2023-09-09T23:58:35.178 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-09T23:58:35.179 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_pdonnell@teuthology --verbose --name pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514 -- /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/orig.config.yaml 2023-09-09T23:58:35.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-09T23:58:35.298 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514 branch: wip-batrick-testing-20230909.145638 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7392514' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-batrick-testing-20230909.145638 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230909.145638 sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5964 sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 sleep_before_teardown: 0 subset: 225/256 suite: fs suite_branch: wip-batrick-testing-20230909.145638 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLybwlcIyj00H+jeLtM8lPFyNiL68Ef1XVNXa8m7uetT2eJy6/Ti3ws/mG5wk8tu62Ndj5Y3aqu/IimCUAAhdgk= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFanmScQKbUsmU2qk9kD/DpJR5YjQLrBNoqA6hS2EXJZivkW1KlXmYgmbGmVBjhQThLp2Ek5bO6LjekpW/Vy6Ow= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-09_19:00:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-09T23:58:35.298 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa; will attempt to use it 2023-09-09T23:58:35.299 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks 2023-09-09T23:58:35.299 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-09T23:58:35.301 INFO:teuthology.task.internal:Checking packages... 2023-09-09T23:58:35.324 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9670cca5bc8e17916865dc84939edfc10b1f2c00' 2023-09-09T23:58:35.325 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-09T23:58:35.325 INFO:teuthology.packaging:ref: None 2023-09-09T23:58:35.325 INFO:teuthology.packaging:tag: None 2023-09-09T23:58:35.326 INFO:teuthology.packaging:branch: wip-batrick-testing-20230909.145638 2023-09-09T23:58:35.326 INFO:teuthology.packaging:sha1: 9670cca5bc8e17916865dc84939edfc10b1f2c00 2023-09-09T23:58:35.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-batrick-testing-20230909.145638 2023-09-09T23:58:35.466 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6025-g9670cca5-1jammy 2023-09-09T23:58:35.467 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-09T23:58:35.474 INFO:teuthology.task.internal:no buildpackages task found 2023-09-09T23:58:35.474 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-09T23:58:35.484 INFO:teuthology.task.internal:Saving configuration 2023-09-09T23:58:35.500 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-09T23:58:35.506 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-09T23:58:35.531 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-09 23:52:57.511702', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFc3+0RgUYf8gBdmc8TVpCETuWOSOEWU1xrli5wTtxuU'} 2023-09-09T23:58:35.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-09 23:52:57.510098', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN8WbN3ZkJqCsACqWYIt8Uaia6BY2wmcONw/BgGiGWj3'} 2023-09-09T23:58:35.554 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-09T23:58:35.561 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-09T23:58:35.561 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-09T23:58:35.561 INFO:teuthology.run_tasks:Running task console_log... 2023-09-09T23:58:35.635 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1b54ffb80>, signals=[15]) 2023-09-09T23:58:35.636 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-09T23:58:35.643 INFO:teuthology.task.internal:Opening connections... 2023-09-09T23:58:35.643 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2023-09-09T23:58:35.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-09T23:58:35.726 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2023-09-09T23:58:35.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-09T23:58:35.803 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-09T23:58:35.811 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-09-09T23:58:35.817 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-09-09T23:58:35.817 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-09-09T23:58:35.864 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-09T23:58:35.864 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2023-09-09T23:58:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2023-09-09T23:58:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-09T23:58:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2023-09-09T23:58:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2023-09-09T23:58:35.865 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2023-09-09T23:58:35.866 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-09T23:58:35.866 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-09T23:58:35.866 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-09T23:58:35.866 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-09T23:58:35.866 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2023-09-09T23:58:35.867 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-09-09T23:58:35.890 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-09-09T23:58:35.895 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-09-09T23:58:35.895 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-09-09T23:58:35.941 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-09T23:58:35.941 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2023-09-09T23:58:35.941 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04" 2023-09-09T23:58:35.941 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-09T23:58:35.942 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy 2023-09-09T23:58:35.942 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2023-09-09T23:58:35.942 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2023-09-09T23:58:35.942 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-09T23:58:35.943 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-09T23:58:35.943 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-09T23:58:35.943 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-09T23:58:35.943 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy 2023-09-09T23:58:35.944 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-09-09T23:58:35.964 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-09T23:58:35.977 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-09T23:58:35.985 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-09T23:58:35.985 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2023-09-09T23:58:35.989 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2023-09-09T23:58:35.994 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-09T23:58:36.001 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-09T23:58:36.002 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2023-09-09T23:58:36.034 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2023-09-09T23:58:36.133 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-09T23:58:36.190 INFO:teuthology.run_tasks:Running task kernel... 2023-09-09T23:58:36.204 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-09T23:58:36.205 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-09T23:58:36.205 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-09T23:58:36.206 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-09T23:58:36.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-09T23:58:36.213 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-09-09T23:58:36.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-09T23:58:36.215 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-09-09T23:58:36.260 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-56-generic 2023-09-09T23:58:36.260 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.15.0-56-generic 2023-09-09T23:58:36.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2023-09-09T23:58:36.262 INFO:teuthology.orchestra.run.smithi100.stdout:5.15.0-56-generic 2023-09-09T23:58:36.262 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.15.0-56-generic 2023-09-09T23:58:36.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2023-09-09T23:58:36.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-09-09T23:58:36.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-09-09T23:58:36.541 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-09T23:58:36.559 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-09-09T23:58:36.617 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-09-09T23:58:36.655 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-09-09T23:58:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-09T23:58:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-09-09T23:58:36.758 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [970 kB] 2023-09-09T23:58:36.764 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-09-09T23:58:36.835 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [484 kB] 2023-09-09T23:58:36.840 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [222 kB] 2023-09-09T23:58:36.842 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-09-09T23:58:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [30.3 kB] 2023-09-09T23:58:36.848 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [838 kB] 2023-09-09T23:58:36.857 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [135 kB] 2023-09-09T23:58:36.858 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [536 B] 2023-09-09T23:58:36.859 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [979 kB] 2023-09-09T23:58:36.869 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [653 kB] 2023-09-09T23:58:36.874 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [213 kB] 2023-09-09T23:58:36.900 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.8 kB] 2023-09-09T23:58:36.900 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-09-09T23:58:36.901 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-09-09T23:58:36.901 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-09-09T23:58:36.901 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [476 B] 2023-09-09T23:58:36.902 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-09-09T23:58:36.902 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-09-09T23:58:36.903 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-09-09T23:58:36.903 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-09-09T23:58:36.917 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-09-09T23:58:36.934 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-09-09T23:58:36.934 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-09-09T23:58:36.935 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-09-09T23:58:37.080 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [319 kB] 2023-09-09T23:58:37.123 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-09-09T23:58:37.126 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [761 kB] 2023-09-09T23:58:37.264 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [970 kB] 2023-09-09T23:58:37.333 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [761 kB] 2023-09-09T23:58:37.471 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [164 kB] 2023-09-09T23:58:37.481 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [319 kB] 2023-09-09T23:58:37.492 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-09-09T23:58:37.493 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [822 kB] 2023-09-09T23:58:37.507 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [164 kB] 2023-09-09T23:58:37.516 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.3 kB] 2023-09-09T23:58:37.516 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [822 kB] 2023-09-09T23:58:37.525 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [484 kB] 2023-09-09T23:58:37.552 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [30.0 kB] 2023-09-09T23:58:37.555 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [132 kB] 2023-09-09T23:58:37.564 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [536 B] 2023-09-09T23:58:37.564 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [781 kB] 2023-09-09T23:58:37.567 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [222 kB] 2023-09-09T23:58:37.582 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.6 kB] 2023-09-09T23:58:37.583 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [838 kB] 2023-09-09T23:58:37.597 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [30.0 kB] 2023-09-09T23:58:37.598 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [132 kB] 2023-09-09T23:58:37.604 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [557 kB] 2023-09-09T23:58:37.608 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [536 B] 2023-09-09T23:58:37.608 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [557 kB] 2023-09-09T23:58:37.633 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [30.3 kB] 2023-09-09T23:58:37.634 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [135 kB] 2023-09-09T23:58:37.640 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [536 B] 2023-09-09T23:58:37.641 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [781 kB] 2023-09-09T23:58:37.787 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [143 kB] 2023-09-09T23:58:37.804 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [979 kB] 2023-09-09T23:58:37.833 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [143 kB] 2023-09-09T23:58:38.168 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-09-09T23:58:38.175 INFO:teuthology.orchestra.run.smithi100.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-09-09T23:58:38.190 INFO:teuthology.orchestra.run.smithi100.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-09-09T23:58:38.191 INFO:teuthology.orchestra.run.smithi100.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-09-09T23:58:38.194 INFO:teuthology.orchestra.run.smithi100.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-09-09T23:58:38.209 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-09-09T23:58:38.217 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-09-09T23:58:38.232 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-09-09T23:58:38.232 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-09-09T23:58:38.236 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-09-09T23:58:38.422 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [653 kB] 2023-09-09T23:58:38.460 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [213 kB] 2023-09-09T23:58:38.473 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [21.8 kB] 2023-09-09T23:58:38.474 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-09-09T23:58:38.476 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-09-09T23:58:38.477 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-09-09T23:58:38.477 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [476 B] 2023-09-09T23:58:38.478 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-09-09T23:58:38.479 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-09-09T23:58:38.504 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-09-09T23:58:38.669 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-09-09T23:58:38.752 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-09-09T23:58:38.848 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-09-09T23:58:38.877 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-09-09T23:58:38.928 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-09-09T23:58:42.427 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 8,880 kB in 2s (5,167 kB/s) 2023-09-09T23:58:43.215 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 8,880 kB in 2s (3,634 kB/s) 2023-09-09T23:58:43.738 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-09T23:58:43.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-09T23:58:43.811 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-09T23:58:43.992 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-09-09T23:58:43.993 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-09-09T23:58:44.142 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-09-09T23:58:44.143 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-09T23:58:44.143 INFO:teuthology.orchestra.run.smithi100.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-09T23:58:44.144 INFO:teuthology.orchestra.run.smithi100.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-09T23:58:44.144 INFO:teuthology.orchestra.run.smithi100.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-09-09T23:58:44.144 INFO:teuthology.orchestra.run.smithi100.stdout: python2.7-minimal 2023-09-09T23:58:44.144 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-09T23:58:44.145 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-09-09T23:58:44.145 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-5.15.0-83 linux-headers-5.15.0-83-generic 2023-09-09T23:58:44.145 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-generic linux-image-5.15.0-83-generic 2023-09-09T23:58:44.145 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-5.15.0-83-generic linux-modules-extra-5.15.0-83-generic 2023-09-09T23:58:44.146 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-09-09T23:58:44.146 INFO:teuthology.orchestra.run.smithi100.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-09-09T23:58:44.146 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2023-09-09T23:58:44.147 INFO:teuthology.orchestra.run.smithi100.stdout: thermald 2023-09-09T23:58:44.190 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-09-09T23:58:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-5.15.0-83 linux-headers-5.15.0-83-generic 2023-09-09T23:58:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.15.0-83-generic linux-modules-5.15.0-83-generic 2023-09-09T23:58:44.191 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-extra-5.15.0-83-generic 2023-09-09T23:58:44.192 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-09-09T23:58:44.192 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-09T23:58:44.240 INFO:teuthology.orchestra.run.smithi100.stdout:3 upgraded, 5 newly installed, 0 to remove and 253 not upgraded. 2023-09-09T23:58:44.241 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 113 MB of archives. 2023-09-09T23:58:44.241 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 582 MB of additional disk space will be used. 2023-09-09T23:58:44.241 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-83-generic amd64 5.15.0-83.92 [22.5 MB] 2023-09-09T23:58:44.476 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-09T23:58:44.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-09T23:58:44.553 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-09T23:58:44.717 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-83-generic amd64 5.15.0-83.92 [11.5 MB] 2023-09-09T23:58:44.736 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-09-09T23:58:44.736 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-09-09T23:58:44.831 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-83-generic amd64 5.15.0-83.92 [63.9 MB] 2023-09-09T23:58:44.893 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-09-09T23:58:44.894 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-09T23:58:44.894 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-09T23:58:44.894 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-09T23:58:44.894 INFO:teuthology.orchestra.run.smithi084.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-09-09T23:58:44.895 INFO:teuthology.orchestra.run.smithi084.stdout: python2.7-minimal 2023-09-09T23:58:44.896 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-09T23:58:44.896 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-09-09T23:58:44.896 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-5.15.0-83 linux-headers-5.15.0-83-generic 2023-09-09T23:58:44.896 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-generic linux-image-5.15.0-83-generic 2023-09-09T23:58:44.896 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-5.15.0-83-generic linux-modules-extra-5.15.0-83-generic 2023-09-09T23:58:44.897 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-09-09T23:58:44.897 INFO:teuthology.orchestra.run.smithi084.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-09-09T23:58:44.897 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2023-09-09T23:58:44.897 INFO:teuthology.orchestra.run.smithi084.stdout: thermald 2023-09-09T23:58:44.944 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-09-09T23:58:44.944 INFO:teuthology.orchestra.run.smithi084.stdout: linux-headers-5.15.0-83 linux-headers-5.15.0-83-generic 2023-09-09T23:58:44.944 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.15.0-83-generic linux-modules-5.15.0-83-generic 2023-09-09T23:58:44.945 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-extra-5.15.0-83-generic 2023-09-09T23:58:44.945 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2023-09-09T23:58:44.946 INFO:teuthology.orchestra.run.smithi084.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-09T23:58:44.994 INFO:teuthology.orchestra.run.smithi084.stdout:3 upgraded, 5 newly installed, 0 to remove and 253 not upgraded. 2023-09-09T23:58:44.995 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 113 MB of archives. 2023-09-09T23:58:44.995 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 582 MB of additional disk space will be used. 2023-09-09T23:58:44.995 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-83-generic amd64 5.15.0-83.92 [22.5 MB] 2023-09-09T23:58:45.430 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-83-generic amd64 5.15.0-83.92 [11.5 MB] 2023-09-09T23:58:45.544 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-83-generic amd64 5.15.0-83.92 [63.9 MB] 2023-09-09T23:58:45.647 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.83.80 [1,698 B] 2023-09-09T23:58:45.648 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.83.80 [2,480 B] 2023-09-09T23:58:45.648 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-83 all 5.15.0-83.92 [12.3 MB] 2023-09-09T23:58:45.772 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-83-generic amd64 5.15.0-83.92 [2,852 kB] 2023-09-09T23:58:45.874 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.83.80 [2,320 B] 2023-09-09T23:58:46.278 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 113 MB in 2s (67.4 MB/s) 2023-09-09T23:58:46.340 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.83.80 [1,698 B] 2023-09-09T23:58:46.341 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.83.80 [2,480 B] 2023-09-09T23:58:46.341 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-83 all 5.15.0-83.92 [12.3 MB] 2023-09-09T23:58:46.448 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-5.15.0-83-generic. 2023-09-09T23:58:46.459 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-83-generic amd64 5.15.0-83.92 [2,852 kB] 2023-09-09T23:58:46.481 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.83.80 [2,320 B] 2023-09-09T23:58:46.893 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 113 MB in 2s (73.9 MB/s) 2023-09-09T23:58:47.067 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-5.15.0-83-generic. 2023-09-09T23:58:48.580 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-09-09T23:58:48.584 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../0-linux-modules-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:48.804 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:49.089 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-09-09T23:58:49.093 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../0-linux-modules-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:49.372 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:51.030 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-image-5.15.0-83-generic. 2023-09-09T23:58:51.051 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../1-linux-image-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:51.134 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:51.523 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-image-5.15.0-83-generic. 2023-09-09T23:58:51.544 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../1-linux-image-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:51.616 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-83-generic. 2023-09-09T23:58:51.637 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:51.654 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:51.674 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-extra-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:52.076 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-83-generic. 2023-09-09T23:58:52.097 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:58:52.126 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-modules-extra-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:58:58.832 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../3-linux-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:58:58.972 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../3-linux-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:58:58.984 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:58:59.074 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:58:59.325 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:58:59.398 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:58:59.479 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:58:59.511 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-image-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:58:59.765 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.15.0-83. 2023-09-09T23:58:59.787 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../5-linux-headers-5.15.0-83_5.15.0-83.92_all.deb ... 2023-09-09T23:58:59.805 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-5.15.0-83. 2023-09-09T23:58:59.816 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../5-linux-headers-5.15.0-83_5.15.0-83.92_all.deb ... 2023-09-09T23:58:59.823 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.15.0-83 (5.15.0-83.92) ... 2023-09-09T23:58:59.855 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-5.15.0-83 (5.15.0-83.92) ... 2023-09-09T23:59:05.814 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package linux-headers-5.15.0-83-generic. 2023-09-09T23:59:05.851 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../6-linux-headers-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:59:05.880 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:05.982 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.15.0-83-generic. 2023-09-09T23:59:06.018 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../6-linux-headers-5.15.0-83-generic_5.15.0-83.92_amd64.deb ... 2023-09-09T23:59:06.073 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:08.399 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:59:08.549 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking linux-headers-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:59:08.712 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.83.80_amd64.deb ... 2023-09-09T23:59:08.852 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-generic (5.15.0.83.80) over (5.15.0.56.54) ... 2023-09-09T23:59:08.882 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-5.15.0-83 (5.15.0-83.92) ... 2023-09-09T23:59:09.004 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:09.138 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-headers-generic (5.15.0.83.80) ... 2023-09-09T23:59:09.202 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.15.0-83 (5.15.0-83.92) ... 2023-09-09T23:59:09.267 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:09.323 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:09.424 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-generic (5.15.0.83.80) ... 2023-09-09T23:59:09.536 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:10.594 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:10.594 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:10.595 INFO:teuthology.orchestra.run.smithi084.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:10.595 INFO:teuthology.orchestra.run.smithi084.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:10.743 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:10.861 INFO:teuthology.orchestra.run.smithi100.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:10.861 INFO:teuthology.orchestra.run.smithi100.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:10.861 INFO:teuthology.orchestra.run.smithi100.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:10.861 INFO:teuthology.orchestra.run.smithi100.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:11.038 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:12.629 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-modules-extra-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:12.766 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-extra-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:14.013 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-image-generic (5.15.0.83.80) ... 2023-09-09T23:59:14.147 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up linux-generic (5.15.0.83.80) ... 2023-09-09T23:59:14.174 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-generic (5.15.0.83.80) ... 2023-09-09T23:59:14.273 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:14.325 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-generic (5.15.0.83.80) ... 2023-09-09T23:59:14.342 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-09T23:59:14.342 INFO:teuthology.orchestra.run.smithi084.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:14.451 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for linux-image-5.15.0-83-generic (5.15.0-83.92) ... 2023-09-09T23:59:14.510 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-09T23:59:14.511 INFO:teuthology.orchestra.run.smithi100.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:28.673 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-09T23:59:28.674 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub' 2023-09-09T23:59:28.694 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-09T23:59:28.711 INFO:teuthology.orchestra.run.smithi100.stdout:Generating grub configuration file ... 2023-09-09T23:59:28.986 INFO:teuthology.orchestra.run.smithi084.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-09T23:59:28.987 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub' 2023-09-09T23:59:28.999 INFO:teuthology.orchestra.run.smithi084.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-09T23:59:29.001 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:29.019 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:29.026 INFO:teuthology.orchestra.run.smithi084.stdout:Generating grub configuration file ... 2023-09-09T23:59:29.268 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:29.287 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:29.295 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:29.301 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:29.366 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-09T23:59:29.371 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-09T23:59:29.529 INFO:teuthology.orchestra.run.smithi100.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-09T23:59:29.530 INFO:teuthology.orchestra.run.smithi100.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-09-09T23:59:29.530 INFO:teuthology.orchestra.run.smithi100.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-09T23:59:29.575 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:29.576 INFO:teuthology.orchestra.run.smithi100.stdout:done 2023-09-09T23:59:29.581 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:29.656 INFO:teuthology.orchestra.run.smithi084.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-09T23:59:29.661 INFO:teuthology.orchestra.run.smithi084.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-09T23:59:29.815 INFO:teuthology.orchestra.run.smithi084.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-09T23:59:29.816 INFO:teuthology.orchestra.run.smithi084.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-09-09T23:59:29.816 INFO:teuthology.orchestra.run.smithi084.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-09T23:59:29.855 INFO:teuthology.orchestra.run.smithi084.stdout:done 2023-09-09T23:59:30.097 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2023-09-09T23:59:30.124 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2023-09-09T23:59:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2023-09-09T23:59:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2023-09-09T23:59:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2023-09-09T23:59:30.125 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 20 2023-09-09T23:59:30.126 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2023-09-09T23:59:30.126 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2023-09-09T23:59:30.126 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2023-09-09T23:59:30.126 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.15.0.83.80 2023-09-09T23:59:30.127 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-83), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-09T23:59:30.127 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.15.0-83-generic, linux-modules-extra-5.15.0-83-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-09T23:59:30.127 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2023-09-09T23:59:30.127 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2023-09-09T23:59:30.128 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2023-09-09T23:59:30.128 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2023-09-09T23:59:30.128 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-83-generic 2023-09-09T23:59:30.128 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-09T23:59:30.129 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-09T23:59:30.129 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-09-09T23:59:30.129 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2023-09-09T23:59:30.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2023-09-09T23:59:30.300 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2023-09-09T23:59:30.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-09-09T23:59:30.326 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2023-09-09T23:59:30.326 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2023-09-09T23:59:30.326 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2023-09-09T23:59:30.327 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2023-09-09T23:59:30.327 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 20 2023-09-09T23:59:30.327 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2023-09-09T23:59:30.327 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2023-09-09T23:59:30.327 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2023-09-09T23:59:30.328 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.83.80 2023-09-09T23:59:30.328 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-83), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-09T23:59:30.328 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-83-generic, linux-modules-extra-5.15.0-83-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-09T23:59:30.328 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2023-09-09T23:59:30.329 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2023-09-09T23:59:30.329 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2023-09-09T23:59:30.329 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2023-09-09T23:59:30.329 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-83-generic 2023-09-09T23:59:30.330 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-09T23:59:30.330 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-09T23:59:30.330 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-09-09T23:59:30.330 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2023-09-09T23:59:30.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get clean 2023-09-09T23:59:30.458 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-09T23:59:30.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-09-09T23:59:30.546 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-09T23:59:30.622 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-09T23:59:30.627 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-09T23:59:30.631 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-09T23:59:30.648 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-09T23:59:30.709 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-09T23:59:30.744 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-09T23:59:31.735 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-09T23:59:31.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-09T23:59:31.812 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-09T23:59:31.925 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-09T23:59:31.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-09T23:59:31.994 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-09-09T23:59:31.995 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-09-09T23:59:31.998 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-09T23:59:32.152 INFO:teuthology.orchestra.run.smithi100.stdout:linux-image-generic is already the newest version (5.15.0.83.80). 2023-09-09T23:59:32.153 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-09-09T23:59:32.153 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-09T23:59:32.153 INFO:teuthology.orchestra.run.smithi100.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-09T23:59:32.153 INFO:teuthology.orchestra.run.smithi100.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-09T23:59:32.154 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-09T23:59:32.154 INFO:teuthology.orchestra.run.smithi100.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-09T23:59:32.154 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-09T23:59:32.181 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-09-09T23:59:32.182 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-09-09T23:59:32.191 INFO:teuthology.orchestra.run.smithi100.stdout:0 upgraded, 0 newly installed, 0 to remove and 253 not upgraded. 2023-09-09T23:59:32.193 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2023-09-09T23:59:32.208 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2023-09-09T23:59:32.209 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2023-09-09T23:59:32.209 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2023-09-09T23:59:32.209 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2023-09-09T23:59:32.209 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 20 2023-09-09T23:59:32.209 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2023-09-09T23:59:32.210 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2023-09-09T23:59:32.210 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2023-09-09T23:59:32.210 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.15.0.83.80 2023-09-09T23:59:32.210 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-83), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-09T23:59:32.210 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.15.0-83-generic, linux-modules-extra-5.15.0-83-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-09T23:59:32.211 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2023-09-09T23:59:32.211 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2023-09-09T23:59:32.211 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2023-09-09T23:59:32.211 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2023-09-09T23:59:32.211 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-09-09T23:59:32.256 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.csTTYynQDs 2023-09-09T23:59:32.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub/grub.cfg /tmp/tmp.csTTYynQDs 2023-09-09T23:59:32.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.csTTYynQDs 2023-09-09T23:59:32.335 INFO:teuthology.orchestra.run.smithi084.stdout:linux-image-generic is already the newest version (5.15.0.83.80). 2023-09-09T23:59:32.335 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-09-09T23:59:32.335 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-09T23:59:32.335 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-09T23:59:32.336 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-09T23:59:32.336 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-09T23:59:32.336 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-09T23:59:32.336 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-09T23:59:32.370 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 0 newly installed, 0 to remove and 253 not upgraded. 2023-09-09T23:59:32.372 DEBUG:teuthology.orchestra.run.smithi084:> dpkg -s linux-image-generic 2023-09-09T23:59:32.387 INFO:teuthology.orchestra.run.smithi084.stdout:Package: linux-image-generic 2023-09-09T23:59:32.388 INFO:teuthology.orchestra.run.smithi084.stdout:Status: install ok installed 2023-09-09T23:59:32.389 INFO:teuthology.orchestra.run.smithi084.stdout:Priority: optional 2023-09-09T23:59:32.389 INFO:teuthology.orchestra.run.smithi084.stdout:Section: kernel 2023-09-09T23:59:32.389 INFO:teuthology.orchestra.run.smithi084.stdout:Installed-Size: 20 2023-09-09T23:59:32.389 INFO:teuthology.orchestra.run.smithi084.stdout:Maintainer: Ubuntu Kernel Team 2023-09-09T23:59:32.389 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: amd64 2023-09-09T23:59:32.390 INFO:teuthology.orchestra.run.smithi084.stdout:Source: linux-meta 2023-09-09T23:59:32.390 INFO:teuthology.orchestra.run.smithi084.stdout:Version: 5.15.0.83.80 2023-09-09T23:59:32.390 INFO:teuthology.orchestra.run.smithi084.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-83), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-09-09T23:59:32.390 INFO:teuthology.orchestra.run.smithi084.stdout:Depends: linux-image-5.15.0-83-generic, linux-modules-extra-5.15.0-83-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-09T23:59:32.391 INFO:teuthology.orchestra.run.smithi084.stdout:Recommends: thermald 2023-09-09T23:59:32.391 INFO:teuthology.orchestra.run.smithi084.stdout:Description: Generic Linux kernel image 2023-09-09T23:59:32.391 INFO:teuthology.orchestra.run.smithi084.stdout: This package will always depend on the latest generic kernel image 2023-09-09T23:59:32.391 INFO:teuthology.orchestra.run.smithi084.stdout: available. 2023-09-09T23:59:32.392 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-09-09T23:59:32.425 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.csTTYynQDs is 10KB 2023-09-09T23:59:32.436 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.SP36a6v1UV 2023-09-09T23:59:32.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SP36a6v1UV 2023-09-09T23:59:32.439 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.csTTYynQDs 2023-09-09T23:59:32.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.499 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-09T23:59:32.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.SP36a6v1UV 2023-09-09T23:59:32.566 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-83-generic 2023-09-09T23:59:32.567 DEBUG:teuthology.orchestra.run.smithi100:> sudo update-grub 2023-09-09T23:59:32.622 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.SP36a6v1UV is 10KB 2023-09-09T23:59:32.634 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.SP36a6v1UV 2023-09-09T23:59:32.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.695 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-09T23:59:32.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-09T23:59:32.773 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-83-generic 2023-09-09T23:59:32.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo update-grub 2023-09-09T23:59:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub' 2023-09-09T23:59:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-09T23:59:33.809 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-09-09T23:59:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub' 2023-09-09T23:59:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-09T23:59:33.915 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2023-09-09T23:59:34.023 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:34.030 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:34.101 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-83-generic 2023-09-09T23:59:34.107 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-83-generic 2023-09-09T23:59:34.270 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:34.276 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:34.318 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-09T23:59:34.323 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-09T23:59:34.346 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-09-09T23:59:34.351 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-09-09T23:59:34.396 INFO:teuthology.orchestra.run.smithi084.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-09-09T23:59:34.401 INFO:teuthology.orchestra.run.smithi084.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-09-09T23:59:34.464 INFO:teuthology.orchestra.run.smithi100.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-09T23:59:34.465 INFO:teuthology.orchestra.run.smithi100.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-09T23:59:34.465 INFO:teuthology.orchestra.run.smithi100.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-09T23:59:34.479 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-09-09T23:59:34.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2023-09-09T23:59:34.529 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-09-09T23:59:34.530 INFO:teuthology.orchestra.run.smithi084.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-09-09T23:59:34.530 INFO:teuthology.orchestra.run.smithi084.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-09-09T23:59:34.541 INFO:teuthology.orchestra.run.smithi084.stderr:done 2023-09-09T23:59:34.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2023-09-10T00:00:04.513 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-09-10T00:00:04.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:00:04.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:00:04.548 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-09-10T00:00:04.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:00:04.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:00:22.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-09-10T00:00:31.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:00:31.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:00:35.034 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-09-10T00:00:39.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-10T00:00:47.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:00:47.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:00:48.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:00:48.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:01:05.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-09-10T00:01:06.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-09-10T00:01:18.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:01:18.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:01:18.906 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-09-10T00:01:19.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:01:19.681 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-83-generic"... 2023-09-10T00:01:19.682 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2023-09-10T00:01:19.688 INFO:teuthology.orchestra.run.smithi084.stdout:5.15.0-83-generic 2023-09-10T00:01:19.688 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-83-generic vs 5.15.0-83-generic 2023-09-10T00:01:19.689 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-10T00:01:19.689 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-10T00:01:20.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:01:20.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:01:20.690 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-10T00:01:20.691 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-10T00:01:20.823 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2023-09-10T00:01:20.853 DEBUG:teuthology.parallel:result is None 2023-09-10T00:01:20.929 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-09-10T00:01:21.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:01:21.471 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-83-generic"... 2023-09-10T00:01:21.471 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-09-10T00:01:21.518 INFO:teuthology.orchestra.run.smithi100.stdout:5.15.0-83-generic 2023-09-10T00:01:21.518 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-83-generic vs 5.15.0-83-generic 2023-09-10T00:01:21.519 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-10T00:01:21.519 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-10T00:01:22.520 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-09-10T00:01:22.521 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-10T00:01:22.590 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2023-09-10T00:01:22.620 DEBUG:teuthology.parallel:result is None 2023-09-10T00:01:22.620 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-10T00:01:22.651 INFO:teuthology.task.internal:Creating test directory... 2023-09-10T00:01:22.651 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-10T00:01:22.654 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-10T00:01:22.659 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-10T00:01:22.706 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-10T00:01:22.718 INFO:teuthology.task.internal:Creating archive directory... 2023-09-10T00:01:22.718 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-10T00:01:22.721 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-10T00:01:22.745 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-10T00:01:22.755 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-10T00:01:22.756 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-10T00:01:22.776 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-10T00:01:22.816 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-10T00:01:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-10T00:01:22.824 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-10T00:01:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-10T00:01:22.828 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-10T00:01:22.849 INFO:teuthology.task.internal:Configuring sudo... 2023-09-10T00:01:22.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-10T00:01:22.868 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-10T00:01:22.882 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-10T00:01:22.904 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-10T00:01:22.904 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-10T00:01:22.924 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-10T00:01:22.930 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-10T00:01:22.975 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-10T00:01:23.024 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:01:23.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-10T00:01:23.090 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-10T00:01:23.097 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-10T00:01:23.143 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:01:23.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-10T00:01:23.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2023-09-10T00:01:23.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2023-09-10T00:01:23.309 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-10T00:01:23.387 INFO:teuthology.task.internal:Starting timer... 2023-09-10T00:01:23.388 INFO:teuthology.run_tasks:Running task pcp... 2023-09-10T00:01:23.398 INFO:teuthology.run_tasks:Running task selinux... 2023-09-10T00:01:23.407 DEBUG:teuthology.task.selinux:Excluding smithi084: OS 'ubuntu' does not support SELinux 2023-09-10T00:01:23.407 DEBUG:teuthology.task.selinux:Excluding smithi100: OS 'ubuntu' does not support SELinux 2023-09-10T00:01:23.407 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-10T00:01:23.408 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-10T00:01:23.408 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-10T00:01:23.408 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-10T00:01:23.422 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-10T00:01:23.428 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-10T00:01:23.575 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-10T00:01:23.621 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-10T00:01:23.623 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-10T00:08:58.286 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2023-09-10T00:08:58.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:08:58.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:08:58.362 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-09-10T00:08:58.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-09-10T00:08:58.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:08:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-10T00:08:58.555 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-09-10T00:08:58.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-09-10T00:08:58.654 INFO:teuthology.run_tasks:Running task clock... 2023-09-10T00:08:58.664 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-10T00:08:58.664 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-10T00:08:58.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-10T00:08:58.667 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-10T00:08:58.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-10T00:08:58.694 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-10T00:08:58.694 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Command line: ntpd -gq 2023-09-10T00:08:58.694 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: ---------------------------------------------------- 2023-09-10T00:08:58.694 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: ntp-4 is maintained by Network Time Foundation, 2023-09-10T00:08:58.694 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-10T00:08:58.695 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: corporation. Support and training for ntp-4 are 2023-09-10T00:08:58.695 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: available at https://www.nwtime.org/support 2023-09-10T00:08:58.695 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: ---------------------------------------------------- 2023-09-10T00:08:58.696 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: proto: precision = 0.066 usec (-24) 2023-09-10T00:08:58.696 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: basedate set to 2022-02-04 2023-09-10T00:08:58.696 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: gps base set to 2022-02-06 (week 2196) 2023-09-10T00:08:58.697 INFO:teuthology.orchestra.run.smithi084.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-10T00:08:58.697 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-10T00:08:58.698 INFO:teuthology.orchestra.run.smithi084.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-10T00:08:58.699 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: restrict ::: KOD does nothing without LIMITED. 2023-09-10T00:08:58.699 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen and drop on 0 v6wildcard [::]:123 2023-09-10T00:08:58.699 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-10T00:08:58.699 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen normally on 2 lo 127.0.0.1:123 2023-09-10T00:08:58.699 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen normally on 3 enp3s0f1 172.21.15.84:123 2023-09-10T00:08:58.700 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen normally on 4 lo [::1]:123 2023-09-10T00:08:58.700 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d751%5]:123 2023-09-10T00:08:58.700 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:08:58 ntpd[27861]: Listening on routing socket on fd #22 for interface updates 2023-09-10T00:08:58.723 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-09-10T00:08:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Command line: ntpd -gq 2023-09-10T00:08:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: ---------------------------------------------------- 2023-09-10T00:08:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: ntp-4 is maintained by Network Time Foundation, 2023-09-10T00:08:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-09-10T00:08:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: corporation. Support and training for ntp-4 are 2023-09-10T00:08:58.725 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: available at https://www.nwtime.org/support 2023-09-10T00:08:58.725 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: ---------------------------------------------------- 2023-09-10T00:08:58.726 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: proto: precision = 0.044 usec (-24) 2023-09-10T00:08:58.726 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: basedate set to 2022-02-04 2023-09-10T00:08:58.726 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: gps base set to 2022-02-06 (week 2196) 2023-09-10T00:08:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-10T00:08:58.727 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-10T00:08:58.727 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: restrict ::: KOD does nothing without LIMITED. 2023-09-10T00:08:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-10T00:08:58.728 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen and drop on 0 v6wildcard [::]:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen normally on 2 lo 127.0.0.1:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen normally on 3 enp3s0f1 172.21.15.100:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen normally on 4 lo [::1]:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d733%5]:123 2023-09-10T00:08:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:08:58 ntpd[27839]: Listening on routing socket on fd #22 for interface updates 2023-09-10T00:08:59.694 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:08:59.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:08:59 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:08:59.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:08:59.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:08:59.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:08:59.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:08:59.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:08:59.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:08:59.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:08:59.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:08:59 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:00.694 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:00.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:00 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:01.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:01.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:01.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:01 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:01.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:01.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:01.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:01.729 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:01.730 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:01 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:02.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:02.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:02.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:02.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:02.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:02.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:02.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:02.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:02 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:03 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:03.727 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:03.729 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:03.729 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:03.729 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:03 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:04.694 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:04.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:04 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:05.698 INFO:teuthology.orchestra.run.smithi084.stdout:10 Sep 00:09:05 ntpd[27861]: ntpd: time slew -0.000088 s 2023-09-10T00:09:05.698 INFO:teuthology.orchestra.run.smithi084.stdout:ntpd: time slew -0.000088s 2023-09-10T00:09:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-10T00:09:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:10 Sep 00:09:05 ntpd[27861]: can't open /var/log/ntpstats/loopstats.20230910: Permission denied 2023-09-10T00:09:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-10T00:09:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/rawstats.20230910: Permission denied 2023-09-10T00:09:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-10T00:09:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/peerstats.20230910: Permission denied 2023-09-10T00:09:05.727 INFO:teuthology.orchestra.run.smithi100.stdout:10 Sep 00:09:05 ntpd[27839]: ntpd: time slew -0.002775 s 2023-09-10T00:09:05.727 INFO:teuthology.orchestra.run.smithi100.stdout:ntpd: time slew -0.002775s 2023-09-10T00:09:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-10T00:09:05.728 INFO:teuthology.orchestra.run.smithi100.stderr:10 Sep 00:09:05 ntpd[27839]: can't open /var/log/ntpstats/loopstats.20230910: Permission denied 2023-09-10T00:09:05.764 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2023-09-10T00:09:05.765 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2023-09-10T00:09:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.765 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.831 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2023-09-10T00:09:05.832 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2023-09-10T00:09:05.832 INFO:teuthology.orchestra.run.smithi100.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.832 INFO:teuthology.orchestra.run.smithi100.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.832 INFO:teuthology.orchestra.run.smithi100.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.833 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-09-10T00:09:05.834 INFO:teuthology.run_tasks:Running task install... 2023-09-10T00:09:05.943 DEBUG:teuthology.task.install:project ceph 2023-09-10T00:09:05.944 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'}} 2023-09-10T00:09:05.944 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'} 2023-09-10T00:09:05.944 INFO:teuthology.task.install:Using flavor: default 2023-09-10T00:09:05.950 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-10T00:09:05.951 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-10T00:09:05.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-key list | grep Ceph 2023-09-10T00:09:05.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-key list | grep Ceph 2023-09-10T00:09:06.011 INFO:teuthology.orchestra.run.smithi084.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-10T00:09:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-09-10T00:09:06.039 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-10T00:09:06.039 INFO:teuthology.orchestra.run.smithi084.stdout:uid [ unknown] Ceph.com (release key) 2023-09-10T00:09:06.039 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-10T00:09:06.040 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph.com (release key) 2023-09-10T00:09:06.040 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-10T00:09:06.040 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-10T00:09:06.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9670cca5bc8e17916865dc84939edfc10b1f2c00 2023-09-10T00:09:06.043 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-09-10T00:09:06.043 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-09-10T00:09:06.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9670cca5bc8e17916865dc84939edfc10b1f2c00 2023-09-10T00:09:06.189 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default/ 2023-09-10T00:09:06.189 INFO:teuthology.task.install.deb:Package version is 18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:09:06.195 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default/ 2023-09-10T00:09:06.195 INFO:teuthology.task.install.deb:Package version is 18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:09:06.299 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:09:06.300 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-10T00:09:06.304 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:09:06.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-10T00:09:06.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get update 2023-09-10T00:09:06.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2023-09-10T00:09:06.480 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-10T00:09:06.484 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-09-10T00:09:06.485 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-10T00:09:06.491 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-10T00:09:06.494 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-09-10T00:09:06.508 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-10T00:09:06.511 INFO:teuthology.orchestra.run.smithi084.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-09-10T00:09:06.540 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy InRelease 2023-09-10T00:09:06.561 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-09-10T00:09:06.583 INFO:teuthology.orchestra.run.smithi084.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-10T00:09:06.597 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy InRelease 2023-09-10T00:09:06.602 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-09-10T00:09:06.604 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-09-10T00:09:06.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-10T00:09:06.633 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-09-10T00:09:06.671 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy Release.gpg 2023-09-10T00:09:06.707 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2023-09-10T00:09:06.749 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-09-10T00:09:06.834 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 28.5 kB in 0s (83.6 kB/s) 2023-09-10T00:09:06.854 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 28.5 kB in 0s (79.8 kB/s) 2023-09-10T00:09:07.690 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-10T00:09:07.691 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-10T00:09:07.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6025-g9670cca5-1jammy cephadm=18.0.0-6025-g9670cca5-1jammy ceph-mds=18.0.0-6025-g9670cca5-1jammy ceph-mgr=18.0.0-6025-g9670cca5-1jammy ceph-common=18.0.0-6025-g9670cca5-1jammy ceph-fuse=18.0.0-6025-g9670cca5-1jammy ceph-test=18.0.0-6025-g9670cca5-1jammy ceph-volume=18.0.0-6025-g9670cca5-1jammy radosgw=18.0.0-6025-g9670cca5-1jammy python3-rados=18.0.0-6025-g9670cca5-1jammy python3-rgw=18.0.0-6025-g9670cca5-1jammy python3-cephfs=18.0.0-6025-g9670cca5-1jammy python3-rbd=18.0.0-6025-g9670cca5-1jammy libcephfs2=18.0.0-6025-g9670cca5-1jammy libcephfs-dev=18.0.0-6025-g9670cca5-1jammy librados2=18.0.0-6025-g9670cca5-1jammy librbd1=18.0.0-6025-g9670cca5-1jammy rbd-fuse=18.0.0-6025-g9670cca5-1jammy python3-cephfs=18.0.0-6025-g9670cca5-1jammy cephfs-shell=18.0.0-6025-g9670cca5-1jammy cephfs-top=18.0.0-6025-g9670cca5-1jammy cephfs-mirror=18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:09:07.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6025-g9670cca5-1jammy cephadm=18.0.0-6025-g9670cca5-1jammy ceph-mds=18.0.0-6025-g9670cca5-1jammy ceph-mgr=18.0.0-6025-g9670cca5-1jammy ceph-common=18.0.0-6025-g9670cca5-1jammy ceph-fuse=18.0.0-6025-g9670cca5-1jammy ceph-test=18.0.0-6025-g9670cca5-1jammy ceph-volume=18.0.0-6025-g9670cca5-1jammy radosgw=18.0.0-6025-g9670cca5-1jammy python3-rados=18.0.0-6025-g9670cca5-1jammy python3-rgw=18.0.0-6025-g9670cca5-1jammy python3-cephfs=18.0.0-6025-g9670cca5-1jammy python3-rbd=18.0.0-6025-g9670cca5-1jammy libcephfs2=18.0.0-6025-g9670cca5-1jammy libcephfs-dev=18.0.0-6025-g9670cca5-1jammy librados2=18.0.0-6025-g9670cca5-1jammy librbd1=18.0.0-6025-g9670cca5-1jammy rbd-fuse=18.0.0-6025-g9670cca5-1jammy python3-cephfs=18.0.0-6025-g9670cca5-1jammy cephfs-shell=18.0.0-6025-g9670cca5-1jammy cephfs-top=18.0.0-6025-g9670cca5-1jammy cephfs-mirror=18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:09:07.758 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-10T00:09:07.763 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-10T00:09:07.920 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-09-10T00:09:07.920 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-09-10T00:09:07.943 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-09-10T00:09:07.944 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-09-10T00:09:08.066 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-09-10T00:09:08.066 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-10T00:09:08.067 INFO:teuthology.orchestra.run.smithi100.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-10T00:09:08.067 INFO:teuthology.orchestra.run.smithi100.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-10T00:09:08.070 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-10T00:09:08.070 INFO:teuthology.orchestra.run.smithi100.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-10T00:09:08.071 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-10T00:09:08.071 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-09-10T00:09:08.071 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-10T00:09:08.071 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-10T00:09:08.072 INFO:teuthology.orchestra.run.smithi100.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-10T00:09:08.072 INFO:teuthology.orchestra.run.smithi100.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-10T00:09:08.072 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-10T00:09:08.072 INFO:teuthology.orchestra.run.smithi100.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-10T00:09:08.072 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-10T00:09:08.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-10T00:09:08.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-10T00:09:08.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-10T00:09:08.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-10T00:09:08.073 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-10T00:09:08.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-10T00:09:08.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-10T00:09:08.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-10T00:09:08.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-10T00:09:08.074 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-10T00:09:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-10T00:09:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-10T00:09:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-10T00:09:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-10T00:09:08.075 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-10T00:09:08.076 INFO:teuthology.orchestra.run.smithi100.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-10T00:09:08.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-10T00:09:08.077 INFO:teuthology.orchestra.run.smithi100.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-10T00:09:08.077 INFO:teuthology.orchestra.run.smithi100.stdout: python3-watchdog 2023-09-10T00:09:08.077 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2023-09-10T00:09:08.077 INFO:teuthology.orchestra.run.smithi100.stdout: btrfs-tools 2023-09-10T00:09:08.091 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-09-10T00:09:08.091 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-10T00:09:08.091 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-10T00:09:08.092 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-10T00:09:08.092 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-10T00:09:08.093 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-10T00:09:08.094 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-10T00:09:08.094 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-09-10T00:09:08.094 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-10T00:09:08.094 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-09-10T00:09:08.095 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-10T00:09:08.095 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-09-10T00:09:08.095 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-09-10T00:09:08.095 INFO:teuthology.orchestra.run.smithi084.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-09-10T00:09:08.095 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-09-10T00:09:08.096 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-09-10T00:09:08.096 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-09-10T00:09:08.096 INFO:teuthology.orchestra.run.smithi084.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-09-10T00:09:08.096 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-09-10T00:09:08.096 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-09-10T00:09:08.097 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-09-10T00:09:08.097 INFO:teuthology.orchestra.run.smithi084.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-10T00:09:08.097 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-09-10T00:09:08.097 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-09-10T00:09:08.097 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-09-10T00:09:08.098 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-09-10T00:09:08.098 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-09-10T00:09:08.098 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-09-10T00:09:08.098 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-09-10T00:09:08.098 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-09-10T00:09:08.099 INFO:teuthology.orchestra.run.smithi084.stdout: qttranslations5-l10n socat xmlstarlet 2023-09-10T00:09:08.099 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-09-10T00:09:08.099 INFO:teuthology.orchestra.run.smithi084.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-09-10T00:09:08.100 INFO:teuthology.orchestra.run.smithi084.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-09-10T00:09:08.100 INFO:teuthology.orchestra.run.smithi084.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-09-10T00:09:08.100 INFO:teuthology.orchestra.run.smithi084.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-09-10T00:09:08.100 INFO:teuthology.orchestra.run.smithi084.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-09-10T00:09:08.100 INFO:teuthology.orchestra.run.smithi084.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-09-10T00:09:08.101 INFO:teuthology.orchestra.run.smithi084.stdout: python3-watchdog 2023-09-10T00:09:08.101 INFO:teuthology.orchestra.run.smithi084.stdout:Recommended packages: 2023-09-10T00:09:08.101 INFO:teuthology.orchestra.run.smithi084.stdout: btrfs-tools 2023-09-10T00:09:08.167 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-09-10T00:09:08.168 INFO:teuthology.orchestra.run.smithi100.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-10T00:09:08.168 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-10T00:09:08.168 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-10T00:09:08.168 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-10T00:09:08.168 INFO:teuthology.orchestra.run.smithi100.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-10T00:09:08.169 INFO:teuthology.orchestra.run.smithi100.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-10T00:09:08.169 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-10T00:09:08.170 INFO:teuthology.orchestra.run.smithi100.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-10T00:09:08.170 INFO:teuthology.orchestra.run.smithi100.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-10T00:09:08.170 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-10T00:09:08.170 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-10T00:09:08.171 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-10T00:09:08.171 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-10T00:09:08.171 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-10T00:09:08.171 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-10T00:09:08.171 INFO:teuthology.orchestra.run.smithi100.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-10T00:09:08.172 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-10T00:09:08.172 INFO:teuthology.orchestra.run.smithi100.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-10T00:09:08.172 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-10T00:09:08.172 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-10T00:09:08.172 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-10T00:09:08.173 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-10T00:09:08.173 INFO:teuthology.orchestra.run.smithi100.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-10T00:09:08.173 INFO:teuthology.orchestra.run.smithi100.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-10T00:09:08.173 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-10T00:09:08.174 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-10T00:09:08.174 INFO:teuthology.orchestra.run.smithi100.stdout: socat xmlstarlet 2023-09-10T00:09:08.193 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-09-10T00:09:08.193 INFO:teuthology.orchestra.run.smithi084.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-10T00:09:08.194 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-10T00:09:08.194 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-10T00:09:08.195 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-09-10T00:09:08.195 INFO:teuthology.orchestra.run.smithi084.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-09-10T00:09:08.195 INFO:teuthology.orchestra.run.smithi084.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-09-10T00:09:08.196 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-09-10T00:09:08.196 INFO:teuthology.orchestra.run.smithi084.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-09-10T00:09:08.196 INFO:teuthology.orchestra.run.smithi084.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-09-10T00:09:08.196 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-09-10T00:09:08.196 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-09-10T00:09:08.197 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-09-10T00:09:08.197 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-09-10T00:09:08.197 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-09-10T00:09:08.197 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-09-10T00:09:08.197 INFO:teuthology.orchestra.run.smithi084.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-09-10T00:09:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-09-10T00:09:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-10T00:09:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-09-10T00:09:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-09-10T00:09:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-09-10T00:09:08.199 INFO:teuthology.orchestra.run.smithi084.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-10T00:09:08.199 INFO:teuthology.orchestra.run.smithi084.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-09-10T00:09:08.199 INFO:teuthology.orchestra.run.smithi084.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-09-10T00:09:08.199 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-09-10T00:09:08.200 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-09-10T00:09:08.200 INFO:teuthology.orchestra.run.smithi084.stdout: socat xmlstarlet 2023-09-10T00:09:08.227 INFO:teuthology.orchestra.run.smithi100.stdout:0 upgraded, 115 newly installed, 0 to remove and 241 not upgraded. 2023-09-10T00:09:08.227 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 183 MB of archives. 2023-09-10T00:09:08.227 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 823 MB of additional disk space will be used. 2023-09-10T00:09:08.228 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-10T00:09:08.245 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-10T00:09:08.253 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 115 newly installed, 0 to remove and 241 not upgraded. 2023-09-10T00:09:08.253 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 183 MB of archives. 2023-09-10T00:09:08.253 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 823 MB of additional disk space will be used. 2023-09-10T00:09:08.253 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-09-10T00:09:08.255 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-10T00:09:08.270 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-09-10T00:09:08.280 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-09-10T00:09:08.296 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-10T00:09:08.305 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-10T00:09:08.320 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-09-10T00:09:08.322 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-10T00:09:08.325 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-10T00:09:08.329 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-09-10T00:09:08.334 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-10T00:09:08.337 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6025-g9670cca5-1jammy [3,402 kB] 2023-09-10T00:09:08.345 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-09-10T00:09:08.348 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-09-10T00:09:08.357 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-09-10T00:09:08.380 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-10T00:09:08.384 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-10T00:09:08.395 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-10T00:09:08.399 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-10T00:09:08.399 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-10T00:09:08.404 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-09-10T00:09:08.407 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-10T00:09:08.408 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-09-10T00:09:08.408 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-10T00:09:08.409 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-10T00:09:08.409 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-10T00:09:08.410 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-10T00:09:08.410 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6025-g9670cca5-1jammy [3,402 kB] 2023-09-10T00:09:08.418 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-09-10T00:09:08.419 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-10T00:09:08.419 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-10T00:09:08.422 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-09-10T00:09:08.423 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-09-10T00:09:08.431 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-09-10T00:09:08.431 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-09-10T00:09:08.432 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-09-10T00:09:08.433 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-09-10T00:09:08.433 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-09-10T00:09:08.435 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-10T00:09:08.436 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-10T00:09:08.436 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-10T00:09:08.439 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-10T00:09:08.439 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-10T00:09:08.440 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-10T00:09:08.440 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-10T00:09:08.441 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-09-10T00:09:08.442 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-10T00:09:08.442 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-09-10T00:09:08.453 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-10T00:09:08.453 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-10T00:09:08.458 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-09-10T00:09:08.459 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-09-10T00:09:08.459 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-09-10T00:09:08.461 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-09-10T00:09:08.462 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-09-10T00:09:08.462 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-09-10T00:09:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-09-10T00:09:08.463 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-10T00:09:08.470 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-10T00:09:08.472 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-10T00:09:08.472 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-10T00:09:08.475 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-09-10T00:09:08.475 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-09-10T00:09:08.477 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-10T00:09:08.477 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-10T00:09:08.477 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-10T00:09:08.478 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-10T00:09:08.479 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-10T00:09:08.487 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-10T00:09:08.488 INFO:teuthology.orchestra.run.smithi100.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-10T00:09:08.492 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-09-10T00:09:08.493 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-09-10T00:09:08.494 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-09-10T00:09:08.499 INFO:teuthology.orchestra.run.smithi100.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-10T00:09:08.500 INFO:teuthology.orchestra.run.smithi100.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-10T00:09:08.503 INFO:teuthology.orchestra.run.smithi100.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-10T00:09:08.503 INFO:teuthology.orchestra.run.smithi100.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-10T00:09:08.504 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-09-10T00:09:08.504 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-09-10T00:09:08.505 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-09-10T00:09:08.506 INFO:teuthology.orchestra.run.smithi100.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-10T00:09:08.506 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-09-10T00:09:08.508 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-09-10T00:09:08.512 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-09-10T00:09:08.513 INFO:teuthology.orchestra.run.smithi084.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-09-10T00:09:08.527 INFO:teuthology.orchestra.run.smithi084.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-09-10T00:09:08.529 INFO:teuthology.orchestra.run.smithi084.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-09-10T00:09:08.533 INFO:teuthology.orchestra.run.smithi084.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-09-10T00:09:08.534 INFO:teuthology.orchestra.run.smithi084.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-09-10T00:09:08.538 INFO:teuthology.orchestra.run.smithi084.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-09-10T00:09:08.557 INFO:teuthology.orchestra.run.smithi100.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-10T00:09:08.558 INFO:teuthology.orchestra.run.smithi100.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-10T00:09:08.560 INFO:teuthology.orchestra.run.smithi100.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-10T00:09:08.560 INFO:teuthology.orchestra.run.smithi100.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-10T00:09:08.560 INFO:teuthology.orchestra.run.smithi100.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-10T00:09:08.561 INFO:teuthology.orchestra.run.smithi100.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-10T00:09:08.578 INFO:teuthology.orchestra.run.smithi100.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-10T00:09:08.580 INFO:teuthology.orchestra.run.smithi100.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-10T00:09:08.580 INFO:teuthology.orchestra.run.smithi100.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-10T00:09:08.595 INFO:teuthology.orchestra.run.smithi100.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-10T00:09:08.595 INFO:teuthology.orchestra.run.smithi100.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-10T00:09:08.595 INFO:teuthology.orchestra.run.smithi100.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-10T00:09:08.596 INFO:teuthology.orchestra.run.smithi100.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-10T00:09:08.596 INFO:teuthology.orchestra.run.smithi100.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-10T00:09:08.597 INFO:teuthology.orchestra.run.smithi100.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-10T00:09:08.604 INFO:teuthology.orchestra.run.smithi084.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-09-10T00:09:08.605 INFO:teuthology.orchestra.run.smithi084.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-09-10T00:09:08.606 INFO:teuthology.orchestra.run.smithi084.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-09-10T00:09:08.607 INFO:teuthology.orchestra.run.smithi084.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-10T00:09:08.607 INFO:teuthology.orchestra.run.smithi084.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-09-10T00:09:08.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-10T00:09:08.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-10T00:09:08.614 INFO:teuthology.orchestra.run.smithi100.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-10T00:09:08.617 INFO:teuthology.orchestra.run.smithi084.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-09-10T00:09:08.617 INFO:teuthology.orchestra.run.smithi084.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6025-g9670cca5-1jammy [3,120 kB] 2023-09-10T00:09:08.628 INFO:teuthology.orchestra.run.smithi100.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-10T00:09:08.629 INFO:teuthology.orchestra.run.smithi100.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-10T00:09:08.630 INFO:teuthology.orchestra.run.smithi100.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-10T00:09:08.633 INFO:teuthology.orchestra.run.smithi100.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-10T00:09:08.635 INFO:teuthology.orchestra.run.smithi084.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-09-10T00:09:08.635 INFO:teuthology.orchestra.run.smithi100.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-10T00:09:08.636 INFO:teuthology.orchestra.run.smithi100.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-10T00:09:08.637 INFO:teuthology.orchestra.run.smithi084.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-09-10T00:09:08.637 INFO:teuthology.orchestra.run.smithi084.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-09-10T00:09:08.639 INFO:teuthology.orchestra.run.smithi100.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-10T00:09:08.645 INFO:teuthology.orchestra.run.smithi100.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-10T00:09:08.646 INFO:teuthology.orchestra.run.smithi100.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-10T00:09:08.646 INFO:teuthology.orchestra.run.smithi100.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-10T00:09:08.653 INFO:teuthology.orchestra.run.smithi084.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-09-10T00:09:08.653 INFO:teuthology.orchestra.run.smithi084.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-09-10T00:09:08.654 INFO:teuthology.orchestra.run.smithi084.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-09-10T00:09:08.655 INFO:teuthology.orchestra.run.smithi084.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-09-10T00:09:08.655 INFO:teuthology.orchestra.run.smithi084.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-09-10T00:09:08.655 INFO:teuthology.orchestra.run.smithi084.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-09-10T00:09:08.662 INFO:teuthology.orchestra.run.smithi084.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-09-10T00:09:08.663 INFO:teuthology.orchestra.run.smithi100.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-10T00:09:08.663 INFO:teuthology.orchestra.run.smithi084.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-09-10T00:09:08.664 INFO:teuthology.orchestra.run.smithi100.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-10T00:09:08.665 INFO:teuthology.orchestra.run.smithi100.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-10T00:09:08.666 INFO:teuthology.orchestra.run.smithi084.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-09-10T00:09:08.671 INFO:teuthology.orchestra.run.smithi100.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-10T00:09:08.671 INFO:teuthology.orchestra.run.smithi100.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-10T00:09:08.672 INFO:teuthology.orchestra.run.smithi100.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-10T00:09:08.673 INFO:teuthology.orchestra.run.smithi100.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-10T00:09:08.679 INFO:teuthology.orchestra.run.smithi084.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-09-10T00:09:08.680 INFO:teuthology.orchestra.run.smithi100.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-10T00:09:08.681 INFO:teuthology.orchestra.run.smithi084.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-09-10T00:09:08.681 INFO:teuthology.orchestra.run.smithi084.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-09-10T00:09:08.684 INFO:teuthology.orchestra.run.smithi084.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-09-10T00:09:08.687 INFO:teuthology.orchestra.run.smithi084.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-09-10T00:09:08.687 INFO:teuthology.orchestra.run.smithi084.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-09-10T00:09:08.693 INFO:teuthology.orchestra.run.smithi084.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-09-10T00:09:08.696 INFO:teuthology.orchestra.run.smithi084.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-09-10T00:09:08.697 INFO:teuthology.orchestra.run.smithi084.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-10T00:09:08.697 INFO:teuthology.orchestra.run.smithi084.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-09-10T00:09:08.713 INFO:teuthology.orchestra.run.smithi084.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-09-10T00:09:08.714 INFO:teuthology.orchestra.run.smithi084.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-09-10T00:09:08.715 INFO:teuthology.orchestra.run.smithi084.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-09-10T00:09:08.722 INFO:teuthology.orchestra.run.smithi084.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-09-10T00:09:08.722 INFO:teuthology.orchestra.run.smithi084.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-09-10T00:09:08.723 INFO:teuthology.orchestra.run.smithi084.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-09-10T00:09:08.724 INFO:teuthology.orchestra.run.smithi084.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-09-10T00:09:08.730 INFO:teuthology.orchestra.run.smithi084.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-09-10T00:09:08.752 INFO:teuthology.orchestra.run.smithi084.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6025-g9670cca5-1jammy [670 kB] 2023-09-10T00:09:08.782 INFO:teuthology.orchestra.run.smithi084.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6025-g9670cca5-1jammy [345 kB] 2023-09-10T00:09:08.797 INFO:teuthology.orchestra.run.smithi084.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6025-g9670cca5-1jammy [23.0 kB] 2023-09-10T00:09:08.798 INFO:teuthology.orchestra.run.smithi084.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6025-g9670cca5-1jammy [170 kB] 2023-09-10T00:09:08.803 INFO:teuthology.orchestra.run.smithi084.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6025-g9670cca5-1jammy [52.4 kB] 2023-09-10T00:09:08.805 INFO:teuthology.orchestra.run.smithi084.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6025-g9670cca5-1jammy [318 kB] 2023-09-10T00:09:08.823 INFO:teuthology.orchestra.run.smithi084.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6025-g9670cca5-1jammy [6,113 kB] 2023-09-10T00:09:08.953 INFO:teuthology.orchestra.run.smithi100.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6025-g9670cca5-1jammy [3,120 kB] 2023-09-10T00:09:09.088 INFO:teuthology.orchestra.run.smithi084.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6025-g9670cca5-1jammy [102 kB] 2023-09-10T00:09:09.091 INFO:teuthology.orchestra.run.smithi084.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6025-g9670cca5-1jammy [428 kB] 2023-09-10T00:09:09.112 INFO:teuthology.orchestra.run.smithi084.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6025-g9670cca5-1jammy [22.4 MB] 2023-09-10T00:09:09.318 INFO:teuthology.orchestra.run.smithi100.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6025-g9670cca5-1jammy [670 kB] 2023-09-10T00:09:09.403 INFO:teuthology.orchestra.run.smithi100.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6025-g9670cca5-1jammy [345 kB] 2023-09-10T00:09:09.444 INFO:teuthology.orchestra.run.smithi100.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6025-g9670cca5-1jammy [23.0 kB] 2023-09-10T00:09:09.446 INFO:teuthology.orchestra.run.smithi100.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6025-g9670cca5-1jammy [170 kB] 2023-09-10T00:09:09.470 INFO:teuthology.orchestra.run.smithi100.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6025-g9670cca5-1jammy [52.4 kB] 2023-09-10T00:09:09.477 INFO:teuthology.orchestra.run.smithi100.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6025-g9670cca5-1jammy [318 kB] 2023-09-10T00:09:09.514 INFO:teuthology.orchestra.run.smithi100.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6025-g9670cca5-1jammy [6,113 kB] 2023-09-10T00:09:10.215 INFO:teuthology.orchestra.run.smithi084.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6025-g9670cca5-1jammy [6,820 kB] 2023-09-10T00:09:10.280 INFO:teuthology.orchestra.run.smithi100.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6025-g9670cca5-1jammy [102 kB] 2023-09-10T00:09:10.282 INFO:teuthology.orchestra.run.smithi100.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6025-g9670cca5-1jammy [428 kB] 2023-09-10T00:09:10.307 INFO:teuthology.orchestra.run.smithi100.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6025-g9670cca5-1jammy [22.4 MB] 2023-09-10T00:09:10.429 INFO:teuthology.orchestra.run.smithi084.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6025-g9670cca5-1jammy [227 kB] 2023-09-10T00:09:10.435 INFO:teuthology.orchestra.run.smithi084.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6025-g9670cca5-1jammy [117 kB] 2023-09-10T00:09:10.441 INFO:teuthology.orchestra.run.smithi084.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6025-g9670cca5-1jammy [1,481 kB] 2023-09-10T00:09:10.507 INFO:teuthology.orchestra.run.smithi084.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6025-g9670cca5-1jammy [9,853 kB] 2023-09-10T00:09:10.954 INFO:teuthology.orchestra.run.smithi084.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6025-g9670cca5-1jammy [31.6 MB] 2023-09-10T00:09:12.547 INFO:teuthology.orchestra.run.smithi084.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6025-g9670cca5-1jammy [3,602 B] 2023-09-10T00:09:12.548 INFO:teuthology.orchestra.run.smithi084.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6025-g9670cca5-1jammy [821 kB] 2023-09-10T00:09:12.564 INFO:teuthology.orchestra.run.smithi084.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6025-g9670cca5-1jammy [2,162 kB] 2023-09-10T00:09:12.602 INFO:teuthology.orchestra.run.smithi084.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6025-g9670cca5-1jammy [243 kB] 2023-09-10T00:09:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6025-g9670cca5-1jammy [128 kB] 2023-09-10T00:09:12.607 INFO:teuthology.orchestra.run.smithi084.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6025-g9670cca5-1jammy [1,882 kB] 2023-09-10T00:09:12.628 INFO:teuthology.orchestra.run.smithi084.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6025-g9670cca5-1jammy [8,615 kB] 2023-09-10T00:09:13.020 INFO:teuthology.orchestra.run.smithi084.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6025-g9670cca5-1jammy [3,732 B] 2023-09-10T00:09:13.021 INFO:teuthology.orchestra.run.smithi084.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6025-g9670cca5-1jammy [47.6 MB] 2023-09-10T00:09:13.065 INFO:teuthology.orchestra.run.smithi100.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6025-g9670cca5-1jammy [6,820 kB] 2023-09-10T00:09:13.819 INFO:teuthology.orchestra.run.smithi100.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6025-g9670cca5-1jammy [227 kB] 2023-09-10T00:09:13.845 INFO:teuthology.orchestra.run.smithi100.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6025-g9670cca5-1jammy [117 kB] 2023-09-10T00:09:13.861 INFO:teuthology.orchestra.run.smithi100.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6025-g9670cca5-1jammy [1,481 kB] 2023-09-10T00:09:14.037 INFO:teuthology.orchestra.run.smithi100.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6025-g9670cca5-1jammy [9,853 kB] 2023-09-10T00:09:15.132 INFO:teuthology.orchestra.run.smithi100.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6025-g9670cca5-1jammy [31.6 MB] 2023-09-10T00:09:15.619 INFO:teuthology.orchestra.run.smithi084.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6025-g9670cca5-1jammy [234 kB] 2023-09-10T00:09:15.623 INFO:teuthology.orchestra.run.smithi084.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6025-g9670cca5-1jammy [215 kB] 2023-09-10T00:09:15.628 INFO:teuthology.orchestra.run.smithi084.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6025-g9670cca5-1jammy [23.8 kB] 2023-09-10T00:09:15.629 INFO:teuthology.orchestra.run.smithi084.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6025-g9670cca5-1jammy [13.2 kB] 2023-09-10T00:09:15.629 INFO:teuthology.orchestra.run.smithi084.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6025-g9670cca5-1jammy [28.4 kB] 2023-09-10T00:09:15.630 INFO:teuthology.orchestra.run.smithi084.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6025-g9670cca5-1jammy [12.1 MB] 2023-09-10T00:09:16.054 INFO:teuthology.orchestra.run.smithi084.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6025-g9670cca5-1jammy [80.8 kB] 2023-09-10T00:09:16.605 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 183 MB in 8s (23.3 MB/s) 2023-09-10T00:09:16.740 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-10T00:09:16.838 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-09-10T00:09:16.843 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-10T00:09:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-10T00:09:17.058 INFO:teuthology.orchestra.run.smithi100.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6025-g9670cca5-1jammy [3,602 B] 2023-09-10T00:09:17.059 INFO:teuthology.orchestra.run.smithi100.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6025-g9670cca5-1jammy [821 kB] 2023-09-10T00:09:17.074 INFO:teuthology.orchestra.run.smithi100.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6025-g9670cca5-1jammy [2,162 kB] 2023-09-10T00:09:17.113 INFO:teuthology.orchestra.run.smithi100.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6025-g9670cca5-1jammy [243 kB] 2023-09-10T00:09:17.131 INFO:teuthology.orchestra.run.smithi100.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6025-g9670cca5-1jammy [128 kB] 2023-09-10T00:09:17.133 INFO:teuthology.orchestra.run.smithi100.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6025-g9670cca5-1jammy [1,882 kB] 2023-09-10T00:09:17.199 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-10T00:09:17.211 INFO:teuthology.orchestra.run.smithi100.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6025-g9670cca5-1jammy [8,615 kB] 2023-09-10T00:09:17.226 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-10T00:09:17.266 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-10T00:09:17.527 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cmd2. 2023-09-10T00:09:17.542 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-10T00:09:17.577 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-10T00:09:17.605 INFO:teuthology.orchestra.run.smithi100.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6025-g9670cca5-1jammy [3,732 B] 2023-09-10T00:09:17.605 INFO:teuthology.orchestra.run.smithi100.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6025-g9670cca5-1jammy [47.6 MB] 2023-09-10T00:09:17.846 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-10T00:09:17.862 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-10T00:09:17.938 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-10T00:09:18.258 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-10T00:09:18.284 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-10T00:09:18.324 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-10T00:09:18.670 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-10T00:09:18.696 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-10T00:09:18.736 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-10T00:09:19.047 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-10T00:09:19.073 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-10T00:09:19.105 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-10T00:09:19.543 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-10T00:09:19.569 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:19.617 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:19.913 INFO:teuthology.orchestra.run.smithi100.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6025-g9670cca5-1jammy [234 kB] 2023-09-10T00:09:19.987 INFO:teuthology.orchestra.run.smithi100.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-6025-g9670cca5-1jammy [215 kB] 2023-09-10T00:09:19.991 INFO:teuthology.orchestra.run.smithi100.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-6025-g9670cca5-1jammy [23.8 kB] 2023-09-10T00:09:19.992 INFO:teuthology.orchestra.run.smithi100.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-6025-g9670cca5-1jammy [13.2 kB] 2023-09-10T00:09:19.992 INFO:teuthology.orchestra.run.smithi100.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6025-g9670cca5-1jammy [28.4 kB] 2023-09-10T00:09:19.993 INFO:teuthology.orchestra.run.smithi100.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6025-g9670cca5-1jammy [12.1 MB] 2023-09-10T00:09:20.021 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-10T00:09:20.047 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:20.087 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:20.418 INFO:teuthology.orchestra.run.smithi100.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20230909.145638/9670cca5bc8e17916865dc84939edfc10b1f2c00/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6025-g9670cca5-1jammy [80.8 kB] 2023-09-10T00:09:20.432 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-10T00:09:20.458 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:20.498 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:20.818 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-10T00:09:20.844 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-10T00:09:20.884 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-10T00:09:20.973 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 183 MB in 12s (15.0 MB/s) 2023-09-10T00:09:21.119 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyperclip. 2023-09-10T00:09:21.196 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librados2. 2023-09-10T00:09:21.217 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 166009 files and directories currently installed.) 2023-09-10T00:09:21.222 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../011-librados2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-09-10T00:09:21.262 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librados2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:21.266 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-09-10T00:09:21.528 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-10T00:09:21.554 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-09-10T00:09:21.586 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-10T00:09:21.715 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librbd1. 2023-09-10T00:09:21.741 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../012-librbd1_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:21.782 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librbd1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:21.872 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cmd2. 2023-09-10T00:09:21.899 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-09-10T00:09:21.938 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-09-10T00:09:22.233 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libfmt8:amd64. 2023-09-10T00:09:22.234 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs2. 2023-09-10T00:09:22.249 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-09-10T00:09:22.261 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:22.301 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:22.317 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-10T00:09:22.553 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rados. 2023-09-10T00:09:22.568 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:22.612 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rados (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:22.670 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-09-10T00:09:22.697 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-09-10T00:09:22.737 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-10T00:09:22.931 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-10T00:09:22.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:22.998 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-argparse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:23.073 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-10T00:09:23.100 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-09-10T00:09:23.140 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-10T00:09:23.250 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cephfs. 2023-09-10T00:09:23.266 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:23.308 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cephfs (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:23.426 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-10T00:09:23.453 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-09-10T00:09:23.484 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-10T00:09:23.578 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-10T00:09:23.604 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:23.644 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:23.905 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-10T00:09:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-prettytable. 2023-09-10T00:09:23.931 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:23.937 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-10T00:09:23.972 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-10T00:09:23.980 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:24.225 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rbd. 2023-09-10T00:09:24.240 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:24.283 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rbd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:24.408 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-10T00:09:24.435 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:24.474 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:24.628 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-10T00:09:24.655 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-10T00:09:24.694 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-10T00:09:24.811 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-10T00:09:24.837 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-09-10T00:09:24.877 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:09:24.997 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package librgw2. 2023-09-10T00:09:25.012 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../021-librgw2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:25.047 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking librgw2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:25.222 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-09-10T00:09:25.249 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-09-10T00:09:25.289 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-10T00:09:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rgw. 2023-09-10T00:09:25.559 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librados2. 2023-09-10T00:09:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:25.585 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../011-librados2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:25.625 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:25.625 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librados2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:25.961 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-10T00:09:25.987 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-10T00:09:26.070 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librbd1. 2023-09-10T00:09:26.073 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-10T00:09:26.096 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../012-librbd1_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:26.136 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librbd1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:26.581 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs2. 2023-09-10T00:09:26.607 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:26.647 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:26.722 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libradosstriper1. 2023-09-10T00:09:26.749 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:26.788 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libradosstriper1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:26.918 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rados. 2023-09-10T00:09:26.933 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../014-python3-rados_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:26.968 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rados (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:27.184 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-common. 2023-09-10T00:09:27.210 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:27.250 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:27.263 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-10T00:09:27.289 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:27.329 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-argparse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:27.607 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cephfs. 2023-09-10T00:09:27.622 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:27.665 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cephfs (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:27.985 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-10T00:09:28.011 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:28.051 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:28.338 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-prettytable. 2023-09-10T00:09:28.364 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-09-10T00:09:28.396 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-09-10T00:09:28.497 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-base. 2023-09-10T00:09:28.524 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:28.573 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-base (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:28.589 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rbd. 2023-09-10T00:09:28.605 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:28.648 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rbd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:29.001 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-10T00:09:29.027 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-09-10T00:09:29.067 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-10T00:09:29.252 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-10T00:09:29.278 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-10T00:09:29.309 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-10T00:09:29.404 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librgw2. 2023-09-10T00:09:29.430 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../021-librgw2_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:29.470 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librgw2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:29.613 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cheroot. 2023-09-10T00:09:29.639 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-10T00:09:29.679 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-10T00:09:29.931 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rgw. 2023-09-10T00:09:29.946 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:29.981 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:30.015 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-10T00:09:30.042 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-10T00:09:30.082 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-10T00:09:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liboath0:amd64. 2023-09-10T00:09:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-09-10T00:09:30.358 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-09-10T00:09:30.385 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-10T00:09:30.411 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-10T00:09:30.451 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-10T00:09:30.686 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libradosstriper1. 2023-09-10T00:09:30.704 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-10T00:09:30.712 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:30.719 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-10T00:09:30.754 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-10T00:09:30.778 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libradosstriper1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:31.059 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempora. 2023-09-10T00:09:31.085 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-10T00:09:31.125 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-10T00:09:31.131 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-common. 2023-09-10T00:09:31.157 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../025-ceph-common_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:31.189 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:31.597 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-portend. 2023-09-10T00:09:31.621 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-10T00:09:31.661 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-10T00:09:31.931 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-10T00:09:31.957 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-10T00:09:31.997 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-10T00:09:32.326 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-10T00:09:32.352 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-10T00:09:32.392 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-10T00:09:32.662 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-base. 2023-09-10T00:09:32.688 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../026-ceph-base_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:32.738 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-base (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:32.762 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-natsort. 2023-09-10T00:09:32.789 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-10T00:09:32.828 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-10T00:09:33.098 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-logutils. 2023-09-10T00:09:33.125 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-10T00:09:33.156 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-10T00:09:33.434 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-10T00:09:33.441 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-09-10T00:09:33.461 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-10T00:09:33.467 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-09-10T00:09:33.500 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-10T00:09:33.507 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-09-10T00:09:33.794 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cheroot. 2023-09-10T00:09:33.803 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-mako. 2023-09-10T00:09:33.820 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-09-10T00:09:33.830 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-10T00:09:33.860 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-10T00:09:33.870 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-10T00:09:34.172 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-09-10T00:09:34.198 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-09-10T00:09:34.198 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-10T00:09:34.225 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-10T00:09:34.229 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-09-10T00:09:34.264 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-10T00:09:34.516 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jaraco.text. 2023-09-10T00:09:34.529 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-10T00:09:34.542 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-09-10T00:09:34.553 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-10T00:09:34.582 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-09-10T00:09:34.592 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-10T00:09:34.887 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webob. 2023-09-10T00:09:34.893 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-09-10T00:09:34.913 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-10T00:09:34.920 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-09-10T00:09:34.953 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-10T00:09:34.960 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-09-10T00:09:35.221 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-tempora. 2023-09-10T00:09:35.236 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-09-10T00:09:35.271 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-09-10T00:09:35.298 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-waitress. 2023-09-10T00:09:35.325 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-10T00:09:35.367 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-10T00:09:35.541 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-portend. 2023-09-10T00:09:35.566 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-09-10T00:09:35.607 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-09-10T00:09:35.701 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-tempita. 2023-09-10T00:09:35.728 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-10T00:09:35.767 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-10T00:09:35.910 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-09-10T00:09:35.936 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-09-10T00:09:35.976 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-09-10T00:09:36.037 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-paste. 2023-09-10T00:09:36.064 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-10T00:09:36.095 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-10T00:09:36.279 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-10T00:09:36.306 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-09-10T00:09:36.346 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-09-10T00:09:36.407 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-10T00:09:36.433 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-10T00:09:36.473 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-10T00:09:36.741 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-natsort. 2023-09-10T00:09:36.751 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-10T00:09:36.768 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-09-10T00:09:36.778 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-10T00:09:36.808 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-09-10T00:09:36.809 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-10T00:09:37.087 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-webtest. 2023-09-10T00:09:37.094 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-logutils. 2023-09-10T00:09:37.114 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-10T00:09:37.121 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-09-10T00:09:37.153 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-10T00:09:37.160 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-09-10T00:09:37.447 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-10T00:09:37.473 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-09-10T00:09:37.481 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pecan. 2023-09-10T00:09:37.505 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-09-10T00:09:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-10T00:09:37.548 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-10T00:09:37.791 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-mako. 2023-09-10T00:09:37.818 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-09-10T00:09:37.857 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-10T00:09:37.903 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-certifi. 2023-09-10T00:09:37.930 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-10T00:09:37.969 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-10T00:09:38.186 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-10T00:09:38.212 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-10T00:09:38.252 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-10T00:09:38.289 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-idna. 2023-09-10T00:09:38.315 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-10T00:09:38.355 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-10T00:09:38.555 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-10T00:09:38.582 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-09-10T00:09:38.622 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-09-10T00:09:38.625 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-urllib3. 2023-09-10T00:09:38.652 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-10T00:09:38.691 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-10T00:09:38.883 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webob. 2023-09-10T00:09:38.898 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-09-10T00:09:38.949 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-09-10T00:09:38.986 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests. 2023-09-10T00:09:39.013 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-10T00:09:39.044 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-10T00:09:39.261 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-waitress. 2023-09-10T00:09:39.287 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-09-10T00:09:39.297 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-10T00:09:39.324 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-10T00:09:39.330 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-10T00:09:39.364 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-10T00:09:39.639 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-tempita. 2023-09-10T00:09:39.642 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-10T00:09:39.657 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:39.665 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-09-10T00:09:39.692 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:39.705 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-09-10T00:09:39.991 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-paste. 2023-09-10T00:09:40.007 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-09-10T00:09:40.049 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-09-10T00:09:40.080 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-10T00:09:40.106 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:40.146 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:40.386 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-10T00:09:40.413 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-09-10T00:09:40.453 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-09-10T00:09:40.457 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-openssl. 2023-09-10T00:09:40.484 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-10T00:09:40.524 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-10T00:09:40.772 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-10T00:09:40.798 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-09-10T00:09:40.810 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr. 2023-09-10T00:09:40.826 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:40.838 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-09-10T00:09:40.860 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:41.108 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webtest. 2023-09-10T00:09:41.135 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-09-10T00:09:41.166 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-09-10T00:09:41.213 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mon. 2023-09-10T00:09:41.240 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:41.280 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mon (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:41.445 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pecan. 2023-09-10T00:09:41.471 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-09-10T00:09:41.511 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-09-10T00:09:42.542 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-certifi. 2023-09-10T00:09:42.568 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-09-10T00:09:42.608 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-09-10T00:09:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-osd. 2023-09-10T00:09:42.919 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-idna. 2023-09-10T00:09:42.935 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:42.946 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-09-10T00:09:42.975 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-osd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:42.985 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-idna (3.3-1) ... 2023-09-10T00:09:43.297 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-urllib3. 2023-09-10T00:09:43.323 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-09-10T00:09:43.363 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-09-10T00:09:43.683 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-requests. 2023-09-10T00:09:43.710 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-09-10T00:09:43.750 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-10T00:09:44.011 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-10T00:09:44.026 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-09-10T00:09:44.086 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-10T00:09:44.381 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-10T00:09:44.396 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:44.439 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:44.761 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph. 2023-09-10T00:09:44.777 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../061-ceph_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:44.811 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:44.827 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-10T00:09:44.854 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:44.893 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:45.131 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-fuse. 2023-09-10T00:09:45.138 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-openssl. 2023-09-10T00:09:45.158 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:45.165 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-09-10T00:09:45.196 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-09-10T00:09:45.197 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:45.532 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr. 2023-09-10T00:09:45.556 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:45.593 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mds. 2023-09-10T00:09:45.599 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:45.619 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:45.659 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mds (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:45.986 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mon. 2023-09-10T00:09:45.987 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephadm. 2023-09-10T00:09:46.012 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:46.013 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../064-cephadm_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:46.045 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:46.052 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mon (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:46.356 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-10T00:09:46.383 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-10T00:09:46.423 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-10T00:09:46.725 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-10T00:09:46.741 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-10T00:09:46.864 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-osd. 2023-09-10T00:09:46.891 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:46.914 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-10T00:09:46.922 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-osd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:47.956 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-babel. 2023-09-10T00:09:47.983 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-10T00:09:48.022 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-10T00:09:48.300 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-jinja2. 2023-09-10T00:09:48.315 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-10T00:09:48.350 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-10T00:09:48.678 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-10T00:09:48.705 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:48.745 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:48.758 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph. 2023-09-10T00:09:48.774 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../061-ceph_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:48.816 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:49.073 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-10T00:09:49.100 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-10T00:09:49.131 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-10T00:09:49.144 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-fuse. 2023-09-10T00:09:49.171 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:49.211 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:49.443 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-10T00:09:49.470 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-10T00:09:49.509 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-10T00:09:49.539 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mds. 2023-09-10T00:09:49.566 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:49.597 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mds (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:49.787 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-routes. 2023-09-10T00:09:49.814 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-10T00:09:49.853 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-10T00:09:49.959 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephadm. 2023-09-10T00:09:49.985 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../064-cephadm_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:50.025 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:50.182 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-10T00:09:50.209 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:50.248 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:50.337 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-asyncssh. 2023-09-10T00:09:50.363 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-09-10T00:09:50.403 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-09-10T00:09:50.644 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-10T00:09:50.670 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-10T00:09:50.672 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-babel-localedata. 2023-09-10T00:09:50.688 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-09-10T00:09:50.710 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-10T00:09:50.756 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-10T00:09:51.180 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-joblib. 2023-09-10T00:09:51.207 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-10T00:09:51.246 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-10T00:09:51.575 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-10T00:09:51.591 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-10T00:09:51.625 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-10T00:09:51.753 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-babel. 2023-09-10T00:09:51.780 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-09-10T00:09:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-09-10T00:09:51.920 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-sklearn. 2023-09-10T00:09:51.947 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-10T00:09:51.986 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-10T00:09:52.131 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jinja2. 2023-09-10T00:09:52.157 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-09-10T00:09:52.197 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-09-10T00:09:52.542 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-10T00:09:52.569 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:52.608 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:52.737 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-10T00:09:52.764 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:52.803 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:52.954 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-10T00:09:52.981 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-09-10T00:09:53.020 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-09-10T00:09:53.273 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-10T00:09:53.297 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-09-10T00:09:53.340 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-10T00:09:53.642 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-routes. 2023-09-10T00:09:53.670 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-09-10T00:09:53.709 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-09-10T00:09:53.722 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-cachetools. 2023-09-10T00:09:53.749 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-10T00:09:53.789 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-10T00:09:54.046 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-10T00:09:54.050 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-10T00:09:54.066 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-10T00:09:54.073 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:54.100 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-10T00:09:54.112 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:54.428 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-10T00:09:54.455 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-10T00:09:54.494 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-10T00:09:54.582 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-09-10T00:09:54.598 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-09-10T00:09:54.640 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-10T00:09:54.805 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-rsa. 2023-09-10T00:09:54.833 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-10T00:09:54.872 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-10T00:09:55.203 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-joblib. 2023-09-10T00:09:55.210 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-google-auth. 2023-09-10T00:09:55.225 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-10T00:09:55.230 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-09-10T00:09:55.260 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-10T00:09:55.269 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-09-10T00:09:55.580 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-10T00:09:55.607 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-10T00:09:55.631 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-09-10T00:09:55.646 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-10T00:09:55.658 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-09-10T00:09:55.697 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-09-10T00:09:55.958 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-websocket. 2023-09-10T00:09:55.986 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-10T00:09:56.000 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn. 2023-09-10T00:09:56.024 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-10T00:09:56.027 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-09-10T00:09:56.067 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-10T00:09:56.354 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-10T00:09:56.381 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-10T00:09:56.419 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-10T00:09:56.725 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-10T00:09:56.753 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:56.792 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:57.134 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-10T00:09:57.161 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:09:57.200 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:57.736 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-10T00:09:57.764 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-10T00:09:57.770 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cachetools. 2023-09-10T00:09:57.797 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-09-10T00:09:57.802 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-10T00:09:57.836 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-09-10T00:09:58.106 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-10T00:09:58.133 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-10T00:09:58.165 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-10T00:09:58.172 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-10T00:09:58.191 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-09-10T00:09:58.222 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-09-10T00:09:58.417 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package jq. 2023-09-10T00:09:58.444 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-10T00:09:58.475 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-10T00:09:58.483 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-10T00:09:58.488 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-09-10T00:09:58.517 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-09-10T00:09:58.735 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package socat. 2023-09-10T00:09:58.751 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-10T00:09:58.794 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-10T00:09:58.803 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rsa. 2023-09-10T00:09:58.831 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-09-10T00:09:58.870 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rsa (4.8-1) ... 2023-09-10T00:09:59.122 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package xmlstarlet. 2023-09-10T00:09:59.150 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-10T00:09:59.188 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-10T00:09:59.267 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-google-auth. 2023-09-10T00:09:59.294 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-09-10T00:09:59.333 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-09-10T00:09:59.518 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-test. 2023-09-10T00:09:59.534 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:09:59.576 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-test (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:09:59.670 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-10T00:09:59.697 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-09-10T00:09:59.737 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-10T00:10:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-websocket. 2023-09-10T00:10:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-09-10T00:10:00.064 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-09-10T00:10:00.326 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-10T00:10:00.353 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-09-10T00:10:00.392 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-10T00:10:01.034 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-10T00:10:01.061 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:01.090 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:01.401 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-10T00:10:01.428 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-09-10T00:10:01.469 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-10T00:10:01.788 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ceph-volume. 2023-09-10T00:10:01.801 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:01.820 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-10T00:10:01.837 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ceph-volume (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:01.848 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-09-10T00:10:01.887 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-10T00:10:02.139 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package jq. 2023-09-10T00:10:02.155 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-09-10T00:10:02.189 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-09-10T00:10:02.284 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-10T00:10:02.312 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:02.351 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-mirror (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:02.392 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package socat. 2023-09-10T00:10:02.407 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-09-10T00:10:02.442 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-09-10T00:10:02.604 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-colorama. 2023-09-10T00:10:02.620 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-10T00:10:02.720 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package xmlstarlet. 2023-09-10T00:10:02.747 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-09-10T00:10:02.786 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-09-10T00:10:02.829 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-10T00:10:03.090 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-shell. 2023-09-10T00:10:03.117 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:03.231 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-shell (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:03.509 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package cephfs-top. 2023-09-10T00:10:03.525 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:03.532 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-test. 2023-09-10T00:10:03.548 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../093-ceph-test_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:03.567 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking cephfs-top (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:03.590 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-test (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:03.803 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-10T00:10:03.819 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:03.862 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libcephfs-dev (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:04.190 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package nvme-cli. 2023-09-10T00:10:04.217 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-10T00:10:04.248 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-10T00:10:04.586 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-10T00:10:04.614 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-10T00:10:04.653 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-10T00:10:05.081 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-10T00:10:05.108 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-10T00:10:05.147 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-10T00:10:05.450 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pastescript. 2023-09-10T00:10:05.477 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-10T00:10:05.525 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-10T00:10:05.803 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-volume. 2023-09-10T00:10:05.819 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:05.845 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pluggy. 2023-09-10T00:10:05.852 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-volume (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:05.872 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-10T00:10:05.911 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-10T00:10:06.173 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-psutil. 2023-09-10T00:10:06.191 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-mirror. 2023-09-10T00:10:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-10T00:10:06.219 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:06.231 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-10T00:10:06.266 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-mirror (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:06.525 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-py. 2023-09-10T00:10:06.553 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-10T00:10:06.583 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-10T00:10:06.593 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-colorama. 2023-09-10T00:10:06.609 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-09-10T00:10:06.654 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-09-10T00:10:06.898 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-shell. 2023-09-10T00:10:06.903 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pygments. 2023-09-10T00:10:06.914 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:06.931 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-10T00:10:06.948 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-shell (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:06.970 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-10T00:10:07.176 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephfs-top. 2023-09-10T00:10:07.192 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-6025-g9670cca5-1jammy_all.deb ... 2023-09-10T00:10:07.234 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephfs-top (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:07.440 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-10T00:10:07.468 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-10T00:10:07.487 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-10T00:10:07.503 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:07.507 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-10T00:10:07.545 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs-dev (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:07.810 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-toml. 2023-09-10T00:10:07.837 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-10T00:10:07.876 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-10T00:10:07.949 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package nvme-cli. 2023-09-10T00:10:07.977 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-09-10T00:10:08.015 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-09-10T00:10:08.137 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-pytest. 2023-09-10T00:10:08.153 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-10T00:10:08.187 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-10T00:10:08.345 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-09-10T00:10:08.361 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-09-10T00:10:08.395 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-09-10T00:10:08.516 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package python3-simplejson. 2023-09-10T00:10:08.543 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-10T00:10:08.582 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-10T00:10:08.815 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-iniconfig. 2023-09-10T00:10:08.842 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-09-10T00:10:08.853 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-10T00:10:08.869 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-10T00:10:08.881 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-09-10T00:10:08.903 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-10T00:10:09.184 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastescript. 2023-09-10T00:10:09.212 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-09-10T00:10:09.250 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-10T00:10:09.571 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pluggy. 2023-09-10T00:10:09.599 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-09-10T00:10:09.633 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package radosgw. 2023-09-10T00:10:09.637 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-09-10T00:10:09.661 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../113-radosgw_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:09.690 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking radosgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:09.899 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-psutil. 2023-09-10T00:10:09.915 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-09-10T00:10:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-09-10T00:10:10.268 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-py. 2023-09-10T00:10:10.296 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-09-10T00:10:10.334 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-py (1.10.0-1) ... 2023-09-10T00:10:10.427 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package rbd-fuse. 2023-09-10T00:10:10.443 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:10.477 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking rbd-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:10.655 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pygments. 2023-09-10T00:10:10.683 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-09-10T00:10:10.713 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-09-10T00:10:10.772 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-10T00:10:11.023 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-10T00:10:11.132 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-10T00:10:11.142 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-10T00:10:11.170 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-09-10T00:10:11.225 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-09-10T00:10:11.373 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-10T00:10:11.511 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-toml. 2023-09-10T00:10:11.539 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-09-10T00:10:11.569 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-09-10T00:10:11.733 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-10T00:10:11.848 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pytest. 2023-09-10T00:10:11.875 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-09-10T00:10:11.914 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-09-10T00:10:12.168 INFO:teuthology.orchestra.run.smithi084.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-10T00:10:12.259 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplejson. 2023-09-10T00:10:12.276 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:12.287 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-09-10T00:10:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-09-10T00:10:12.595 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-10T00:10:12.611 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-09-10T00:10:12.653 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-09-10T00:10:12.810 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user cephadm....done 2023-09-10T00:10:12.965 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-10T00:10:13.225 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-10T00:10:13.374 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package radosgw. 2023-09-10T00:10:13.402 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../113-radosgw_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:13.440 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking radosgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:13.468 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-10T00:10:13.577 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-10T00:10:13.828 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-10T00:10:14.079 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-10T00:10:14.205 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-10T00:10:14.218 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package rbd-fuse. 2023-09-10T00:10:14.246 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-6025-g9670cca5-1jammy_amd64.deb ... 2023-09-10T00:10:14.285 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking rbd-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:14.540 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-10T00:10:14.597 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-09-10T00:10:14.848 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-09-10T00:10:14.884 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-10T00:10:14.974 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-09-10T00:10:15.135 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-10T00:10:15.237 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-09-10T00:10:15.386 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-10T00:10:15.584 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-09-10T00:10:15.679 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-10T00:10:15.947 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-10T00:10:16.081 INFO:teuthology.orchestra.run.smithi100.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-09-10T00:10:16.143 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:16.197 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-10T00:10:16.457 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-argparse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:16.695 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user cephadm....done 2023-09-10T00:10:16.774 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-10T00:10:16.849 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-09-10T00:10:16.892 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-10T00:10:17.109 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-09-10T00:10:17.126 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-10T00:10:17.335 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-09-10T00:10:17.378 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-10T00:10:17.461 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-09-10T00:10:17.504 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-10T00:10:17.712 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-10T00:10:17.863 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-10T00:10:17.972 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-09-10T00:10:17.989 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-10T00:10:18.098 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-py (1.10.0-1) ... 2023-09-10T00:10:18.240 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-10T00:10:18.399 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-09-10T00:10:18.483 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-10T00:10:18.743 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-09-10T00:10:18.786 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-10T00:10:19.011 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-09-10T00:10:19.262 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-09-10T00:10:19.411 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-10T00:10:19.530 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-09-10T00:10:19.662 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-10T00:10:19.788 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-10T00:10:19.789 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-09-10T00:10:19.914 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-10T00:10:20.049 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-09-10T00:10:20.198 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-10T00:10:20.300 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-argparse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:20.543 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-09-10T00:10:20.583 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-10T00:10:20.660 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-09-10T00:10:20.809 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-10T00:10:20.929 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-09-10T00:10:21.160 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-10T00:10:21.213 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-09-10T00:10:21.339 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-09-10T00:10:21.453 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-10T00:10:21.698 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-09-10T00:10:21.763 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-10T00:10:21.816 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-09-10T00:10:22.067 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-09-10T00:10:22.131 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-10T00:10:22.326 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-09-10T00:10:22.382 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-10T00:10:22.483 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:22.619 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-09-10T00:10:22.759 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-idna (3.3-1) ... 2023-09-10T00:10:23.068 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-10T00:10:23.271 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-09-10T00:10:23.531 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-09-10T00:10:23.657 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-09-10T00:10:23.800 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-09-10T00:10:24.067 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-09-10T00:10:24.191 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:24.308 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-10T00:10:24.444 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-09-10T00:10:24.559 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-10T00:10:24.685 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-10T00:10:24.703 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-09-10T00:10:24.811 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-10T00:10:25.080 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-09-10T00:10:25.138 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-10T00:10:25.364 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-09-10T00:10:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-10T00:10:25.649 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-09-10T00:10:25.673 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:25.774 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-10T00:10:25.883 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-10T00:10:25.967 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-09-10T00:10:26.160 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-10T00:10:26.201 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-09-10T00:10:26.319 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:26.411 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-10T00:10:26.620 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-idna (3.3-1) ... 2023-09-10T00:10:26.670 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-10T00:10:26.929 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-10T00:10:26.930 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-09-10T00:10:27.189 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-10T00:10:27.440 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-10T00:10:27.549 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-10T00:10:27.809 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-10T00:10:27.935 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-10T00:10:28.035 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:28.186 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-toml (0.10.2-1) ... 2023-09-10T00:10:28.227 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-10T00:10:28.446 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-09-10T00:10:28.545 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-10T00:10:28.572 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-09-10T00:10:28.723 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-09-10T00:10:28.813 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-10T00:10:29.008 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-09-10T00:10:29.239 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-10T00:10:29.242 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-09-10T00:10:29.457 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-10T00:10:29.485 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:29.567 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-10T00:10:29.611 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-09-10T00:10:29.737 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-09-10T00:10:29.943 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-10T00:10:30.064 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-09-10T00:10:30.203 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-10T00:10:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-09-10T00:10:30.470 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:30.574 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-09-10T00:10:30.596 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-10T00:10:30.808 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-10T00:10:30.922 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-10T00:10:31.051 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-09-10T00:10:31.198 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-10T00:10:31.302 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-09-10T00:10:31.450 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-10T00:10:31.453 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-09-10T00:10:31.567 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-10T00:10:31.729 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-09-10T00:10:31.843 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-10T00:10:31.855 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-09-10T00:10:32.127 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-10T00:10:32.157 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-09-10T00:10:32.404 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-10T00:10:32.432 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-09-10T00:10:32.667 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-09-10T00:10:32.780 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-10T00:10:33.042 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-09-10T00:10:33.064 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-10T00:10:33.278 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-09-10T00:10:33.413 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-09-10T00:10:33.599 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-10T00:10:33.798 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-09-10T00:10:33.876 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librados2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.002 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librgw2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.205 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.306 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.334 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-portend (3.0.0-1) ... 2023-09-10T00:10:34.415 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libradosstriper1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.550 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-10T00:10:34.583 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-09-10T00:10:34.701 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-09-10T00:10:34.827 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up librbd1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:34.953 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-modules-core (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:35.043 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-09-10T00:10:35.053 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:35.252 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-10T00:10:35.253 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-10T00:10:35.336 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-09-10T00:10:35.604 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-09-10T00:10:35.730 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rsa (4.8-1) ... 2023-09-10T00:10:35.855 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libcephfs-dev (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:35.956 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rados (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:36.006 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-09-10T00:10:36.257 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-09-10T00:10:36.358 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-top (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:36.476 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-10T00:10:36.525 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-09-10T00:10:36.885 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-10T00:10:37.169 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-09-10T00:10:37.505 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-09-10T00:10:37.631 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librados2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.638 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rbd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.739 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up rbd-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.749 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librgw2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.849 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-rgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.953 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:37.975 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up python3-cephfs (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.101 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-shell (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.103 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs2 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.227 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.229 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libradosstriper1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.355 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-09-10T00:10:38.623 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librbd1 (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.725 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-modules-core (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:38.786 INFO:teuthology.orchestra.run.smithi084.stdout:Adding group ceph....done 2023-09-10T00:10:38.842 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:39.056 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-10T00:10:39.057 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-10T00:10:39.154 INFO:teuthology.orchestra.run.smithi084.stdout:Adding system user ceph....done 2023-09-10T00:10:39.297 INFO:teuthology.orchestra.run.smithi084.stdout:Setting system user ceph properties....done 2023-09-10T00:10:39.313 INFO:teuthology.orchestra.run.smithi084.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-10T00:10:39.447 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-10T00:10:39.552 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs-dev (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:39.678 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rados (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:39.805 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-top (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:39.809 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-10T00:10:39.930 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-09-10T00:10:40.425 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up cephfs-mirror (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:40.646 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-10T00:10:40.646 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-10T00:10:41.170 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-test (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.176 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rbd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.288 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up radosgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.303 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up rbd-fuse (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.445 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.519 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-10T00:10:41.519 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-10T00:10:41.580 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cephfs (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.706 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-shell (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:41.807 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-common (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:42.273 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-base (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:42.317 INFO:teuthology.orchestra.run.smithi100.stdout:Adding group ceph....done 2023-09-10T00:10:42.590 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-10T00:10:42.693 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user ceph....done 2023-09-10T00:10:42.887 INFO:teuthology.orchestra.run.smithi100.stdout:Setting system user ceph properties....done 2023-09-10T00:10:42.900 INFO:teuthology.orchestra.run.smithi100.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-10T00:10:43.034 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-10T00:10:43.100 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mds (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:43.322 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-10T00:10:43.322 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-10T00:10:43.422 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-10T00:10:43.885 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:44.050 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephfs-mirror (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:44.103 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-10T00:10:44.104 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-10T00:10:44.264 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-10T00:10:44.264 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-09-10T00:10:44.636 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-osd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:44.953 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-10T00:10:44.953 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-10T00:10:45.140 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-test (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:45.250 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up radosgw (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:45.463 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:45.487 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-10T00:10:45.487 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-10T00:10:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:45.732 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mon (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:45.926 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-10T00:10:45.926 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-10T00:10:46.218 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-base (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:46.441 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:46.555 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-10T00:10:46.592 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:46.734 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-mgr-dashboard (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:46.885 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ceph-volume (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:47.012 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-10T00:10:47.061 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mds (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:47.301 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-10T00:10:47.301 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-10T00:10:47.838 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:48.037 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-10T00:10:48.037 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-10T00:10:48.121 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-10T00:10:48.565 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-osd (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:48.570 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-10T00:10:48.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-10T00:10:48.625 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-10T00:10:48.809 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-09-10T00:10:48.810 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-09-10T00:10:48.839 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-10T00:10:48.840 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-10T00:10:48.966 INFO:teuthology.orchestra.run.smithi084.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-10T00:10:48.967 INFO:teuthology.orchestra.run.smithi084.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-10T00:10:48.967 INFO:teuthology.orchestra.run.smithi084.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:10:48.967 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-10T00:10:48.968 INFO:teuthology.orchestra.run.smithi084.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-10T00:10:48.969 INFO:teuthology.orchestra.run.smithi084.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-10T00:10:48.969 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-10T00:10:48.970 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-09-10T00:10:48.970 INFO:teuthology.orchestra.run.smithi084.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-10T00:10:48.970 INFO:teuthology.orchestra.run.smithi084.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-10T00:10:48.970 INFO:teuthology.orchestra.run.smithi084.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-10T00:10:48.971 INFO:teuthology.orchestra.run.smithi084.stdout: libengine-pkcs11-openssl 2023-09-10T00:10:49.003 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-09-10T00:10:49.005 INFO:teuthology.orchestra.run.smithi084.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-10T00:10:49.005 INFO:teuthology.orchestra.run.smithi084.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-10T00:10:49.005 INFO:teuthology.orchestra.run.smithi084.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-10T00:10:49.005 INFO:teuthology.orchestra.run.smithi084.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-10T00:10:49.005 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-10T00:10:49.006 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-10T00:10:49.006 INFO:teuthology.orchestra.run.smithi084.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-10T00:10:49.006 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages will be upgraded: 2023-09-10T00:10:49.007 INFO:teuthology.orchestra.run.smithi084.stdout: libssl3 2023-09-10T00:10:49.204 INFO:teuthology.orchestra.run.smithi084.stdout:1 upgraded, 39 newly installed, 0 to remove and 240 not upgraded. 2023-09-10T00:10:49.205 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 54.6 MB of archives. 2023-09-10T00:10:49.205 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-10T00:10:49.205 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-10T00:10:49.416 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:49.542 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:49.682 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-10T00:10:49.693 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mon (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:49.909 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-10T00:10:49.909 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-10T00:10:49.938 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-10T00:10:49.973 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-10T00:10:49.975 INFO:teuthology.orchestra.run.smithi084.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-10T00:10:49.980 INFO:teuthology.orchestra.run.smithi084.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-09-10T00:10:49.983 INFO:teuthology.orchestra.run.smithi084.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-10T00:10:49.984 INFO:teuthology.orchestra.run.smithi084.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-10T00:10:49.987 INFO:teuthology.orchestra.run.smithi084.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-10T00:10:49.990 INFO:teuthology.orchestra.run.smithi084.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-10T00:10:49.990 INFO:teuthology.orchestra.run.smithi084.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-10T00:10:50.154 INFO:teuthology.orchestra.run.smithi084.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-10T00:10:50.453 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-cephadm (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:50.465 INFO:teuthology.orchestra.run.smithi084.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-10T00:10:50.596 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:50.714 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-dashboard (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:50.840 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-volume (18.0.0-6025-g9670cca5-1jammy) ... 2023-09-10T00:10:50.942 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-10T00:10:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-10T00:10:51.624 INFO:teuthology.orchestra.run.smithi084.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-10T00:10:51.625 INFO:teuthology.orchestra.run.smithi084.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-10T00:10:51.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-10T00:10:51.631 INFO:teuthology.orchestra.run.smithi084.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-10T00:10:51.642 INFO:teuthology.orchestra.run.smithi084.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-10T00:10:51.646 INFO:teuthology.orchestra.run.smithi084.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-10T00:10:51.662 INFO:teuthology.orchestra.run.smithi084.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-10T00:10:51.663 INFO:teuthology.orchestra.run.smithi084.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-10T00:10:51.884 INFO:teuthology.orchestra.run.smithi084.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-10T00:10:51.967 INFO:teuthology.orchestra.run.smithi084.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-10T00:10:52.077 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-10T00:10:52.441 INFO:teuthology.orchestra.run.smithi084.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-10T00:10:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-10T00:10:52.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-09-10T00:10:52.573 INFO:teuthology.orchestra.run.smithi084.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-10T00:10:52.585 INFO:teuthology.orchestra.run.smithi084.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-10T00:10:52.586 INFO:teuthology.orchestra.run.smithi084.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-10T00:10:52.588 INFO:teuthology.orchestra.run.smithi084.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-10T00:10:52.589 INFO:teuthology.orchestra.run.smithi084.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-10T00:10:52.621 INFO:teuthology.orchestra.run.smithi084.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-10T00:10:52.625 INFO:teuthology.orchestra.run.smithi084.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-10T00:10:52.626 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2023-09-10T00:10:52.809 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2023-09-10T00:10:52.809 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2023-09-10T00:10:52.973 INFO:teuthology.orchestra.run.smithi100.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-09-10T00:10:52.973 INFO:teuthology.orchestra.run.smithi100.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-10T00:10:52.974 INFO:teuthology.orchestra.run.smithi100.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:10:52.974 INFO:teuthology.orchestra.run.smithi100.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:10:52.974 INFO:teuthology.orchestra.run.smithi100.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-10T00:10:52.974 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages were automatically installed and are no longer required: 2023-09-10T00:10:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-09-10T00:10:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-09-10T00:10:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-09-10T00:10:52.975 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-09-10T00:10:52.976 INFO:teuthology.orchestra.run.smithi100.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-09-10T00:10:52.977 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-10T00:10:52.977 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2023-09-10T00:10:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-09-10T00:10:52.977 INFO:teuthology.orchestra.run.smithi100.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-09-10T00:10:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-09-10T00:10:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-09-10T00:10:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-10T00:10:52.978 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2023-09-10T00:10:52.978 INFO:teuthology.orchestra.run.smithi100.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-09-10T00:10:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-09-10T00:10:52.979 INFO:teuthology.orchestra.run.smithi100.stdout: libengine-pkcs11-openssl 2023-09-10T00:10:53.011 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2023-09-10T00:10:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-09-10T00:10:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-09-10T00:10:53.012 INFO:teuthology.orchestra.run.smithi100.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-09-10T00:10:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-09-10T00:10:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-09-10T00:10:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-09-10T00:10:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-09-10T00:10:53.014 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2023-09-10T00:10:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: libssl3 2023-09-10T00:10:53.183 INFO:teuthology.orchestra.run.smithi084.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-10T00:10:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:1 upgraded, 39 newly installed, 0 to remove and 240 not upgraded. 2023-09-10T00:10:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 54.6 MB of archives. 2023-09-10T00:10:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 202 MB of additional disk space will be used. 2023-09-10T00:10:53.194 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-09-10T00:10:53.348 INFO:teuthology.orchestra.run.smithi084.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-10T00:10:53.437 INFO:teuthology.orchestra.run.smithi084.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-10T00:10:53.437 INFO:teuthology.orchestra.run.smithi084.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-10T00:10:53.519 INFO:teuthology.orchestra.run.smithi084.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-10T00:10:53.527 INFO:teuthology.orchestra.run.smithi084.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-10T00:10:53.672 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-09-10T00:10:53.928 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-09-10T00:10:53.963 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-09-10T00:10:53.965 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-09-10T00:10:53.970 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-09-10T00:10:53.974 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-09-10T00:10:53.975 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-09-10T00:10:53.979 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-09-10T00:10:53.980 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-09-10T00:10:53.989 INFO:teuthology.orchestra.run.smithi084.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-10T00:10:53.991 INFO:teuthology.orchestra.run.smithi084.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-10T00:10:54.146 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-09-10T00:10:54.146 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-09-10T00:10:54.390 INFO:teuthology.orchestra.run.smithi084.stdout:Preconfiguring packages ... 2023-09-10T00:10:54.393 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-09-10T00:10:54.759 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-09-10T00:10:54.881 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package flex. 2023-09-10T00:10:54.972 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172986 files and directories currently installed.) 2023-09-10T00:10:54.977 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-10T00:10:55.021 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-10T00:10:55.564 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-09-10T00:10:55.569 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-09-10T00:10:55.570 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-09-10T00:10:55.576 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-09-10T00:10:55.577 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-09-10T00:10:55.587 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-09-10T00:10:55.591 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-09-10T00:10:55.596 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-10T00:10:55.608 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-09-10T00:10:55.769 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-10T00:10:55.772 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-09-10T00:10:56.169 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:10:56.494 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-09-10T00:10:56.495 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-09-10T00:10:56.521 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-09-10T00:10:56.599 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-09-10T00:10:56.607 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-09-10T00:10:56.609 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-09-10T00:10:56.610 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-09-10T00:10:56.611 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-09-10T00:10:56.637 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-09-10T00:10:56.640 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-09-10T00:10:56.686 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package bison. 2023-09-10T00:10:56.786 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173059 files and directories currently installed.) 2023-09-10T00:10:56.793 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-10T00:10:56.846 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-10T00:10:57.272 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-10T00:10:57.290 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-09-10T00:10:57.299 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-10T00:10:57.338 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-10T00:10:57.374 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-09-10T00:10:57.374 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-09-10T00:10:57.375 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-09-10T00:10:57.464 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-09-10T00:10:57.469 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-09-10T00:10:57.609 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package dump. 2023-09-10T00:10:57.624 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-10T00:10:57.658 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking dump (0.4b47-3) ... 2023-09-10T00:10:57.925 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-09-10T00:10:57.927 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-09-10T00:10:57.936 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package indent. 2023-09-10T00:10:57.964 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-09-10T00:10:58.003 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking indent (2.2.12-1build2) ... 2023-09-10T00:10:58.272 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-10T00:10:58.288 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-10T00:10:58.330 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-10T00:10:58.331 INFO:teuthology.orchestra.run.smithi100.stdout:Preconfiguring packages ... 2023-09-10T00:10:58.466 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 54.6 MB in 5s (11.1 MB/s) 2023-09-10T00:10:58.608 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package flex. 2023-09-10T00:10:58.625 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-10T00:10:58.653 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-10T00:10:58.683 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-10T00:10:58.711 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172986 files and directories currently installed.) 2023-09-10T00:10:58.716 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-09-10T00:10:58.756 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking flex (2.6.4-8build2) ... 2023-09-10T00:10:58.928 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-10T00:10:58.943 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-10T00:10:58.986 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-10T00:10:59.280 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-10T00:10:59.314 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-10T00:10:59.342 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-10T00:10:59.381 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-10T00:10:59.446 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-09-10T00:10:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-10T00:10:59.649 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-10T00:10:59.691 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-10T00:10:59.838 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:11:00.028 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libjson-perl. 2023-09-10T00:11:00.044 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-10T00:11:00.086 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-10T00:11:00.364 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package bison. 2023-09-10T00:11:00.372 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-10T00:11:00.400 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-10T00:11:00.431 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-10T00:11:00.467 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173059 files and directories currently installed.) 2023-09-10T00:11:00.473 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-09-10T00:11:00.516 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-09-10T00:11:00.933 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-09-10T00:11:00.961 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-09-10T00:11:00.999 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-09-10T00:11:01.286 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package dump. 2023-09-10T00:11:01.313 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-09-10T00:11:01.344 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking dump (0.4b47-3) ... 2023-09-10T00:11:01.650 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package indent. 2023-09-10T00:11:01.666 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-09-10T00:11:01.708 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking indent (2.2.12-1build2) ... 2023-09-10T00:11:01.985 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-09-10T00:11:02.013 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-09-10T00:11:02.052 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-10T00:11:02.125 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-10T00:11:02.148 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-10T00:11:02.191 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:02.373 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-09-10T00:11:02.400 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-09-10T00:11:02.410 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-10T00:11:02.426 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-10T00:11:02.439 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-10T00:11:02.460 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:02.658 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-09-10T00:11:02.674 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-09-10T00:11:02.708 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-09-10T00:11:02.738 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-10T00:11:02.765 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-10T00:11:02.804 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:03.037 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libfl2:amd64. 2023-09-10T00:11:03.064 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-09-10T00:11:03.103 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:03.141 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-10T00:11:03.169 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-10T00:11:03.207 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-10T00:11:03.356 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-09-10T00:11:03.380 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-09-10T00:11:03.422 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:03.535 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-10T00:11:03.563 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-10T00:11:03.601 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-10T00:11:03.642 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjson-perl. 2023-09-10T00:11:03.658 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-09-10T00:11:03.691 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-09-10T00:11:03.871 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-10T00:11:03.886 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:03.929 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:03.953 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libllvm14:amd64. 2023-09-10T00:11:03.980 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-09-10T00:11:04.019 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-10T00:11:04.257 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-10T00:11:04.285 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:04.323 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:04.618 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-10T00:11:04.633 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:04.676 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:05.365 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-10T00:11:05.392 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-10T00:11:05.604 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:11:05.706 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-09-10T00:11:05.734 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-10T00:11:05.772 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:06.025 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmbim-proxy. 2023-09-10T00:11:06.053 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-09-10T00:11:06.084 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-10T00:11:06.091 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:06.100 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-10T00:11:06.167 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-10T00:11:06.336 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-09-10T00:11:06.364 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-10T00:11:06.394 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:06.504 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package modemmanager. 2023-09-10T00:11:06.531 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-10T00:11:06.570 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:06.748 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libndp0:amd64. 2023-09-10T00:11:06.775 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-09-10T00:11:06.814 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-10T00:11:07.142 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libnm0:amd64. 2023-09-10T00:11:07.170 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-09-10T00:11:07.193 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager. 2023-09-10T00:11:07.208 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-10T00:11:07.220 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-10T00:11:07.267 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-10T00:11:07.486 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libpq5:amd64. 2023-09-10T00:11:07.500 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:07.536 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:07.865 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-09-10T00:11:07.874 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package ppp. 2023-09-10T00:11:07.893 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:07.902 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-10T00:11:07.923 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:08.192 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-10T00:11:08.225 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libqmi-proxy. 2023-09-10T00:11:08.254 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:08.325 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:08.495 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package pptp-linux. 2023-09-10T00:11:08.523 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-10T00:11:08.552 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-09-10T00:11:08.561 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-10T00:11:08.569 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-09-10T00:11:08.611 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:11:08.839 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-10T00:11:08.855 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-10T00:11:08.897 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-10T00:11:09.140 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-09-10T00:11:09.168 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-09-10T00:11:09.192 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-10T00:11:09.206 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-09-10T00:11:09.219 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-10T00:11:09.258 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-common (238) ... 2023-09-10T00:11:09.553 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-10T00:11:09.559 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package modemmanager. 2023-09-10T00:11:09.581 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:09.587 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-09-10T00:11:09.611 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:09.626 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:10.191 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-common. 2023-09-10T00:11:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-10T00:11:10.266 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package network-manager. 2023-09-10T00:11:10.275 INFO:teuthology.orchestra.run.smithi084.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-10T00:11:10.294 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-09-10T00:11:10.297 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-common (238) ... 2023-09-10T00:11:10.341 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-09-10T00:11:10.990 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ppp. 2023-09-10T00:11:11.018 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-09-10T00:11:11.093 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-14. 2023-09-10T00:11:11.121 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:11.154 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:11.305 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-09-10T00:11:11.624 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package pptp-linux. 2023-09-10T00:11:11.651 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-09-10T00:11:11.694 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-09-10T00:11:11.947 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package network-manager-pptp. 2023-09-10T00:11:11.963 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-09-10T00:11:12.005 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-09-10T00:11:12.270 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql. 2023-09-10T00:11:12.286 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-10T00:11:12.309 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client-common. 2023-09-10T00:11:12.328 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql (14+238) ... 2023-09-10T00:11:12.336 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-09-10T00:11:12.375 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client-common (238) ... 2023-09-10T00:11:12.563 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-client. 2023-09-10T00:11:12.580 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-10T00:11:12.613 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-client (14+238) ... 2023-09-10T00:11:12.679 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client-14. 2023-09-10T00:11:12.707 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:12.745 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:12.824 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-10T00:11:12.840 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-10T00:11:12.874 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-10T00:11:13.176 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl8.6. 2023-09-10T00:11:13.205 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-10T00:11:13.243 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-10T00:11:13.259 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-common. 2023-09-10T00:11:13.287 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-09-10T00:11:13.344 INFO:teuthology.orchestra.run.smithi100.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-09-10T00:11:13.373 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-common (238) ... 2023-09-10T00:11:13.520 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package tcl. 2023-09-10T00:11:13.549 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-10T00:11:13.592 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-10T00:11:13.841 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-14. 2023-09-10T00:11:13.869 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-09-10T00:11:13.906 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package wpasupplicant. 2023-09-10T00:11:13.911 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:13.935 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-10T00:11:13.972 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-10T00:11:14.285 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-10T00:11:14.302 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-10T00:11:14.343 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-10T00:11:14.721 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-10T00:11:14.750 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-10T00:11:14.796 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-10T00:11:15.091 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-common (238) ... 2023-09-10T00:11:15.119 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql. 2023-09-10T00:11:15.148 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-09-10T00:11:15.186 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql (14+238) ... 2023-09-10T00:11:15.260 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-10T00:11:15.395 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-10T00:11:15.405 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-client. 2023-09-10T00:11:15.421 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-09-10T00:11:15.520 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:15.574 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-client (14+238) ... 2023-09-10T00:11:15.646 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-10T00:11:15.772 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-10T00:11:15.907 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:16.249 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package postgresql-contrib. 2023-09-10T00:11:16.277 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-09-10T00:11:16.315 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking postgresql-contrib (14+238) ... 2023-09-10T00:11:16.395 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-10T00:11:16.479 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-10T00:11:16.618 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package tcl8.6. 2023-09-10T00:11:16.646 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-09-10T00:11:16.684 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-10T00:11:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-10T00:11:16.857 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-10T00:11:16.954 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package tcl. 2023-09-10T00:11:16.970 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-09-10T00:11:17.009 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-09-10T00:11:17.357 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package wpasupplicant. 2023-09-10T00:11:17.385 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-09-10T00:11:17.406 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-10T00:11:17.423 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-10T00:11:17.541 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:11:17.667 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-10T00:11:17.786 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-09-10T00:11:17.792 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-10T00:11:17.815 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-09-10T00:11:17.853 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-09-10T00:11:17.902 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:18.003 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-10T00:11:18.104 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-10T00:11:18.223 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package usb-modeswitch. 2023-09-10T00:11:18.251 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-09-10T00:11:18.323 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-10T00:11:18.609 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client-common (238) ... 2023-09-10T00:11:18.779 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up flex (2.6.4-8build2) ... 2023-09-10T00:11:18.784 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-10T00:11:18.905 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-09-10T00:11:18.909 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up dump (0.4b47-3) ... 2023-09-10T00:11:19.003 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-10T00:11:19.031 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:19.070 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:19.165 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-09-10T00:11:19.195 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-10T00:11:19.291 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-09-10T00:11:19.313 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-10T00:11:19.430 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-10T00:11:19.434 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:19.531 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-10T00:11:19.621 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-10T00:11:19.691 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up indent (2.2.12-1build2) ... 2023-09-10T00:11:19.817 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-10T00:11:19.950 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-09-10T00:11:19.993 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-10T00:11:20.030 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-09-10T00:11:20.119 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:20.245 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-10T00:11:20.409 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-10T00:11:20.410 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-09-10T00:11:20.413 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-client (14+238) ... 2023-09-10T00:11:20.531 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-10T00:11:20.950 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-09-10T00:11:21.076 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-09-10T00:11:21.185 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-09-10T00:11:21.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:21.251 INFO:teuthology.orchestra.run.smithi084.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-10T00:11:21.251 INFO:teuthology.orchestra.run.smithi084.stdout:which means they are currently configured by ifupdown: 2023-09-10T00:11:21.252 INFO:teuthology.orchestra.run.smithi084.stdout:- enp3s0f1 2023-09-10T00:11:21.252 INFO:teuthology.orchestra.run.smithi084.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-10T00:11:21.252 INFO:teuthology.orchestra.run.smithi084.stdout:remove their configuration from /etc/network/interfaces. 2023-09-10T00:11:21.252 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:21.295 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-09-10T00:11:21.379 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-10T00:11:21.396 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:21.522 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-09-10T00:11:21.690 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-09-10T00:11:21.734 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-10T00:11:22.066 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-10T00:11:22.312 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-09-10T00:11:22.413 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up dump (0.4b47-3) ... 2023-09-10T00:11:22.506 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-09-10T00:11:22.572 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:22.600 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-09-10T00:11:22.860 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:22.891 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up tcl (8.6.11+1build2) ... 2023-09-10T00:11:23.002 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-10T00:11:23.017 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjson-perl (4.04000-1) ... 2023-09-10T00:11:23.128 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-common (238) ... 2023-09-10T00:11:23.143 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-09-10T00:11:23.225 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-09-10T00:11:23.295 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up indent (2.2.12-1build2) ... 2023-09-10T00:11:23.396 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-09-10T00:11:23.564 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-09-10T00:11:23.690 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-09-10T00:11:23.968 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-client (14+238) ... 2023-09-10T00:11:23.986 INFO:teuthology.orchestra.run.smithi084.stdout:Adding user postgres to group ssl-cert 2023-09-10T00:11:24.068 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-09-10T00:11:24.223 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:24.223 INFO:teuthology.orchestra.run.smithi084.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-10T00:11:24.412 INFO:teuthology.orchestra.run.smithi084.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-10T00:11:24.412 INFO:teuthology.orchestra.run.smithi084.stdout:Removing obsolete dictionary files: 2023-09-10T00:11:24.556 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:24.556 INFO:teuthology.orchestra.run.smithi100.stdout:The following network interfaces were found in /etc/network/interfaces 2023-09-10T00:11:24.556 INFO:teuthology.orchestra.run.smithi100.stdout:which means they are currently configured by ifupdown: 2023-09-10T00:11:24.557 INFO:teuthology.orchestra.run.smithi100.stdout:- enp3s0f1 2023-09-10T00:11:24.557 INFO:teuthology.orchestra.run.smithi100.stdout:If you want to manage those interfaces with NetworkManager instead 2023-09-10T00:11:24.557 INFO:teuthology.orchestra.run.smithi100.stdout:remove their configuration from /etc/network/interfaces. 2023-09-10T00:11:24.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:24.682 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-09-10T00:11:25.030 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-09-10T00:11:25.043 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-10T00:11:25.364 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-09-10T00:11:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:25.871 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-09-10T00:11:25.873 INFO:teuthology.orchestra.run.smithi084.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-10T00:11:25.896 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-10T00:11:25.931 INFO:teuthology.orchestra.run.smithi084.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-10T00:11:25.931 INFO:teuthology.orchestra.run.smithi084.stdout:This user must also own the server process. 2023-09-10T00:11:25.931 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:The database cluster will be initialized with locale "en_US". 2023-09-10T00:11:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-10T00:11:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:The default text search configuration will be set to "english". 2023-09-10T00:11:25.932 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:25.932 INFO:teuthology.orchestra.run.smithi084.stdout:Data page checksums are disabled. 2023-09-10T00:11:25.933 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:25.933 INFO:teuthology.orchestra.run.smithi084.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-10T00:11:25.933 INFO:teuthology.orchestra.run.smithi084.stdout:creating subdirectories ... ok 2023-09-10T00:11:25.934 INFO:teuthology.orchestra.run.smithi084.stdout:selecting dynamic shared memory implementation ... posix 2023-09-10T00:11:25.947 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default max_connections ... 100 2023-09-10T00:11:25.966 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default shared_buffers ... 128MB 2023-09-10T00:11:25.977 INFO:teuthology.orchestra.run.smithi084.stdout:selecting default time zone ... Etc/UTC 2023-09-10T00:11:25.978 INFO:teuthology.orchestra.run.smithi084.stdout:creating configuration files ... ok 2023-09-10T00:11:26.015 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-09-10T00:11:26.093 INFO:teuthology.orchestra.run.smithi084.stdout:running bootstrap script ... ok 2023-09-10T00:11:26.141 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-09-10T00:11:26.625 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-common (238) ... 2023-09-10T00:11:26.726 INFO:teuthology.orchestra.run.smithi084.stdout:performing post-bootstrap initialization ... ok 2023-09-10T00:11:27.538 INFO:teuthology.orchestra.run.smithi100.stdout:Adding user postgres to group ssl-cert 2023-09-10T00:11:27.584 INFO:teuthology.orchestra.run.smithi084.stdout:syncing data to disk ... ok 2023-09-10T00:11:27.772 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:27.772 INFO:teuthology.orchestra.run.smithi100.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-09-10T00:11:27.960 INFO:teuthology.orchestra.run.smithi100.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-09-10T00:11:27.961 INFO:teuthology.orchestra.run.smithi100.stdout:Removing obsolete dictionary files: 2023-09-10T00:11:27.980 INFO:teuthology.orchestra.run.smithi084.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-10T00:11:28.565 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-09-10T00:11:28.968 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-09-10T00:11:29.293 INFO:teuthology.orchestra.run.smithi100.stdout:Creating new PostgreSQL cluster 14/main ... 2023-09-10T00:11:29.317 INFO:teuthology.orchestra.run.smithi100.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-09-10T00:11:29.364 INFO:teuthology.orchestra.run.smithi100.stdout:The files belonging to this database system will be owned by user "postgres". 2023-09-10T00:11:29.365 INFO:teuthology.orchestra.run.smithi100.stdout:This user must also own the server process. 2023-09-10T00:11:29.365 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:29.365 INFO:teuthology.orchestra.run.smithi100.stdout:The database cluster will be initialized with locale "en_US". 2023-09-10T00:11:29.365 INFO:teuthology.orchestra.run.smithi100.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-09-10T00:11:29.366 INFO:teuthology.orchestra.run.smithi100.stdout:The default text search configuration will be set to "english". 2023-09-10T00:11:29.366 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:29.366 INFO:teuthology.orchestra.run.smithi100.stdout:Data page checksums are disabled. 2023-09-10T00:11:29.366 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:29.366 INFO:teuthology.orchestra.run.smithi100.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-09-10T00:11:29.367 INFO:teuthology.orchestra.run.smithi100.stdout:creating subdirectories ... ok 2023-09-10T00:11:29.367 INFO:teuthology.orchestra.run.smithi100.stdout:selecting dynamic shared memory implementation ... posix 2023-09-10T00:11:29.378 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default max_connections ... 100 2023-09-10T00:11:29.396 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default shared_buffers ... 128MB 2023-09-10T00:11:29.405 INFO:teuthology.orchestra.run.smithi100.stdout:selecting default time zone ... Etc/UTC 2023-09-10T00:11:29.406 INFO:teuthology.orchestra.run.smithi100.stdout:creating configuration files ... ok 2023-09-10T00:11:29.520 INFO:teuthology.orchestra.run.smithi100.stdout:running bootstrap script ... ok 2023-09-10T00:11:30.146 INFO:teuthology.orchestra.run.smithi100.stdout:performing post-bootstrap initialization ... ok 2023-09-10T00:11:30.811 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:30.830 INFO:teuthology.orchestra.run.smithi100.stdout:syncing data to disk ... ok 2023-09-10T00:11:30.937 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-10T00:11:31.063 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up postgresql (14+238) ... 2023-09-10T00:11:31.197 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:31.245 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-09-10T00:11:31.323 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:31.568 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-10T00:11:31.569 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-10T00:11:32.175 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-10T00:11:32.453 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-10T00:11:32.604 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-10T00:11:33.940 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-10T00:11:34.048 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-10T00:11:34.092 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:34.218 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql-contrib (14+238) ... 2023-09-10T00:11:34.344 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up postgresql (14+238) ... 2023-09-10T00:11:34.445 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-09-10T00:11:34.546 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-09-10T00:11:34.678 INFO:teuthology.orchestra.run.smithi084.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-10T00:11:34.682 DEBUG:teuthology.parallel:result is None 2023-09-10T00:11:34.799 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-09-10T00:11:34.800 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-09-10T00:11:35.457 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-09-10T00:11:35.784 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-10T00:11:35.935 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-10T00:11:37.280 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-09-10T00:11:37.371 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-10T00:11:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-10T00:11:37.990 DEBUG:teuthology.parallel:result is None 2023-09-10T00:11:37.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9670cca5bc8e17916865dc84939edfc10b1f2c00 2023-09-10T00:11:38.208 DEBUG:teuthology.orchestra.run.smithi084:> dpkg-query -W -f '${Version}' ceph 2023-09-10T00:11:38.228 INFO:teuthology.orchestra.run.smithi084.stdout:18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:11:38.229 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:11:38.229 INFO:teuthology.task.install:The correct ceph version 18.0.0-6025-g9670cca5-1jammy is installed. 2023-09-10T00:11:38.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9670cca5bc8e17916865dc84939edfc10b1f2c00 2023-09-10T00:11:38.373 DEBUG:teuthology.orchestra.run.smithi100:> dpkg-query -W -f '${Version}' ceph 2023-09-10T00:11:38.393 INFO:teuthology.orchestra.run.smithi100.stdout:18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:11:38.393 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6025-g9670cca5-1jammy 2023-09-10T00:11:38.393 INFO:teuthology.task.install:The correct ceph version 18.0.0-6025-g9670cca5-1jammy is installed. 2023-09-10T00:11:38.394 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-10T00:11:38.395 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:38.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-10T00:11:38.410 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:38.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-10T00:11:38.451 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-10T00:11:38.452 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:38.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2023-09-10T00:11:38.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-10T00:11:38.520 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:38.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2023-09-10T00:11:38.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-10T00:11:38.586 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-10T00:11:38.586 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:38.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-10T00:11:38.599 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-10T00:11:38.652 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:38.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-10T00:11:38.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-10T00:11:38.718 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-10T00:11:38.718 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:38.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2023-09-10T00:11:38.731 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-10T00:11:38.785 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:38.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2023-09-10T00:11:38.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-10T00:11:38.853 INFO:teuthology.run_tasks:Running task ceph... 2023-09-10T00:11:38.918 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-10T00:11:38.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2023-09-10T00:11:38.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2023-09-10T00:11:38.934 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-10T00:11:38.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-10T00:11:38.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-10T00:11:38.989 INFO:tasks.ceph:Creating extra log directories... 2023-09-10T00:11:38.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-10T00:11:39.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-10T00:11:39.048 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-10T00:11:39.049 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-10T00:11:39.049 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-10T00:11:39.049 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:39.050 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-10T00:11:39.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-10T00:11:39.164 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:39.165 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-10T00:11:39.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-10T00:11:39.253 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-10T00:11:39.254 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-10T00:11:39.254 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514', 'branch': 'wip-batrick-testing-20230909.145638', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7392514', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230909.145638'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230909.145638', 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5964, 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00', 'sleep_before_teardown': 0, 'subset': '225/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230909.145638', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLybwlcIyj00H+jeLtM8lPFyNiL68Ef1XVNXa8m7uetT2eJy6/Ti3ws/mG5wk8tu62Ndj5Y3aqu/IimCUAAhdgk=', 'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFanmScQKbUsmU2qk9kD/DpJR5YjQLrBNoqA6hS2EXJZivkW1KlXmYgmbGmVBjhQThLp2Ek5bO6LjekpW/Vy6Ow='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '9670cca5bc8e17916865dc84939edfc10b1f2c00', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-09_19:00:20', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-09-10T00:11:39.255 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-10T00:11:39.258 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-10T00:11:39.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2023-09-10T00:11:39.307 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2023-09-10T00:11:39.350 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:39.351 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2023-09-10T00:11:39.366 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-10T00:11:39.366 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2023-09-10T00:11:39.414 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-10T00:11:39.414 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:39.415 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 874 Links: 1 2023-09-10T00:11:39.415 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:39.415 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-10 00:05:42.316824910 +0000 2023-09-10T00:11:39.415 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-10 00:05:41.984827875 +0000 2023-09-10T00:11:39.415 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-10 00:05:41.984827875 +0000 2023-09-10T00:11:39.416 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-10T00:11:39.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-10T00:11:39.468 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-10T00:11:39.469 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-10T00:11:39.469 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.0004059 s, 1.3 MB/s 2023-09-10T00:11:39.470 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-10T00:11:39.519 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2023-09-10T00:11:39.566 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-10T00:11:39.566 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:39.566 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 892 Links: 1 2023-09-10T00:11:39.566 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:39.566 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-10 00:05:42.860820052 +0000 2023-09-10T00:11:39.567 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-10 00:05:42.532822981 +0000 2023-09-10T00:11:39.567 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-10 00:05:42.532822981 +0000 2023-09-10T00:11:39.567 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-10T00:11:39.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-10T00:11:39.620 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-10T00:11:39.621 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-10T00:11:39.621 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000423237 s, 1.2 MB/s 2023-09-10T00:11:39.622 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-10T00:11:39.671 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2023-09-10T00:11:39.718 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-10T00:11:39.718 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:39.719 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-09-10T00:11:39.719 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:39.719 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-10 00:05:43.440814871 +0000 2023-09-10T00:11:39.719 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-10 00:05:43.104817871 +0000 2023-09-10T00:11:39.719 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-10 00:05:43.104817871 +0000 2023-09-10T00:11:39.720 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-10T00:11:39.720 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-10T00:11:39.771 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-10T00:11:39.772 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-10T00:11:39.772 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000306436 s, 1.7 MB/s 2023-09-10T00:11:39.773 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-10T00:11:39.819 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2023-09-10T00:11:39.866 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-10T00:11:39.866 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:39.866 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-09-10T00:11:39.866 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:39.867 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2023-09-10 00:05:44.020809690 +0000 2023-09-10T00:11:39.867 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2023-09-10 00:05:43.668812833 +0000 2023-09-10T00:11:39.867 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2023-09-10 00:05:43.668812833 +0000 2023-09-10T00:11:39.867 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2023-09-10T00:11:39.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-10T00:11:39.921 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2023-09-10T00:11:39.921 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2023-09-10T00:11:39.922 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000383807 s, 1.3 MB/s 2023-09-10T00:11:39.923 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-10T00:11:39.972 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:39.972 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:39.973 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2023-09-10T00:11:39.979 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-10T00:11:39.980 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2023-09-10T00:11:40.028 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-10T00:11:40.028 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:40.028 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 876 Links: 1 2023-09-10T00:11:40.029 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:40.029 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-09-10 00:05:41.998312931 +0000 2023-09-10T00:11:40.029 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-09-10 00:05:41.994312965 +0000 2023-09-10T00:11:40.030 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-09-10 00:05:41.994312965 +0000 2023-09-10T00:11:40.030 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-09-10T00:11:40.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-10T00:11:40.081 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-09-10T00:11:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-09-10T00:11:40.082 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000384707 s, 1.3 MB/s 2023-09-10T00:11:40.083 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-10T00:11:40.132 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2023-09-10T00:11:40.179 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-10T00:11:40.179 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:40.179 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 893 Links: 1 2023-09-10T00:11:40.179 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:40.179 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-09-10 00:05:42.914304759 +0000 2023-09-10T00:11:40.180 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-09-10 00:05:42.570307827 +0000 2023-09-10T00:11:40.180 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-09-10 00:05:42.570307827 +0000 2023-09-10T00:11:40.180 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-09-10T00:11:40.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-10T00:11:40.232 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-09-10T00:11:40.233 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-09-10T00:11:40.233 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000426177 s, 1.2 MB/s 2023-09-10T00:11:40.234 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-10T00:11:40.284 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2023-09-10T00:11:40.330 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-10T00:11:40.331 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:40.331 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 913 Links: 1 2023-09-10T00:11:40.331 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:40.331 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-09-10 00:05:43.510299441 +0000 2023-09-10T00:11:40.331 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-09-10 00:05:43.150302653 +0000 2023-09-10T00:11:40.332 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-09-10 00:05:43.150302653 +0000 2023-09-10T00:11:40.332 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-09-10T00:11:40.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-10T00:11:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-09-10T00:11:40.385 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-09-10T00:11:40.385 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000360063 s, 1.4 MB/s 2023-09-10T00:11:40.386 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-10T00:11:40.436 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2023-09-10T00:11:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-10T00:11:40.483 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-10T00:11:40.483 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-09-10T00:11:40.483 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-10T00:11:40.484 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-09-10 00:05:43.730297479 +0000 2023-09-10T00:11:40.484 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-09-10 00:05:43.726297515 +0000 2023-09-10T00:11:40.484 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-09-10 00:05:43.726297515 +0000 2023-09-10T00:11:40.484 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2023-09-10T00:11:40.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-10T00:11:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-09-10T00:11:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-09-10T00:11:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000385647 s, 1.3 MB/s 2023-09-10T00:11:40.539 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-10T00:11:40.588 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:40.588 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-10T00:11:40.588 INFO:tasks.ceph:Generating config... 2023-09-10T00:11:40.590 INFO:tasks.ceph:[client] pid file = 2023-09-10T00:11:40.590 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-10T00:11:40.590 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-10T00:11:40.590 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-10T00:11:40.591 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-10T00:11:40.591 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-10T00:11:40.591 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-10T00:11:40.592 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-10T00:11:40.592 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-10T00:11:40.592 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-10T00:11:40.592 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-10T00:11:40.593 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-10T00:11:40.593 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-10T00:11:40.593 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-10T00:11:40.593 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-10T00:11:40.594 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-10T00:11:40.594 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-10T00:11:40.594 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-10T00:11:40.595 INFO:tasks.ceph:Setting up mon.a... 2023-09-10T00:11:40.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-10T00:11:40.630 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2023-09-10T00:11:40.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-10T00:11:40.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-10T00:11:40.777 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.100'), ('mon.c', '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]')] 2023-09-10T00:11:40.777 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-09-10T00:11:40.778 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:40.779 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-10T00:11:40.822 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.100 --addv c '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:40.908 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid af9d6115-2022-4a0a-92c0-a49edd021b51 2023-09-10T00:11:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = pacific 2023-09-10T00:11:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2023-09-10T00:11:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:fsid af9d6115-2022-4a0a-92c0-a49edd021b51 2023-09-10T00:11:40.909 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2023-09-10T00:11:40.911477+0000 2023-09-10T00:11:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:created 2023-09-10T00:11:40.911477+0000 2023-09-10T00:11:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 16 (pacific) 2023-09-10T00:11:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2023-09-10T00:11:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2023-09-10T00:11:40.910 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2023-09-10T00:11:40.911 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon.c 2023-09-10T00:11:40.911 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-10T00:11:40.912 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-10T00:11:40.958 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID af9d6115-2022-4a0a-92c0-a49edd021b51... 2023-09-10T00:11:40.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-10T00:11:41.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-10T00:11:41.031 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2023-09-10T00:11:41.032 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2023-09-10T00:11:41.032 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-10T00:11:41.032 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2023-09-10T00:11:41.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.032 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2023-09-10T00:11:41.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.033 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2023-09-10T00:11:41.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.033 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2023-09-10T00:11:41.033 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2023-09-10T00:11:41.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.034 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2023-09-10T00:11:41.034 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2023-09-10T00:11:41.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-10T00:11:41.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.036 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2023-09-10T00:11:41.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2023-09-10T00:11:41.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2023-09-10T00:11:41.036 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2023-09-10T00:11:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2023-09-10T00:11:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2023-09-10T00:11:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2023-09-10T00:11:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2023-09-10T00:11:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-10T00:11:41.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-10T00:11:41.038 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2023-09-10T00:11:41.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.038 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-10T00:11:41.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.039 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2023-09-10T00:11:41.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2023-09-10T00:11:41.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.039 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2023-09-10T00:11:41.040 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2023-09-10T00:11:41.040 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2023-09-10T00:11:41.040 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2023-09-10T00:11:41.040 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = af9d6115-2022-4a0a-92c0-a49edd021b51 2023-09-10T00:11:41.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.041 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2023-09-10T00:11:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2023-09-10T00:11:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2023-09-10T00:11:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2023-09-10T00:11:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2023-09-10T00:11:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2023-09-10T00:11:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2023-09-10T00:11:41.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.043 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2023-09-10T00:11:41.043 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2023-09-10T00:11:41.043 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2023-09-10T00:11:41.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.044 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2023-09-10T00:11:41.044 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2023-09-10T00:11:41.044 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.044 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2023-09-10T00:11:41.044 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2023-09-10T00:11:41.045 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2023-09-10T00:11:41.046 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.046 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2023-09-10T00:11:41.046 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2023-09-10T00:11:41.046 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2023-09-10T00:11:41.046 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2023-09-10T00:11:41.047 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 20 2023-09-10T00:11:41.047 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 20 2023-09-10T00:11:41.047 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-10T00:11:41.047 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2023-09-10T00:11:41.047 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 10 2023-09-10T00:11:41.048 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2023-09-10T00:11:41.048 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2023-09-10T00:11:41.048 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2023-09-10T00:11:41.048 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2023-09-10T00:11:41.049 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2023-09-10T00:11:41.049 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.049 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2023-09-10T00:11:41.049 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-10T00:11:41.049 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2023-09-10T00:11:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-09-10T00:11:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-09-10T00:11:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-09-10T00:11:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-09-10T00:11:41.050 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2023-09-10T00:11:41.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.051 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2023-09-10T00:11:41.051 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2023-09-10T00:11:41.051 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2023-09-10T00:11:41.052 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2023-09-10T00:11:41.052 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2023-09-10T00:11:41.052 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2023-09-10T00:11:41.052 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2023-09-10T00:11:41.052 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-10T00:11:41.053 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2023-09-10T00:11:41.054 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2023-09-10T00:11:41.054 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.054 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2023-09-10T00:11:41.054 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-10T00:11:41.054 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-10T00:11:41.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.055 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2023-09-10T00:11:41.055 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2023-09-10T00:11:41.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.055 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2023-09-10T00:11:41.056 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = "" 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2023-09-10T00:11:41.057 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-09-10T00:11:41.058 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-09-10T00:11:41.058 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-09-10T00:11:41.058 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-09-10T00:11:41.059 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2023-09-10T00:11:41.060 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2023-09-10T00:11:41.060 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-10T00:11:41.060 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2023-09-10T00:11:41.060 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2023-09-10T00:11:41.061 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2023-09-10T00:11:41.062 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.062 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2023-09-10T00:11:41.062 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2023-09-10T00:11:41.062 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.062 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-10T00:11:41.063 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2023-09-10T00:11:41.063 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.063 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2023-09-10T00:11:41.063 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-10T00:11:41.063 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2023-09-10T00:11:41.064 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2023-09-10T00:11:41.065 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2023-09-10T00:11:41.065 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2023-09-10T00:11:41.065 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2023-09-10T00:11:41.065 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-10T00:11:41.065 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-10T00:11:41.066 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2023-09-10T00:11:41.066 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.066 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-10T00:11:41.066 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.066 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2023-09-10T00:11:41.067 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.84,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = af9d6115-2022-4a0a-92c0-a49edd021b51 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2023-09-10T00:11:41.068 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.069 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2023-09-10T00:11:41.069 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2023-09-10T00:11:41.069 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2023-09-10T00:11:41.069 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.069 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2023-09-10T00:11:41.070 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2023-09-10T00:11:41.070 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.070 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2023-09-10T00:11:41.070 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2023-09-10T00:11:41.070 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2023-09-10T00:11:41.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.071 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2023-09-10T00:11:41.071 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2023-09-10T00:11:41.071 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.071 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2023-09-10T00:11:41.072 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.072 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2023-09-10T00:11:41.072 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.072 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2023-09-10T00:11:41.072 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.073 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2023-09-10T00:11:41.073 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2023-09-10T00:11:41.073 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.073 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2023-09-10T00:11:41.073 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2023-09-10T00:11:41.074 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2023-09-10T00:11:41.074 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2023-09-10T00:11:41.074 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2023-09-10T00:11:41.074 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2023-09-10T00:11:41.074 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-09-10T00:11:41.075 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2023-09-10T00:11:41.075 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2023-09-10T00:11:41.075 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2023-09-10T00:11:41.075 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2023-09-10T00:11:41.075 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2023-09-10T00:11:41.076 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2023-09-10T00:11:41.076 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2023-09-10T00:11:41.076 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.076 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2023-09-10T00:11:41.077 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-09-10T00:11:41.077 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2023-09-10T00:11:41.077 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-09-10T00:11:41.077 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-09-10T00:11:41.077 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-09-10T00:11:41.078 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-09-10T00:11:41.078 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2023-09-10T00:11:41.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.078 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2023-09-10T00:11:41.078 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2023-09-10T00:11:41.079 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2023-09-10T00:11:41.079 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2023-09-10T00:11:41.079 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2023-09-10T00:11:41.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2023-09-10T00:11:41.079 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2023-09-10T00:11:41.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2023-09-10T00:11:41.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2023-09-10T00:11:41.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2023-09-10T00:11:41.080 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2023-09-10T00:11:41.080 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.081 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-10T00:11:41.081 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2023-09-10T00:11:41.081 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2023-09-10T00:11:41.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.081 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2023-09-10T00:11:41.082 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-10T00:11:41.082 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-10T00:11:41.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.082 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2023-09-10T00:11:41.082 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2023-09-10T00:11:41.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.083 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2023-09-10T00:11:41.083 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-09-10T00:11:41.083 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2023-09-10T00:11:41.083 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2023-09-10T00:11:41.084 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2023-09-10T00:11:41.084 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2023-09-10T00:11:41.084 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-10T00:11:41.084 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-10T00:11:41.084 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = "" 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-09-10T00:11:41.085 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-09-10T00:11:41.086 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-09-10T00:11:41.086 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-10T00:11:41.086 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-10T00:11:41.149 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-10T00:11:41.149 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:41.149 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-10T00:11:41.157 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:41.157 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-10T00:11:41.206 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:11:41.206 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:41.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-10T00:11:41.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-10T00:11:41.269 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:11:41.269 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:41.322 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:11:41.322 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:41.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-10T00:11:41.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-10T00:11:41.346 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:11:41.346 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:41.395 INFO:tasks.ceph:Setting up mon nodes... 2023-09-10T00:11:41.395 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-10T00:11:41.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-10T00:11:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-10T00:11:41.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-10T00:11:41.484 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-10T00:11:41.494 INFO:tasks.ceph:Setting up mds nodes... 2023-09-10T00:11:41.495 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-10T00:11:41.533 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-10T00:11:41.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-10T00:11:41.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-10T00:11:41.678 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-10T00:11:41.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-10T00:11:41.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-10T00:11:41.784 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-10T00:11:41.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-10T00:11:41.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-10T00:11:41.924 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-10T00:11:41.927 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-10T00:11:41.984 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-10T00:11:41.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-10T00:11:42.019 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-10T00:11:42.030 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-10T00:11:42.104 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-10T00:11:42.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-10T00:11:42.152 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-10T00:11:42.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-10T00:11:42.239 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-10T00:11:42.250 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-10T00:11:42.250 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-10T00:11:42.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-10T00:11:42.264 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:42.265 INFO:tasks.ceph:role: osd.0 2023-09-10T00:11:42.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:11:42.265 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-10T00:11:42.325 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:42.326 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:42.326 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:42.326 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:42.326 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:42.326 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:42.327 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:42.327 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:42.327 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:42.327 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:42.812 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-10T00:11:42.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-10T00:11:42.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-10T00:11:42.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-10T00:11:42.951 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:42.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:42.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-10T00:11:43.003 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:43.004 INFO:tasks.ceph:role: osd.1 2023-09-10T00:11:43.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:11:43.004 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-10T00:11:43.071 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:43.071 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:43.071 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:43.071 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:43.072 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:43.507 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-10T00:11:43.509 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-10T00:11:43.509 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-10T00:11:43.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-10T00:11:43.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:43.623 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:43.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-10T00:11:43.677 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:43.677 INFO:tasks.ceph:role: osd.2 2023-09-10T00:11:43.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:11:43.678 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-10T00:11:43.742 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:43.742 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:43.742 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:43.742 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:43.743 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:44.193 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-10T00:11:44.195 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-10T00:11:44.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-10T00:11:44.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-10T00:11:44.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:44.297 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:44.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-10T00:11:44.347 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:44.348 INFO:tasks.ceph:role: osd.3 2023-09-10T00:11:44.348 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:11:44.348 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-10T00:11:44.410 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:44.411 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:44.411 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:44.411 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:44.411 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:44.411 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:44.412 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:44.412 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:44.412 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:44.412 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:44.868 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2023-09-10T00:11:44.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2023-09-10T00:11:44.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-10T00:11:44.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-10T00:11:44.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:44.998 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:44.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.097+0000 7fdef6c89640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-10T00:11:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.101+0000 7fdef6c89640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-10T00:11:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.101+0000 7fdef6c89640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-10T00:11:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.101+0000 7fdef6c89640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-10T00:11:45.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.101+0000 7fdef6c89640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-10T00:11:45.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:45.109+0000 7fdef6c89640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-10T00:11:48.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-10T00:11:48.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:48.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-10T00:11:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-10T00:11:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-10T00:11:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-10T00:11:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-10T00:11:48.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:48.245+0000 7f2f61342640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-10T00:11:51.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-10T00:11:51.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:51.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-10T00:11:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-10T00:11:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-10T00:11:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-10T00:11:51.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-10T00:11:51.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:51.401+0000 7f1a82e22640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-10T00:11:54.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-10T00:11:54.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:11:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-10T00:11:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-10T00:11:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-10T00:11:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-10T00:11:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-10T00:11:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:11:54.597+0000 7f94d30c9640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-10T00:11:57.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-10T00:11:57.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-10T00:11:57.677 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:57.678 INFO:tasks.ceph:role: osd.4 2023-09-10T00:11:57.678 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:11:57.678 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-10T00:11:57.737 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:57.737 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:57.737 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:57.738 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:57.738 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:57.738 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:57.738 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:57.739 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:57.739 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:57.739 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:58.206 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2023-09-10T00:11:58.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-09-10T00:11:58.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-10T00:11:58.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-10T00:11:58.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:58.350 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:58.351 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-10T00:11:58.404 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:58.404 INFO:tasks.ceph:role: osd.5 2023-09-10T00:11:58.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:11:58.405 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-10T00:11:58.465 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:58.466 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:58.466 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:58.466 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:58.466 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:58.467 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:58.467 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:58.467 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:58.467 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:58.467 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:58.897 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2023-09-10T00:11:58.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-09-10T00:11:58.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-10T00:11:58.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-10T00:11:59.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:59.015 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:59.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-10T00:11:59.068 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:59.068 INFO:tasks.ceph:role: osd.6 2023-09-10T00:11:59.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:11:59.069 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-10T00:11:59.130 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:59.130 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:59.131 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:59.131 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:59.131 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:59.131 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:59.131 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:59.132 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:59.132 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:59.132 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:11:59.604 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2023-09-10T00:11:59.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-09-10T00:11:59.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-10T00:11:59.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-10T00:11:59.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:11:59.705 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:11:59.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-10T00:11:59.766 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-10T00:11:59.766 INFO:tasks.ceph:role: osd.7 2023-09-10T00:11:59.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:11:59.767 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-10T00:11:59.831 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-10T00:11:59.832 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-10T00:11:59.832 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-10T00:11:59.832 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-10T00:11:59.832 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-10T00:11:59.833 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2023-09-10T00:11:59.833 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-10T00:11:59.833 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-10T00:11:59.833 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-10T00:11:59.833 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-10T00:12:00.286 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2023-09-10T00:12:00.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2023-09-10T00:12:00.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-10T00:12:00.419 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-10T00:12:00.431 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: /sbin/restorecon: command not found 2023-09-10T00:12:00.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:12:00.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:00.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.548+0000 7fc2b6007640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-10T00:12:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.552+0000 7fc2b6007640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-10T00:12:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.552+0000 7fc2b6007640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-10T00:12:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.552+0000 7fc2b6007640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-10T00:12:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.552+0000 7fc2b6007640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-10T00:12:00.558 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:00.556+0000 7fc2b6007640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-10T00:12:03.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-10T00:12:03.812 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:03.891 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-10T00:12:03.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-10T00:12:03.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-10T00:12:03.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-10T00:12:03.892 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-10T00:12:03.893 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:03.892+0000 7fb87bbc4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-10T00:12:06.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-10T00:12:06.967 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.048+0000 7fa89cdaa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-10T00:12:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.052+0000 7fa89cdaa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-10T00:12:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.052+0000 7fa89cdaa640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-10T00:12:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.052+0000 7fa89cdaa640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-10T00:12:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.052+0000 7fa89cdaa640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-10T00:12:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:07.052+0000 7fa89cdaa640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-10T00:12:09.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:12:09.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:12:10.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-10T00:12:10.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-10T00:12:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-10T00:12:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-10T00:12:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-10T00:12:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-10T00:12:10.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:10.168+0000 7fef99c63640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-10T00:12:13.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-10T00:12:13.243 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-10T00:12:13.243 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-10T00:12:13.257 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-10T00:12:13.314 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.314 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-10T00:12:13.369 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-10T00:12:13.425 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.425 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-10T00:12:13.481 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-10T00:12:13.537 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-10T00:12:13.593 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-10T00:12:13.607 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-10T00:12:13.661 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-10T00:12:13.719 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-10T00:12:13.773 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-10T00:12:13.826 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-10T00:12:13.881 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-10T00:12:13.933 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.933 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-10T00:12:13.939 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:13.939 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-10T00:12:13.986 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.986 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-10T00:12:13.992 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:13.992 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-10T00:12:14.038 INFO:tasks.ceph:Adding keys to all mons... 2023-09-10T00:12:14.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-10T00:12:14.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-10T00:12:14.084 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2023-09-10T00:12:14.084 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1klfxTGhAAAEc2uIskIMw1yfAErIi9Zg== 2023-09-10T00:12:14.085 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2023-09-10T00:12:14.085 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1k3Tr8HxAA0cnWpoM86V6vYdWRBhfOHw== 2023-09-10T00:12:14.085 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2023-09-10T00:12:14.085 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1kXIKeKBAAIIFJve06bjSGXxxsZnWInw== 2023-09-10T00:12:14.085 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2023-09-10T00:12:14.086 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDBCf1kmqsuBhAA6aIdLqWEQPTmm5MXHSgVyA== 2023-09-10T00:12:14.086 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2023-09-10T00:12:14.086 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDECf1kMCr8DhAAXgaK7bstEyOonwTUynAQqw== 2023-09-10T00:12:14.086 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2023-09-10T00:12:14.086 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDHCf1kIMgpGBAAbM7SJ/0EuDC01g1+iUuGoQ== 2023-09-10T00:12:14.087 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2023-09-10T00:12:14.087 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDKCf1km5faIxAAFCyuZ2ioyU8GEH4MtQLToA== 2023-09-10T00:12:14.087 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2023-09-10T00:12:14.087 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1kwOH3HBAAYdUDq79JbDK0Hu473+S/fg== 2023-09-10T00:12:14.087 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2023-09-10T00:12:14.088 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1kzT3eLhAAcUxdejvOMuHW4lFJQT0Wsg== 2023-09-10T00:12:14.088 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2023-09-10T00:12:14.088 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1kHh5CNxAAHjOTlqwuFOTGcWML7+sL4A== 2023-09-10T00:12:14.088 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2023-09-10T00:12:14.089 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDQCf1kGFm5IBAADJJuQhHg1qQ2g/UCrCzERA== 2023-09-10T00:12:14.089 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2023-09-10T00:12:14.089 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDTCf1kDC1GNRAAkmkQ5mGoyiACvSYQtRY8BA== 2023-09-10T00:12:14.090 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2023-09-10T00:12:14.090 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDXCf1kmUYeAxAAU8IgpMBSarKo/IhAHVQrwA== 2023-09-10T00:12:14.090 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2023-09-10T00:12:14.090 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQDaCf1kP5UeChAAsxKkaHL0Alich5xIqPVkzA== 2023-09-10T00:12:14.090 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC+Cf1kBBJYARAANCeEIrMyww1eYb9zY89mOw== 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout:[client.2] 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC+Cf1kkuRgBhAAl82p1/o/1kGlYwhjvZtBAw== 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout:[client.1] 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC+Cf1kS6Y0CRAAM7iIvJZgkrE9YGUqMAcUAg== 2023-09-10T00:12:14.091 INFO:teuthology.orchestra.run.smithi084.stdout:[client.3] 2023-09-10T00:12:14.092 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC+Cf1kkKVpDhAAEf1/3Usl9gjL2BFeNzew/Q== 2023-09-10T00:12:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2023-09-10T00:12:14.093 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1klfxTGhAAAEc2uIskIMw1yfAErIi9Zg== 2023-09-10T00:12:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2023-09-10T00:12:14.093 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1k3Tr8HxAA0cnWpoM86V6vYdWRBhfOHw== 2023-09-10T00:12:14.094 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2023-09-10T00:12:14.094 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1kXIKeKBAAIIFJve06bjSGXxxsZnWInw== 2023-09-10T00:12:14.094 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2023-09-10T00:12:14.094 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDBCf1kmqsuBhAA6aIdLqWEQPTmm5MXHSgVyA== 2023-09-10T00:12:14.094 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2023-09-10T00:12:14.095 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDECf1kMCr8DhAAXgaK7bstEyOonwTUynAQqw== 2023-09-10T00:12:14.095 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2023-09-10T00:12:14.095 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDHCf1kIMgpGBAAbM7SJ/0EuDC01g1+iUuGoQ== 2023-09-10T00:12:14.095 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2023-09-10T00:12:14.095 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDKCf1km5faIxAAFCyuZ2ioyU8GEH4MtQLToA== 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1kwOH3HBAAYdUDq79JbDK0Hu473+S/fg== 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1kzT3eLhAAcUxdejvOMuHW4lFJQT0Wsg== 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2023-09-10T00:12:14.096 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9Cf1kHh5CNxAAHjOTlqwuFOTGcWML7+sL4A== 2023-09-10T00:12:14.097 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2023-09-10T00:12:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQCf1kGFm5IBAADJJuQhHg1qQ2g/UCrCzERA== 2023-09-10T00:12:14.097 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2023-09-10T00:12:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDTCf1kDC1GNRAAkmkQ5mGoyiACvSYQtRY8BA== 2023-09-10T00:12:14.097 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2023-09-10T00:12:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDXCf1kmUYeAxAAU8IgpMBSarKo/IhAHVQrwA== 2023-09-10T00:12:14.098 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2023-09-10T00:12:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDaCf1kP5UeChAAsxKkaHL0Alich5xIqPVkzA== 2023-09-10T00:12:14.098 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2023-09-10T00:12:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC+Cf1kBBJYARAANCeEIrMyww1eYb9zY89mOw== 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout:[client.2] 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC+Cf1kkuRgBhAAl82p1/o/1kGlYwhjvZtBAw== 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC+Cf1kS6Y0CRAAM7iIvJZgkrE9YGUqMAcUAg== 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout:[client.3] 2023-09-10T00:12:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC+Cf1kkKVpDhAAEf1/3Usl9gjL2BFeNzew/Q== 2023-09-10T00:12:14.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-10T00:12:14.139 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-10T00:12:14.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.319 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.400 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-10T00:12:14.654 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-10T00:12:14.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-10T00:12:14.899 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:14.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:15.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:15.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:15.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:15.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-10T00:12:15.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.415 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-10T00:12:15.553 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-10T00:12:15.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-10T00:12:15.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-10T00:12:15.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-10T00:12:15.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-10T00:12:15.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-10T00:12:15.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-10T00:12:15.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-10T00:12:15.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-10T00:12:15.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-10T00:12:15.993 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:15.996 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-10T00:12:16.037 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-10T00:12:16.038 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-10T00:12:16.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-10T00:12:16.042 INFO:tasks.ceph.mon.a:Started 2023-09-10T00:12:16.043 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-10T00:12:16.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-10T00:12:16.083 INFO:tasks.ceph.mon.b:Started 2023-09-10T00:12:16.084 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-10T00:12:16.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-10T00:12:16.086 INFO:tasks.ceph.mon.c:Started 2023-09-10T00:12:16.087 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'] 2023-09-10T00:12:16.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-09-10T00:12:16.090 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'] 2023-09-10T00:12:16.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client debug_client 20 2023-09-10T00:12:16.134 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'] 2023-09-10T00:12:16.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client debug_ms 1 2023-09-10T00:12:16.178 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'] 2023-09-10T00:12:16.179 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-09-10T00:12:16.226 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'] 2023-09-10T00:12:16.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-09-10T00:12:16.274 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'] 2023-09-10T00:12:16.274 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-09-10T00:12:16.318 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'] 2023-09-10T00:12:16.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-09-10T00:12:16.366 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'] 2023-09-10T00:12:16.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-09-10T00:12:16.414 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'] 2023-09-10T00:12:16.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_bal_fragment_size_max 10000 2023-09-10T00:12:16.458 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'] 2023-09-10T00:12:16.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_bal_merge_size 5 2023-09-10T00:12:16.502 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'] 2023-09-10T00:12:16.502 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_bal_split_bits 3 2023-09-10T00:12:16.546 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'] 2023-09-10T00:12:16.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_bal_split_size 100 2023-09-10T00:12:16.590 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'] 2023-09-10T00:12:16.591 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-09-10T00:12:16.638 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'] 2023-09-10T00:12:16.639 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-09-10T00:12:16.682 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'] 2023-09-10T00:12:16.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-09-10T00:12:16.725 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'] 2023-09-10T00:12:16.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-09-10T00:12:16.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.741+0000 7f4fcd7fa640 1 -- 172.21.15.84:0/4076215391 <== mon.1 v2:172.21.15.100:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v6)=0 v6) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4fc80c0070 con 0x7f4fd0153c20 2023-09-10T00:12:16.746 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'] 2023-09-10T00:12:16.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-09-10T00:12:16.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.753+0000 7f4fd6cda640 1 -- 172.21.15.84:0/4076215391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd0153c20 msgr2=0x7f4fd014e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.753+0000 7f4fd6cda640 1 --2- 172.21.15.84:0/4076215391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd0153c20 0x7f4fd014e6b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009e50 tx=0x7f4fc801a540 comp rx=0 tx=0).stop 2023-09-10T00:12:16.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.753+0000 7fe99effd640 1 -- 172.21.15.84:0/2988706415 <== mon.2 v2:172.21.15.100:3301/0 10 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7fe9a80bb030 con 0x7fe9b0156870 2023-09-10T00:12:16.759 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'] 2023-09-10T00:12:16.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-09-10T00:12:16.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 -- 172.21.15.84:0/4076215391 shutdown_connections 2023-09-10T00:12:16.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.757+0000 7fe9b49da640 1 -- 172.21.15.84:0/2988706415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe9b0156870 msgr2=0x7fe9b01588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 --2- 172.21.15.84:0/4076215391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd0153c20 0x7f4fd014e6b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 --2- 172.21.15.84:0/4076215391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4fd015b2e0 0x7f4fd01536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 --2- 172.21.15.84:0/4076215391 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4fc0005190 0x7f4fd015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 -- 172.21.15.84:0/4076215391 >> 172.21.15.84:0/4076215391 conn(0x7f4fd00cb350 msgr2=0x7f4fd00cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 --2- 172.21.15.84:0/2988706415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe9b0156870 0x7fe9b01588d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80ae040 tx=0x7fe998005800 comp rx=0 tx=0).stop 2023-09-10T00:12:16.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 -- 172.21.15.84:0/4076215391 shutdown_connections 2023-09-10T00:12:16.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7f4fd6cda640 1 -- 172.21.15.84:0/4076215391 wait complete. 2023-09-10T00:12:16.765 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'] 2023-09-10T00:12:16.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-09-10T00:12:16.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 -- 172.21.15.84:0/2988706415 shutdown_connections 2023-09-10T00:12:16.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 --2- 172.21.15.84:0/2988706415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe9b0156870 0x7fe9b01588d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 --2- 172.21.15.84:0/2988706415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b01f4620 0x7fe9b0158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 --2- 172.21.15.84:0/2988706415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe998004d10 0x7fe9b01f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.761+0000 7fe9b49da640 1 -- 172.21.15.84:0/2988706415 >> 172.21.15.84:0/2988706415 conn(0x7fe9b00cd570 msgr2=0x7fe9b00b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.765+0000 7fe9b49da640 1 -- 172.21.15.84:0/2988706415 shutdown_connections 2023-09-10T00:12:16.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.765+0000 7fe9b49da640 1 -- 172.21.15.84:0/2988706415 wait complete. 2023-09-10T00:12:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.781+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2642956783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 msgr2=0x7fb6b40b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.781+0000 7fb6b93d0640 1 --2- 172.21.15.84:0/2642956783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40b2170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009840 tx=0x7fb6a801c5f0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.785 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'] 2023-09-10T00:12:16.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-09-10T00:12:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2642956783 shutdown_connections 2023-09-10T00:12:16.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 --2- 172.21.15.84:0/2642956783 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 0x7fb6b40c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 --2- 172.21.15.84:0/2642956783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40b2170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2642956783 >> 172.21.15.84:0/2642956783 conn(0x7fb6b40cc540 msgr2=0x7fb6b40cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.795 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'] 2023-09-10T00:12:16.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-09-10T00:12:16.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2642956783 shutdown_connections 2023-09-10T00:12:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2642956783 wait complete. 2023-09-10T00:12:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 Processor -- start 2023-09-10T00:12:16.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.793+0000 7fb6b93d0640 1 -- start start 2023-09-10T00:12:16.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 0x7fb6b415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6b4157750 0x7fb6b42003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b415a6a0 con 0x7fb6b4157b30 2023-09-10T00:12:16.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4159320 con 0x7fb6b4157750 2023-09-10T00:12:16.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b93d0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b4159600 con 0x7fb6b40ca820 2023-09-10T00:12:16.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45984/0 (socket says 172.21.15.84:45984) 2023-09-10T00:12:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 -- 172.21.15.84:0/2169410098 learned_addr learned my addr 172.21.15.84:0/2169410098 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b3fff640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 0x7fb6b415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b37fe640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6b4157750 0x7fb6b42003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 -- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 msgr2=0x7fb6b415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 0x7fb6b415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 -- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6b4157750 msgr2=0x7fb6b42003b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6b4157750 0x7fb6b42003b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 -- 172.21.15.84:0/2169410098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80094a0 con 0x7fb6b4157b30 2023-09-10T00:12:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7fb6b8bcf640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d950 tx=0x7fb6a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:16.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.797+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f5c540050d0 con 0x7f5c7815b370 2023-09-10T00:12:16.811 DEBUG:tasks.ceph:set 21 configs 2023-09-10T00:12:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.805+0000 7f5c6dffb640 1 -- 172.21.15.84:0/249170657 <== mon.0 v2:172.21.15.84:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v8)=0 v8) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5c6802a0c0 con 0x7f5c7815b370 2023-09-10T00:12:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.805+0000 7fb8c3fff640 1 -- 172.21.15.84:0/42836279 <== mon.0 v2:172.21.15.84:3300/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fb8d001d770 con 0x7fb8dc1599b0 2023-09-10T00:12:16.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.805+0000 7f5c6dffb640 1 -- 172.21.15.84:0/249170657 <== mon.0 v2:172.21.15.84:3300/0 11 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f5c68025ac0 con 0x7f5c7815b370 2023-09-10T00:12:16.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.805+0000 7f19c37fe640 1 -- 172.21.15.84:0/2805552416 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f19bc017840 con 0x7f19cc0ca7f0 2023-09-10T00:12:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4009c30 con 0x7fb6b4157b30 2023-09-10T00:12:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) v1 -- 0x7fb8b40052e0 con 0x7fb8dc1599b0 2023-09-10T00:12:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c7815b370 msgr2=0x7f5c781fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7f5c7f665640 1 --2- 172.21.15.84:0/249170657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c7815b370 0x7f5c781fd4e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800f770 tx=0x7f5c6800fc30 comp rx=0 tx=0).stop 2023-09-10T00:12:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2169410098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b41598e0 con 0x7fb6b4157b30 2023-09-10T00:12:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.809+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2169410098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b4159ea0 con 0x7fb6b4157b30 2023-09-10T00:12:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(3 keys) v1 ==== 79+0+0 (secure 0 0 0) 0x7fb6a4009db0 con 0x7fb6b4157b30 2023-09-10T00:12:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4004280 con 0x7fb6b4157b30 2023-09-10T00:12:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fb6a4003650 con 0x7fb6b4157b30 2023-09-10T00:12:16.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 5 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb6a4003ba0 con 0x7fb6b4157b30 2023-09-10T00:12:16.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 6 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb6a4010ba0 con 0x7fb6b4157b30 2023-09-10T00:12:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 shutdown_connections 2023-09-10T00:12:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 --2- 172.21.15.84:0/249170657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c7815b7f0 0x7f5c781fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.824 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 --2- 172.21.15.84:0/249170657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c7815b370 0x7f5c781fd4e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 --2- 172.21.15.84:0/249170657 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c64005190 0x7f5c781fa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 >> 172.21.15.84:0/249170657 conn(0x7f5c780af230 msgr2=0x7f5c780ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 shutdown_connections 2023-09-10T00:12:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7f5c7f665640 1 -- 172.21.15.84:0/249170657 wait complete. 2023-09-10T00:12:16.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.813+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2169410098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690005260 con 0x7fb6b4157b30 2023-09-10T00:12:16.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.817+0000 7f19c37fe640 1 -- 172.21.15.84:0/2805552416 <== mon.0 v2:172.21.15.84:3300/0 9 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19bc017a90 con 0x7f19cc0ca7f0 2023-09-10T00:12:16.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.821+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 7 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb6a4003e50 con 0x7fb6b4157b30 2023-09-10T00:12:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.821+0000 7fb8c3fff640 1 -- 172.21.15.84:0/42836279 <== mon.0 v2:172.21.15.84:3300/0 11 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v9)=0 v9) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb8d002b030 con 0x7fb8dc1599b0 2023-09-10T00:12:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.821+0000 7fb8c3fff640 1 -- 172.21.15.84:0/42836279 <== mon.0 v2:172.21.15.84:3300/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8d001da80 con 0x7fb8dc1599b0 2023-09-10T00:12:16.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.821+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb6a4020060 con 0x7fb6b4157b30 2023-09-10T00:12:16.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc1599b0 msgr2=0x7fb8dc0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 --2- 172.21.15.84:0/42836279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc1599b0 0x7fb8dc0c45d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0003e20 tx=0x7fb8d0011730 comp rx=0 tx=0).stop 2023-09-10T00:12:16.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 shutdown_connections 2023-09-10T00:12:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 --2- 172.21.15.84:0/42836279 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb8dc159e30 0x7fb8dc0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 --2- 172.21.15.84:0/42836279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8dc1599b0 0x7fb8dc0c45d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 --2- 172.21.15.84:0/42836279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8c40052b0 0x7fb8dc157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 >> 172.21.15.84:0/42836279 conn(0x7fb8dc0cb350 msgr2=0x7fb8dc0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 shutdown_connections 2023-09-10T00:12:16.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.841+0000 7fb8e1b43640 1 -- 172.21.15.84:0/42836279 wait complete. 2023-09-10T00:12:16.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.901+0000 7f3497fff640 1 -- 172.21.15.84:0/727048697 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 msgr2=0x7f349806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.901+0000 7f3497fff640 1 --2- 172.21.15.84:0/727048697 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f349806a220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3488009870 tx=0x7f348801c580 comp rx=0 tx=0).stop 2023-09-10T00:12:16.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- 172.21.15.84:0/727048697 shutdown_connections 2023-09-10T00:12:16.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 --2- 172.21.15.84:0/727048697 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f349806a220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- 172.21.15.84:0/727048697 >> 172.21.15.84:0/727048697 conn(0x7f34980cc540 msgr2=0x7f34980cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- 172.21.15.84:0/727048697 shutdown_connections 2023-09-10T00:12:16.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- 172.21.15.84:0/727048697 wait complete. 2023-09-10T00:12:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 Processor -- start 2023-09-10T00:12:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- start start 2023-09-10T00:12:16.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f34981f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34981f1f60 0x7f3498158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349815b780 con 0x7f34980ca110 2023-09-10T00:12:16.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349814b260 con 0x7f34981f1f60 2023-09-10T00:12:16.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f34967fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f3497fff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34981f2410 con 0x7f3498069e40 2023-09-10T00:12:16.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f34967fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45988/0 (socket says 172.21.15.84:45988) 2023-09-10T00:12:16.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.913+0000 7f34967fc640 1 -- 172.21.15.84:0/1318735908 learned_addr learned my addr 172.21.15.84:0/1318735908 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:16.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f3496ffd640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f34981f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34977fe640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34981f1f60 0x7f3498158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 -- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 msgr2=0x7f34981f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f34981f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 -- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34981f1f60 msgr2=0x7f3498158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34981f1f60 0x7f3498158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 -- 172.21.15.84:0/1318735908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880094a0 con 0x7f34980ca110 2023-09-10T00:12:16.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.917+0000 7f34967fc640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f348c009eb0 tx=0x7f348c00c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:16.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c014420 con 0x7f34980ca110 2023-09-10T00:12:16.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f348c014690 con 0x7f34980ca110 2023-09-10T00:12:16.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3498158cb0 con 0x7f34980ca110 2023-09-10T00:12:16.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34981f5390 con 0x7f34980ca110 2023-09-10T00:12:16.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c014aa0 con 0x7f34980ca110 2023-09-10T00:12:16.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f348c01d400 con 0x7f34980ca110 2023-09-10T00:12:16.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.929+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f348c01c4a0 con 0x7f34980ca110 2023-09-10T00:12:16.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.941+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3478005260 con 0x7f34980ca110 2023-09-10T00:12:16.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.945+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f348c03cb20 con 0x7f34980ca110 2023-09-10T00:12:16.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- 172.21.15.84:0/3290227857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 msgr2=0x7f50c816b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 --2- 172.21.15.84:0/3290227857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c816b4c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f50b8005c60 tx=0x7f50b801d9e0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- 172.21.15.84:0/3290227857 shutdown_connections 2023-09-10T00:12:16.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 --2- 172.21.15.84:0/3290227857 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 0x7f50c80cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 --2- 172.21.15.84:0/3290227857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c816b4c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- 172.21.15.84:0/3290227857 >> 172.21.15.84:0/3290227857 conn(0x7f50c80cc540 msgr2=0x7f50c80cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- 172.21.15.84:0/3290227857 shutdown_connections 2023-09-10T00:12:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 -- 172.21.15.84:0/3252820265 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8158880 msgr2=0x7f6ff806c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 --2- 172.21.15.84:0/3252820265 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8158880 0x7f6ff806c870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009c80 tx=0x7f6ff001cd30 comp rx=0 tx=0).stop 2023-09-10T00:12:16.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 -- 172.21.15.84:0/3252820265 shutdown_connections 2023-09-10T00:12:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 --2- 172.21.15.84:0/3252820265 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8158880 0x7f6ff806c870 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 --2- 172.21.15.84:0/3252820265 >> v2:172.21.15.84:3300/0 conn(0x7f6ff8151f70 0x7f6ff806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f6fff013640 1 -- 172.21.15.84:0/3252820265 >> 172.21.15.84:0/3252820265 conn(0x7f6ff80cc650 msgr2=0x7f6ff80cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- 172.21.15.84:0/3290227857 wait complete. 2023-09-10T00:12:16.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 Processor -- start 2023-09-10T00:12:16.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 -- start start 2023-09-10T00:12:16.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.969+0000 7f50cd561640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 0x7f50c80c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46008/0 (socket says 172.21.15.84:46008) 2023-09-10T00:12:16.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 -- 172.21.15.84:0/1442894631 learned_addr learned my addr 172.21.15.84:0/1442894631 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:16.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8174800 0x7f50c8174cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81751f0 con 0x7f50c816ac30 2023-09-10T00:12:16.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8175ac0 con 0x7f50c8174800 2023-09-10T00:12:16.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c80af300 con 0x7f50c816b010 2023-09-10T00:12:16.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c77fe640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 0x7f50c80c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50ccd60640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8174800 0x7f50c8174cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 -- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 msgr2=0x7f50c80c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 0x7f50c80c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 -- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8174800 msgr2=0x7f50c8174cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8174800 0x7f50c8174cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009560 con 0x7f50c816ac30 2023-09-10T00:12:16.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c7fff640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50b801a5f0 tx=0x7f50b800d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:16.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003800 con 0x7f50c816ac30 2023-09-10T00:12:16.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c80af550 con 0x7f50c816ac30 2023-09-10T00:12:16.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c80afb10 con 0x7f50c816ac30 2023-09-10T00:12:16.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50b8003a50 con 0x7f50c816ac30 2023-09-10T00:12:16.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003e60 con 0x7f50c816ac30 2023-09-10T00:12:16.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f50b80b5070 con 0x7f50c816ac30 2023-09-10T00:12:16.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.973+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f50b80a6b60 con 0x7f50c816ac30 2023-09-10T00:12:16.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- 172.21.15.84:0/3252820265 shutdown_connections 2023-09-10T00:12:16.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- 172.21.15.84:0/3252820265 wait complete. 2023-09-10T00:12:16.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 Processor -- start 2023-09-10T00:12:16.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- start start 2023-09-10T00:12:16.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ff806ffa0 0x7f6ff8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8151f70 0x7f6ff815a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:16.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff815dd10 con 0x7f6ff8158880 2023-09-10T00:12:16.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8153050 con 0x7f6ff806ffa0 2023-09-10T00:12:16.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6fff013640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff81532d0 con 0x7f6ff8151f70 2023-09-10T00:12:16.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ffd5b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ffd5b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46032/0 (socket says 172.21.15.84:46032) 2023-09-10T00:12:16.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ffd5b0640 1 -- 172.21.15.84:0/258196909 learned_addr learned my addr 172.21.15.84:0/258196909 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:16.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a8005260 con 0x7f50c816ac30 2023-09-10T00:12:16.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ff7fff640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8151f70 0x7f6ff815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ffcdaf640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ff806ffa0 0x7f6ff8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:16.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.977+0000 7f6ffd5b0640 1 -- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8151f70 msgr2=0x7f6ff815a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.981+0000 7f6ffd5b0640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8151f70 0x7f6ff815a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.981+0000 7f6ffd5b0640 1 -- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ff806ffa0 msgr2=0x7f6ff8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.981+0000 7f6ffd5b0640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ff806ffa0 0x7f6ff8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.981+0000 7f6ffd5b0640 1 -- 172.21.15.84:0/258196909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00098e0 con 0x7f6ff8158880 2023-09-10T00:12:16.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.981+0000 7f6ffd5b0640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ff001b3e0 tx=0x7f6ff0003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:16.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.985+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f50b80b3070 con 0x7f50c816ac30 2023-09-10T00:12:16.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.985+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) v1 -- 0x7f19a40052e0 con 0x7f19cc0ca7f0 2023-09-10T00:12:16.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00a5bc0 con 0x7f6ff8158880 2023-09-10T00:12:16.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6fff013640 1 -- 172.21.15.84:0/258196909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff81535b0 con 0x7f6ff8158880 2023-09-10T00:12:16.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ff00a5e10 con 0x7f6ff8158880 2023-09-10T00:12:16.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00adb70 con 0x7f6ff8158880 2023-09-10T00:12:16.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 -- 172.21.15.84:0/3955749075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd14157810 msgr2=0x7fdd1406d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 --2- 172.21.15.84:0/3955749075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd14157810 0x7fdd1406d500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd140cb060 tx=0x7fdd0801c8c0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6fff013640 1 -- 172.21.15.84:0/258196909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff8153b70 con 0x7f6ff8158880 2023-09-10T00:12:16.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 -- 172.21.15.84:0/3955749075 shutdown_connections 2023-09-10T00:12:16.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 --2- 172.21.15.84:0/3955749075 >> v2:172.21.15.100:3300/0 conn(0x7fdd140c8110 0x7fdd140cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 --2- 172.21.15.84:0/3955749075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd140ccea0 0x7fdd140c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 --2- 172.21.15.84:0/3955749075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd14157810 0x7fdd1406d500 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7fdd1996c640 1 -- 172.21.15.84:0/3955749075 >> 172.21.15.84:0/3955749075 conn(0x7fdd140ca000 msgr2=0x7fdd140ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ff00b4040 con 0x7f6ff8158880 2023-09-10T00:12:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.989+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ff00b6770 con 0x7f6ff8158880 2023-09-10T00:12:16.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- 172.21.15.84:0/3955749075 shutdown_connections 2023-09-10T00:12:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- 172.21.15.84:0/3955749075 wait complete. 2023-09-10T00:12:16.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff8153d60 con 0x7f6ff8158880 2023-09-10T00:12:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19c37fe640 1 -- 172.21.15.84:0/2805552416 <== mon.0 v2:172.21.15.84:3300/0 10 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7f19cc14c580 con 0x7f19cc0ca7f0 2023-09-10T00:12:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 Processor -- start 2023-09-10T00:12:16.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- start start 2023-09-10T00:12:16.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19cc0ca7f0 msgr2=0x7f19cc15d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:16.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 --2- 172.21.15.84:0/2805552416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19cc0ca7f0 0x7f19cc15d640 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19bc00b560 tx=0x7f19bc00ba20 comp rx=0 tx=0).stop 2023-09-10T00:12:16.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 shutdown_connections 2023-09-10T00:12:16.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 --2- 172.21.15.84:0/2805552416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f19cc0ca7f0 0x7f19cc15d640 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:16.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 --2- 172.21.15.84:0/2805552416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19cc0700a0 0x7f19cc1501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 --2- 172.21.15.84:0/2805552416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19cc06fcc0 0x7f19cc138990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 >> 172.21.15.84:0/2805552416 conn(0x7f19cc0cc650 msgr2=0x7f19cc15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd140c8110 0x7fdd140b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd140ccea0 0x7fdd140c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14155570 con 0x7fdd140ccea0 2023-09-10T00:12:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140b12d0 con 0x7fdd140c8110 2023-09-10T00:12:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd1996c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140c3840 con 0x7fdd14157810 2023-09-10T00:12:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd137fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:34508/0 (socket says 172.21.15.84:34508) 2023-09-10T00:12:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.993+0000 7fdd137fe640 1 -- 172.21.15.84:0/2204222572 learned_addr learned my addr 172.21.15.84:0/2204222572 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7fdd137fe640 1 -- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd140c8110 msgr2=0x7fdd140b0d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T00:12:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7fdd137fe640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd140c8110 0x7fdd140b0d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7fdd137fe640 1 -- 172.21.15.84:0/2204222572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd140ccea0 msgr2=0x7fdd140c6820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T00:12:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7fdd137fe640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd140ccea0 0x7fdd140c6820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7fdd137fe640 1 -- 172.21.15.84:0/2204222572 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd08009560 con 0x7fdd14157810 2023-09-10T00:12:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 shutdown_connections 2023-09-10T00:12:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6ff8153d60 con 0x7f6ff8158880 2023-09-10T00:12:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:16.997+0000 7f19d1242640 1 -- 172.21.15.84:0/2805552416 wait complete. 2023-09-10T00:12:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdd137fe640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd040099a0 tx=0x7fdd04009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04012070 con 0x7fdd14157810 2023-09-10T00:12:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdd0400d670 con 0x7fdd14157810 2023-09-10T00:12:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400cc20 con 0x7fdd14157810 2023-09-10T00:12:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdd1996c640 1 -- 172.21.15.84:0/2204222572 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd140affd0 con 0x7fdd14157810 2023-09-10T00:12:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdd1996c640 1 -- 172.21.15.84:0/2204222572 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd140b0590 con 0x7fdd14157810 2023-09-10T00:12:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd04005320 con 0x7fdd14157810 2023-09-10T00:12:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.001+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdd04016410 con 0x7fdd14157810 2023-09-10T00:12:17.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.005+0000 7fdd1996c640 1 -- 172.21.15.84:0/2204222572 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf4005260 con 0x7fdd14157810 2023-09-10T00:12:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.009+0000 7f981fb4d640 1 -- 172.21.15.84:0/2496115078 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98180c7130 msgr2=0x7f98180695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.009+0000 7f981fb4d640 1 --2- 172.21.15.84:0/2496115078 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98180c7130 0x7f98180695b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9808009900 tx=0x7f980801c7f0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.013+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fdd0400cd80 con 0x7fdd14157810 2023-09-10T00:12:17.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.017+0000 7fb6b93d0640 1 -- 172.21.15.84:0/2169410098 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) v1 -- 0x7fb6900055b0 con 0x7fb6b4157b30 2023-09-10T00:12:17.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.017+0000 7f981fb4d640 1 -- 172.21.15.84:0/2496115078 shutdown_connections 2023-09-10T00:12:17.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.017+0000 7f981fb4d640 1 --2- 172.21.15.84:0/2496115078 >> v2:172.21.15.84:3300/0 conn(0x7f981815e700 0x7f981815b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.017+0000 7f981fb4d640 1 --2- 172.21.15.84:0/2496115078 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98180c7130 0x7f98180695b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.017+0000 7f981fb4d640 1 -- 172.21.15.84:0/2496115078 >> 172.21.15.84:0/2496115078 conn(0x7f98180cc4e0 msgr2=0x7f98180cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.021+0000 7f981fb4d640 1 -- 172.21.15.84:0/2496115078 shutdown_connections 2023-09-10T00:12:17.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.021+0000 7fb6b0ff9640 1 -- 172.21.15.84:0/2169410098 <== mon.0 v2:172.21.15.84:3300/0 9 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7fb6a4017070 con 0x7fb6b4157b30 2023-09-10T00:12:17.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.021+0000 7f981fb4d640 1 -- 172.21.15.84:0/2496115078 wait complete. 2023-09-10T00:12:17.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 Processor -- start 2023-09-10T00:12:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 -- start start 2023-09-10T00:12:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 0x7f981814d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f981815e700 0x7f98180ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981814ecf0 con 0x7f9818069af0 2023-09-10T00:12:17.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98181524b0 con 0x7f98180c7130 2023-09-10T00:12:17.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981fb4d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981814ddd0 con 0x7f981815e700 2023-09-10T00:12:17.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46056/0 (socket says 172.21.15.84:46056) 2023-09-10T00:12:17.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 -- 172.21.15.84:0/985336894 learned_addr learned my addr 172.21.15.84:0/985336894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981e0ea640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f981815e700 0x7f98180ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d0e8640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 0x7f981814d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 -- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f981815e700 msgr2=0x7f98180ad100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f981815e700 0x7f98180ad100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 -- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 msgr2=0x7f981814d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 0x7f981814d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 -- 172.21.15.84:0/985336894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009560 con 0x7f9818069af0 2023-09-10T00:12:17.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d0e8640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 0x7f981814d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:12:17.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.025+0000 7f981d8e9640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f980801aea0 tx=0x7f98080040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080044c0 con 0x7f9818069af0 2023-09-10T00:12:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f981fb4d640 1 -- 172.21.15.84:0/985336894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981814e070 con 0x7f9818069af0 2023-09-10T00:12:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f981fb4d640 1 -- 172.21.15.84:0/985336894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981814e630 con 0x7f9818069af0 2023-09-10T00:12:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9808005110 con 0x7f9818069af0 2023-09-10T00:12:17.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808005500 con 0x7f9818069af0 2023-09-10T00:12:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f98080b4040 con 0x7f9818069af0 2023-09-10T00:12:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9808003bc0 con 0x7f9818069af0 2023-09-10T00:12:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.029+0000 7f981fb4d640 1 -- 172.21.15.84:0/985336894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9800005260 con 0x7f9818069af0 2023-09-10T00:12:17.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.033+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f98080b2070 con 0x7f9818069af0 2023-09-10T00:12:17.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.037+0000 7eff0f9b0640 1 -- 172.21.15.84:0/21570272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080ae620 msgr2=0x7eff0806fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.037+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/21570272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080ae620 0x7eff0806fa00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff00009bc0 tx=0x7eff0001cb10 comp rx=0 tx=0).stop 2023-09-10T00:12:17.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- 172.21.15.84:0/21570272 shutdown_connections 2023-09-10T00:12:17.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/21570272 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff080ae620 0x7eff0806fa00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- 172.21.15.84:0/21570272 >> 172.21.15.84:0/21570272 conn(0x7eff080c8fe0 msgr2=0x7eff080c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- 172.21.15.84:0/21570272 shutdown_connections 2023-09-10T00:12:17.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- 172.21.15.84:0/21570272 wait complete. 2023-09-10T00:12:17.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 Processor -- start 2023-09-10T00:12:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- start start 2023-09-10T00:12:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 0x7eff080a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff080ae620 0x7eff080b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080b0b50 con 0x7eff08158920 2023-09-10T00:12:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080b0e30 con 0x7eff080ae240 2023-09-10T00:12:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.041+0000 7eff0f9b0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff080b1110 con 0x7eff080ae620 2023-09-10T00:12:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0cf4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff080ae620 0x7eff080b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0d74c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 0x7eff080a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46070/0 (socket says 172.21.15.84:46070) 2023-09-10T00:12:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0d74c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 0x7eff080a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:47606/0 (socket says 172.21.15.84:47606) 2023-09-10T00:12:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 -- 172.21.15.84:0/1173316130 learned_addr learned my addr 172.21.15.84:0/1173316130 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 -- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff080ae620 msgr2=0x7eff080b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff080ae620 0x7eff080b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 -- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 msgr2=0x7eff080a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 0x7eff080a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 -- 172.21.15.84:0/1173316130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009820 con 0x7eff08158920 2023-09-10T00:12:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.045+0000 7eff0df4d640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff00019720 tx=0x7eff00003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- 172.21.15.84:0/3896201464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406a2e0 msgr2=0x7f36540cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3896201464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406a2e0 0x7f36540cb370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3654070e40 tx=0x7f364c01cd10 comp rx=0 tx=0).stop 2023-09-10T00:12:17.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- 172.21.15.84:0/3896201464 shutdown_connections 2023-09-10T00:12:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00004340 con 0x7eff08158920 2023-09-10T00:12:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3896201464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406a2e0 0x7f36540cb370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3896201464 >> v2:172.21.15.100:3300/0 conn(0x7f365406fa60 0x7f365406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- 172.21.15.84:0/3896201464 >> 172.21.15.84:0/3896201464 conn(0x7f36540cc650 msgr2=0x7f36540cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- 172.21.15.84:0/3896201464 shutdown_connections 2023-09-10T00:12:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- 172.21.15.84:0/3896201464 wait complete. 2023-09-10T00:12:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 Processor -- start 2023-09-10T00:12:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 -- start start 2023-09-10T00:12:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f365406a2e0 0x7f36541693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.049+0000 7f365b7ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f365b7ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3654087690 0x7f365415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f365b7ec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36540c88a0 con 0x7f365406fa60 2023-09-10T00:12:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f365b7ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365416ad60 con 0x7f3654087690 2023-09-10T00:12:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f365b7ec640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3654169ef0 con 0x7f365406a2e0 2023-09-10T00:12:17.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 -- 172.21.15.84:0/2169410098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 msgr2=0x7fb6b40c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400d950 tx=0x7fb6a400de10 comp rx=0 tx=0).stop 2023-09-10T00:12:17.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46076/0 (socket says 172.21.15.84:46076) 2023-09-10T00:12:17.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 -- 172.21.15.84:0/3168002862 learned_addr learned my addr 172.21.15.84:0/3168002862 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 -- 172.21.15.84:0/2169410098 shutdown_connections 2023-09-10T00:12:17.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff080b13f0 con 0x7eff08158920 2023-09-10T00:12:17.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff080a6380 con 0x7eff08158920 2023-09-10T00:12:17.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6b4157b30 0x7fb6b40c3d90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6b4157750 0x7fb6b42003b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 --2- 172.21.15.84:0/2169410098 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6b40ca820 0x7fb6b415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 -- 172.21.15.84:0/2169410098 >> 172.21.15.84:0/2169410098 conn(0x7fb6b40cc540 msgr2=0x7fb6b40cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3659588640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f365406a2e0 0x7f36541693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3659d89640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3654087690 0x7f365415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 -- 172.21.15.84:0/2169410098 shutdown_connections 2023-09-10T00:12:17.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7fb6a27fc640 1 -- 172.21.15.84:0/2169410098 wait complete. 2023-09-10T00:12:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 -- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f365406a2e0 msgr2=0x7f36541693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f365406a2e0 0x7f36541693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 -- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3654087690 msgr2=0x7f365415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3654087690 0x7f365415c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 -- 172.21.15.84:0/3168002862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0098e0 con 0x7f365406fa60 2023-09-10T00:12:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7eff00004590 con 0x7eff08158920 2023-09-10T00:12:17.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7f3658d87640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f364c009bd0 tx=0x7f364c0aebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff000ad440 con 0x7eff08158920 2023-09-10T00:12:17.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff000b4040 con 0x7eff08158920 2023-09-10T00:12:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.053+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff000c0540 con 0x7eff08158920 2023-09-10T00:12:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.057+0000 7feee65fb640 1 -- 172.21.15.84:0/2175985555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 msgr2=0x7feee0158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.057+0000 7feee65fb640 1 --2- 172.21.15.84:0/2175985555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee0158170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feed4009900 tx=0x7feed401c750 comp rx=0 tx=0).stop 2023-09-10T00:12:17.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8005260 con 0x7eff08158920 2023-09-10T00:12:17.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7feee65fb640 1 -- 172.21.15.84:0/2175985555 shutdown_connections 2023-09-10T00:12:17.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7feee65fb640 1 --2- 172.21.15.84:0/2175985555 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee0158170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7feee65fb640 1 -- 172.21.15.84:0/2175985555 >> 172.21.15.84:0/2175985555 conn(0x7feee00cc650 msgr2=0x7feee00cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c003b80 con 0x7f365406fa60 2023-09-10T00:12:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f364c003dd0 con 0x7f365406fa60 2023-09-10T00:12:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3654083480 con 0x7f365406fa60 2023-09-10T00:12:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364c004290 con 0x7f365406fa60 2023-09-10T00:12:17.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3654085ea0 con 0x7f365406fa60 2023-09-10T00:12:17.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.061+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3634005260 con 0x7f365406fa60 2023-09-10T00:12:17.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.065+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7eff000b2070 con 0x7eff08158920 2023-09-10T00:12:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.065+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f364c0b4040 con 0x7f365406fa60 2023-09-10T00:12:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.065+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f364c0c95f0 con 0x7f365406fa60 2023-09-10T00:12:17.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.065+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f364c0b2070 con 0x7f365406fa60 2023-09-10T00:12:17.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.069+0000 7feee65fb640 1 -- 172.21.15.84:0/2175985555 shutdown_connections 2023-09-10T00:12:17.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.069+0000 7feee65fb640 1 -- 172.21.15.84:0/2175985555 wait complete. 2023-09-10T00:12:17.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.069+0000 7feee65fb640 1 Processor -- start 2023-09-10T00:12:17.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.069+0000 7feee65fb640 1 -- start start 2023-09-10T00:12:17.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0151f70 0x7feee00c1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46100/0 (socket says 172.21.15.84:46100) 2023-09-10T00:12:17.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 -- 172.21.15.84:0/2240756092 learned_addr learned my addr 172.21.15.84:0/2240756092 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 0x7feee00c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00c6ab0 con 0x7feee0070170 2023-09-10T00:12:17.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00c6d90 con 0x7feee0151f70 2023-09-10T00:12:17.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee00c7070 con 0x7feee01586b0 2023-09-10T00:12:17.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedf7fe640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0151f70 0x7feee00c1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee4b98640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 0x7feee00c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 -- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 msgr2=0x7feee00c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 0x7feee00c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 -- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0151f70 msgr2=0x7feee00c1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0151f70 0x7feee00c1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4009560 con 0x7feee0070170 2023-09-10T00:12:17.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feee4b98640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 0x7feee00c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:12:17.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.073+0000 7feedffff640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feed800c790 tx=0x7feed800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800cea0 con 0x7feee0070170 2023-09-10T00:12:17.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feed8003ba0 con 0x7feee0070170 2023-09-10T00:12:17.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee00c7350 con 0x7feee0070170 2023-09-10T00:12:17.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800a850 con 0x7feee0070170 2023-09-10T00:12:17.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee00c66d0 con 0x7feee0070170 2023-09-10T00:12:17.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feed800acd0 con 0x7feee0070170 2023-09-10T00:12:17.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.077+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feed80128d0 con 0x7feee0070170 2023-09-10T00:12:17.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.081+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee00713a0 con 0x7feee0070170 2023-09-10T00:12:17.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.085+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7feed80050d0 con 0x7feee0070170 2023-09-10T00:12:17.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.089+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) v1 -- 0x7f34780050d0 con 0x7f34980ca110 2023-09-10T00:12:17.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.089+0000 7fddf373d640 1 -- 172.21.15.84:0/1880706893 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 msgr2=0x7fddec06d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.089+0000 7fddf373d640 1 --2- 172.21.15.84:0/1880706893 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec06d500 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009840 tx=0x7fdddc01c800 comp rx=0 tx=0).stop 2023-09-10T00:12:17.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.093+0000 7f347f7fe640 1 -- 172.21.15.84:0/1318735908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7f348c02b020 con 0x7f34980ca110 2023-09-10T00:12:17.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.093+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 msgr2=0x7f3498147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.093+0000 7f3497fff640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f348c009eb0 tx=0x7f348c00c430 comp rx=0 tx=0).stop 2023-09-10T00:12:17.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 shutdown_connections 2023-09-10T00:12:17.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34981f1f60 0x7f3498158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34980ca110 0x7f3498147650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 -- 172.21.15.84:0/1880706893 shutdown_connections 2023-09-10T00:12:17.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 --2- 172.21.15.84:0/1880706893 >> v2:172.21.15.84:3300/0 conn(0x7fddec0ccea0 0x7fddec0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 --2- 172.21.15.84:0/1880706893 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec06d500 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 -- 172.21.15.84:0/1880706893 >> 172.21.15.84:0/1880706893 conn(0x7fddec0ca000 msgr2=0x7fddec0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 --2- 172.21.15.84:0/1318735908 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3498069e40 0x7f34981f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 -- 172.21.15.84:0/1880706893 shutdown_connections 2023-09-10T00:12:17.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 >> 172.21.15.84:0/1318735908 conn(0x7f34980cc540 msgr2=0x7f3498151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 shutdown_connections 2023-09-10T00:12:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f3497fff640 1 -- 172.21.15.84:0/1318735908 wait complete. 2023-09-10T00:12:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 -- 172.21.15.84:0/2717370246 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc0dfe70 msgr2=0x7f6bbc053c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/2717370246 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc0dfe70 0x7f6bbc053c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009900 tx=0x7f6bb801f070 comp rx=0 tx=0).stop 2023-09-10T00:12:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 -- 172.21.15.84:0/1880706893 wait complete. 2023-09-10T00:12:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 Processor -- start 2023-09-10T00:12:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7fddf373d640 1 -- start start 2023-09-10T00:12:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 -- 172.21.15.84:0/2717370246 shutdown_connections 2023-09-10T00:12:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/2717370246 >> v2:172.21.15.100:3300/0 conn(0x7f6bbc008c20 0x7f6bbc0090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/2717370246 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc0dfe70 0x7f6bbc053c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 -- 172.21.15.84:0/2717370246 >> 172.21.15.84:0/2717370246 conn(0x7f6bbc055c20 msgr2=0x7f6bbc056030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 -- 172.21.15.84:0/2717370246 shutdown_connections 2023-09-10T00:12:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.101+0000 7f6bcad7b640 1 -- 172.21.15.84:0/2717370246 wait complete. 2023-09-10T00:12:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 0x7fddec14f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14d0d0 con 0x7fddec0ccea0 2023-09-10T00:12:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14d3b0 con 0x7fddec157810 2023-09-10T00:12:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf373d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec14d690 con 0x7fddec0c82e0 2023-09-10T00:12:17.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46110/0 (socket says 172.21.15.84:46110) 2023-09-10T00:12:17.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 -- 172.21.15.84:0/705393061 learned_addr learned my addr 172.21.15.84:0/705393061 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf14d9640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 Processor -- start 2023-09-10T00:12:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 -- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 msgr2=0x7fddec14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf1cda640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 0x7fddec14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 -- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 msgr2=0x7fddec14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 0x7fddec14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 -- 172.21.15.84:0/705393061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0094a0 con 0x7fddec0ccea0 2023-09-10T00:12:17.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf1cda640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 0x7fddec14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:17.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7fddf0cd8640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdddc01a430 tx=0x7fdddc005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 -- start start 2023-09-10T00:12:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc054180 0x7f6bbc04fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0dfe70 0x7f6bbc0d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0d81b0 con 0x7f6bbc008c20 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0d8490 con 0x7f6bbc0dfe70 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bcad7b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0d8770 con 0x7f6bbc054180 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46116/0 (socket says 172.21.15.84:46116) 2023-09-10T00:12:17.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 -- 172.21.15.84:0/1979791392 learned_addr learned my addr 172.21.15.84:0/1979791392 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc9318640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0dfe70 0x7f6bbc0d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 -- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc054180 msgr2=0x7f6bbc04fb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-10T00:12:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc054180 0x7f6bbc04fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 -- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0dfe70 msgr2=0x7f6bbc0d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0dfe70 0x7f6bbc0d6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 -- 172.21.15.84:0/1979791392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc404de30 con 0x7f6bbc008c20 2023-09-10T00:12:17.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.105+0000 7f6bc8b17640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bb801d720 tx=0x7f6bb8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc004230 con 0x7fddec0ccea0 2023-09-10T00:12:17.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdddc004480 con 0x7fddec0ccea0 2023-09-10T00:12:17.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec14d970 con 0x7fddec0ccea0 2023-09-10T00:12:17.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdddc004930 con 0x7fddec0ccea0 2023-09-10T00:12:17.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec14ce90 con 0x7fddec0ccea0 2023-09-10T00:12:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80bf070 con 0x7f6bbc008c20 2023-09-10T00:12:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb8009560 con 0x7f6bbc008c20 2023-09-10T00:12:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0d8d30 con 0x7f6bbc008c20 2023-09-10T00:12:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6bb80b1920 con 0x7f6bbc008c20 2023-09-10T00:12:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80b1cf0 con 0x7f6bbc008c20 2023-09-10T00:12:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6bb80b7040 con 0x7f6bbc008c20 2023-09-10T00:12:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.117+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6bb80c4460 con 0x7f6bbc008c20 2023-09-10T00:12:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.125+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdddc0b4040 con 0x7fddec0ccea0 2023-09-10T00:12:17.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.125+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdddc0c0480 con 0x7fddec0ccea0 2023-09-10T00:12:17.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.125+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba4005260 con 0x7f6bbc008c20 2023-09-10T00:12:17.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.129+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec0b1780 con 0x7fddec0ccea0 2023-09-10T00:12:17.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.129+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6bb80b5070 con 0x7f6bbc008c20 2023-09-10T00:12:17.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.133+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f50a8005880 con 0x7f50c816ac30 2023-09-10T00:12:17.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.133+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fddec0b1780 con 0x7fddec0ccea0 2023-09-10T00:12:17.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.137+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) v1 -- 0x7f6ff815dea0 con 0x7f6ff8158880 2023-09-10T00:12:17.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f50c4ff9640 1 -- 172.21.15.84:0/1442894631 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v13)=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f50b80c4950 con 0x7f50c816ac30 2023-09-10T00:12:17.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 msgr2=0x7f50c8086ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 -- 172.21.15.84:0/2682971136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815bd70 msgr2=0x7f65080c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 --2- 172.21.15.84:0/2682971136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815bd70 0x7f65080c6b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f64f8009840 tx=0x7f64f801c720 comp rx=0 tx=0).stop 2023-09-10T00:12:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 -- 172.21.15.84:0/2682971136 shutdown_connections 2023-09-10T00:12:17.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 --2- 172.21.15.84:0/2682971136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815bd70 0x7f65080c6b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 -- 172.21.15.84:0/2682971136 >> 172.21.15.84:0/2682971136 conn(0x7f65080cc4e0 msgr2=0x7f65080cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 -- 172.21.15.84:0/2682971136 shutdown_connections 2023-09-10T00:12:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.145+0000 7f650d266640 1 -- 172.21.15.84:0/2682971136 wait complete. 2023-09-10T00:12:17.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 Processor -- start 2023-09-10T00:12:17.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 -- start start 2023-09-10T00:12:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 0x7f65080c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 0x7f65080c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f650815bd70 0x7f65080c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080c1180 con 0x7f650815b8e0 2023-09-10T00:12:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65082007b0 con 0x7f65080716c0 2023-09-10T00:12:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f650d266640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080c0570 con 0x7f650815bd70 2023-09-10T00:12:17.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f6506ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 0x7f65080c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f6506ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 0x7f65080c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:47668/0 (socket says 172.21.15.84:47668) 2023-09-10T00:12:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f6506ffd640 1 -- 172.21.15.84:0/1363293536 learned_addr learned my addr 172.21.15.84:0/1363293536 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f50cd561640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50b801a5f0 tx=0x7f50b800d2e0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f6ff57fa640 1 -- 172.21.15.84:0/258196909 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v14)=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ff815dea0 con 0x7f6ff8158880 2023-09-10T00:12:17.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f65067fc640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 0x7f65080c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.149+0000 7f65077fe640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f650815bd70 0x7f65080c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 -- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f650815bd70 msgr2=0x7f65080c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f650815bd70 0x7f65080c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 -- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 msgr2=0x7f65080c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 0x7f65080c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 -- 172.21.15.84:0/1363293536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80094a0 con 0x7f650815b8e0 2023-09-10T00:12:17.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f65067fc640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 0x7f65080c7c50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6500004a40 tx=0x7f650000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000a840 con 0x7f650815b8e0 2023-09-10T00:12:17.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65080c0850 con 0x7f650815b8e0 2023-09-10T00:12:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65080c0e10 con 0x7f650815b8e0 2023-09-10T00:12:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f650000aa90 con 0x7f650815b8e0 2023-09-10T00:12:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65080c1330 con 0x7f650815b8e0 2023-09-10T00:12:17.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000ae80 con 0x7f650815b8e0 2023-09-10T00:12:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6500012720 con 0x7f650815b8e0 2023-09-10T00:12:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f650001ba30 con 0x7f650815b8e0 2023-09-10T00:12:17.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 shutdown_connections 2023-09-10T00:12:17.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7fdd1996c640 1 -- 172.21.15.84:0/2204222572 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7fdcf40050d0 con 0x7fdd14157810 2023-09-10T00:12:17.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f50cd561640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8174800 0x7f50c8174cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f50cd561640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50c816b010 0x7f50c80c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f50cd561640 1 --2- 172.21.15.84:0/1442894631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50c816ac30 0x7f50c8086ca0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.153+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 >> 172.21.15.84:0/1442894631 conn(0x7f50c80cc540 msgr2=0x7f50c80ad300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.157+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 shutdown_connections 2023-09-10T00:12:17.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.157+0000 7f50cd561640 1 -- 172.21.15.84:0/1442894631 wait complete. 2023-09-10T00:12:17.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.157+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f650003ab20 con 0x7f650815b8e0 2023-09-10T00:12:17.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.157+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 msgr2=0x7f6ff815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.157+0000 7f6fdeffd640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ff001b3e0 tx=0x7f6ff0003d10 comp rx=0 tx=0).stop 2023-09-10T00:12:17.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 shutdown_connections 2023-09-10T00:12:17.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ff8158880 0x7f6ff815ac50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6ff8151f70 0x7f6ff815a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 --2- 172.21.15.84:0/258196909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ff806ffa0 0x7f6ff8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 >> 172.21.15.84:0/258196909 conn(0x7f6ff80cc650 msgr2=0x7f6ff8161ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7fdcfbfff640 1 -- 172.21.15.84:0/2204222572 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v15)=0 v15) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdd040047b0 con 0x7fdd14157810 2023-09-10T00:12:17.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 shutdown_connections 2023-09-10T00:12:17.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.169+0000 7f6fdeffd640 1 -- 172.21.15.84:0/258196909 wait complete. 2023-09-10T00:12:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 -- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 msgr2=0x7fdd140c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7f981fb4d640 1 -- 172.21.15.84:0/985336894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f98000057e0 con 0x7f9818069af0 2023-09-10T00:12:17.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd040099a0 tx=0x7fdd04009e60 comp rx=0 tx=0).stop 2023-09-10T00:12:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 -- 172.21.15.84:0/2204222572 shutdown_connections 2023-09-10T00:12:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd14157810 0x7fdd140c6d60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd140ccea0 0x7fdd140c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 --2- 172.21.15.84:0/2204222572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd140c8110 0x7fdd140b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 -- 172.21.15.84:0/2204222572 >> 172.21.15.84:0/2204222572 conn(0x7fdd140ca000 msgr2=0x7fdd1415ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 -- 172.21.15.84:0/2204222572 shutdown_connections 2023-09-10T00:12:17.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.185+0000 7fdcf9ffb640 1 -- 172.21.15.84:0/2204222572 wait complete. 2023-09-10T00:12:17.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.193+0000 7f980e7fc640 1 -- 172.21.15.84:0/985336894 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9808003dd0 con 0x7f9818069af0 2023-09-10T00:12:17.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7feee0073400 con 0x7feee0070170 2023-09-10T00:12:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 -- 172.21.15.84:0/985336894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 msgr2=0x7f9818151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f980801aea0 tx=0x7f98080040d0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 -- 172.21.15.84:0/985336894 shutdown_connections 2023-09-10T00:12:17.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f981815e700 0x7f98180ad100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98180c7130 0x7f981814d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 --2- 172.21.15.84:0/985336894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9818069af0 0x7f9818151f70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 -- 172.21.15.84:0/985336894 >> 172.21.15.84:0/985336894 conn(0x7f98180cc4e0 msgr2=0x7f9818155cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 -- 172.21.15.84:0/985336894 shutdown_connections 2023-09-10T00:12:17.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.197+0000 7f97fbfff640 1 -- 172.21.15.84:0/985336894 wait complete. 2023-09-10T00:12:17.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.201+0000 7feedcff9640 1 -- 172.21.15.84:0/2240756092 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v17)=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7feed8012ae0 con 0x7feee0070170 2023-09-10T00:12:17.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.205+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7f36340050d0 con 0x7f365406fa60 2023-09-10T00:12:17.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.205+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7efee8005510 con 0x7eff08158920 2023-09-10T00:12:17.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.209+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 msgr2=0x7feee00af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.209+0000 7feee65fb640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feed800c790 tx=0x7feed800cc50 comp rx=0 tx=0).stop 2023-09-10T00:12:17.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 shutdown_connections 2023-09-10T00:12:17.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee01586b0 0x7feee00c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee0151f70 0x7feee00c1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 --2- 172.21.15.84:0/2240756092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feee0070170 0x7feee00af640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 >> 172.21.15.84:0/2240756092 conn(0x7feee00cc650 msgr2=0x7feee00cca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f3649ffb640 1 -- 172.21.15.84:0/3168002862 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) v1 ==== 119+0+0 (secure 0 0 0) 0x7f364c0046f0 con 0x7f365406fa60 2023-09-10T00:12:17.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 shutdown_connections 2023-09-10T00:12:17.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7feee65fb640 1 -- 172.21.15.84:0/2240756092 wait complete. 2023-09-10T00:12:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 msgr2=0x7f3654169910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f364c009bd0 tx=0x7f364c0aebe0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 shutdown_connections 2023-09-10T00:12:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3654087690 0x7f365415c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f365406fa60 0x7f3654169910 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 --2- 172.21.15.84:0/3168002862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f365406a2e0 0x7f36541693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 >> 172.21.15.84:0/3168002862 conn(0x7f36540cc650 msgr2=0x7f36540ac300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 shutdown_connections 2023-09-10T00:12:17.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.213+0000 7f365b7ec640 1 -- 172.21.15.84:0/3168002862 wait complete. 2023-09-10T00:12:17.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.221+0000 7efefdffb640 1 -- 172.21.15.84:0/1173316130 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v19)=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7eff000ada50 con 0x7eff08158920 2023-09-10T00:12:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 msgr2=0x7eff080abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff00019720 tx=0x7eff00003f60 comp rx=0 tx=0).stop 2023-09-10T00:12:17.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 shutdown_connections 2023-09-10T00:12:17.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff08158920 0x7eff080abd00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff080ae620 0x7eff080b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 --2- 172.21.15.84:0/1173316130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff080ae240 0x7eff080a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 >> 172.21.15.84:0/1173316130 conn(0x7eff080c8fe0 msgr2=0x7eff080acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 shutdown_connections 2023-09-10T00:12:17.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.225+0000 7eff0f9b0640 1 -- 172.21.15.84:0/1173316130 wait complete. 2023-09-10T00:12:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.229+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f6ba40050d0 con 0x7f6bbc008c20 2023-09-10T00:12:17.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bc17fa640 1 -- 172.21.15.84:0/1979791392 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6bb8003a40 con 0x7f6bbc008c20 2023-09-10T00:12:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 msgr2=0x7f6bbc0d9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6bb801d720 tx=0x7f6bb8005770 comp rx=0 tx=0).stop 2023-09-10T00:12:17.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 shutdown_connections 2023-09-10T00:12:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bbc0dfe70 0x7f6bbc0d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6bbc054180 0x7f6bbc04fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 --2- 172.21.15.84:0/1979791392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bbc008c20 0x7f6bbc0d9b40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 >> 172.21.15.84:0/1979791392 conn(0x7f6bbc055c20 msgr2=0x7f6bbc008240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 shutdown_connections 2023-09-10T00:12:17.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.233+0000 7f6bcad7b640 1 -- 172.21.15.84:0/1979791392 wait complete. 2023-09-10T00:12:17.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.241+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fddec14d7d0 con 0x7fddec0ccea0 2023-09-10T00:12:17.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.245+0000 7fdde1ffb640 1 -- 172.21.15.84:0/705393061 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) v1 ==== 121+0+0 (secure 0 0 0) 0x7fddec14d7d0 con 0x7fddec0ccea0 2023-09-10T00:12:17.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 msgr2=0x7fddec14beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdddc01a430 tx=0x7fdddc005780 comp rx=0 tx=0).stop 2023-09-10T00:12:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 shutdown_connections 2023-09-10T00:12:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fddec157810 0x7fddec14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddec0ccea0 0x7fddec14beb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 --2- 172.21.15.84:0/705393061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fddec0c82e0 0x7fddec14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 >> 172.21.15.84:0/705393061 conn(0x7fddec0ca000 msgr2=0x7fddec159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 shutdown_connections 2023-09-10T00:12:17.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.249+0000 7fddf373d640 1 -- 172.21.15.84:0/705393061 wait complete. 2023-09-10T00:12:17.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.257+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f6508073390 con 0x7f650815b8e0 2023-09-10T00:12:17.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f64ef7fe640 1 -- 172.21.15.84:0/1363293536 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6500029020 con 0x7f650815b8e0 2023-09-10T00:12:17.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 msgr2=0x7f65080c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 0x7f65080c7c50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6500004a40 tx=0x7f650000cb80 comp rx=0 tx=0).stop 2023-09-10T00:12:17.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 shutdown_connections 2023-09-10T00:12:17.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f650815bd70 0x7f65080c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f650815b8e0 0x7f65080c7c50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 --2- 172.21.15.84:0/1363293536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65080716c0 0x7f65080c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 >> 172.21.15.84:0/1363293536 conn(0x7f65080cc4e0 msgr2=0x7f6508156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 shutdown_connections 2023-09-10T00:12:17.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.261+0000 7f650d266640 1 -- 172.21.15.84:0/1363293536 wait complete. 2023-09-10T00:12:17.280 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-10T00:12:17.281 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-10T00:12:17.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-10T00:12:17.323 INFO:tasks.ceph.mgr.y:Started 2023-09-10T00:12:17.323 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-10T00:12:17.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-10T00:12:17.326 INFO:tasks.ceph.mgr.x:Started 2023-09-10T00:12:17.327 INFO:tasks.ceph:Setting crush tunables to default 2023-09-10T00:12:17.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2023-09-10T00:12:17.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/1382329571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640cd2e0 msgr2=0x7f7e6406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/1382329571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640cd2e0 0x7f7e6406ac10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e6406e790 tx=0x7f7e5c01cb60 comp rx=0 tx=0).stop 2023-09-10T00:12:17.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/1382329571 shutdown_connections 2023-09-10T00:12:17.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/1382329571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640cd2e0 0x7f7e6406ac10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/1382329571 >> v2:172.21.15.100:3300/0 conn(0x7f7e64158c60 0x7f7e640b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/1382329571 >> 172.21.15.84:0/1382329571 conn(0x7f7e640af230 msgr2=0x7f7e640af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/1382329571 shutdown_connections 2023-09-10T00:12:17.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/1382329571 wait complete. 2023-09-10T00:12:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 Processor -- start 2023-09-10T00:12:17.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- start start 2023-09-10T00:12:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e640b0db0 0x7f7e64149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640cd2e0 0x7f7e64154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64159a50 con 0x7f7e64158c60 2023-09-10T00:12:17.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64155270 con 0x7f7e640b0db0 2023-09-10T00:12:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e6a1d2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64159400 con 0x7f7e640cd2e0 2023-09-10T00:12:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.448 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46160/0 (socket says 172.21.15.84:46160) 2023-09-10T00:12:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.437+0000 7f7e63fff640 1 -- 172.21.15.84:0/2832796884 learned_addr learned my addr 172.21.15.84:0/2832796884 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e62ffd640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640cd2e0 0x7f7e64154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e637fe640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e640b0db0 0x7f7e64149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 -- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640cd2e0 msgr2=0x7f7e64154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640cd2e0 0x7f7e64154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 -- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e640b0db0 msgr2=0x7f7e64149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e640b0db0 0x7f7e64149a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 -- 172.21.15.84:0/2832796884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009820 con 0x7f7e64158c60 2023-09-10T00:12:17.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e63fff640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0b0040 tx=0x7f7e5c0a5bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0041e0 con 0x7f7e64158c60 2023-09-10T00:12:17.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e5c004430 con 0x7f7e64158c60 2023-09-10T00:12:17.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e641596e0 con 0x7f7e64158c60 2023-09-10T00:12:17.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c004800 con 0x7f7e64158c60 2023-09-10T00:12:17.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64156140 con 0x7f7e64158c60 2023-09-10T00:12:17.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e5c0b4040 con 0x7f7e64158c60 2023-09-10T00:12:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e5c0ad440 con 0x7f7e64158c60 2023-09-10T00:12:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e64159bc0 con 0x7f7e64158c60 2023-09-10T00:12:17.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.441+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f7e5c0b2070 con 0x7f7e64158c60 2023-09-10T00:12:17.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.501+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7e6406e0d0 con 0x7f7e64158c60 2023-09-10T00:12:17.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.501+0000 7f7e4bfff640 1 -- 172.21.15.84:0/2832796884 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7e5c0ce090 con 0x7f7e64158c60 2023-09-10T00:12:17.505 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2023-09-10T00:12:17.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 msgr2=0x7f7e64154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0b0040 tx=0x7f7e5c0a5bf0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 shutdown_connections 2023-09-10T00:12:17.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e64158c60 0x7f7e64154c40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640cd2e0 0x7f7e64154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 --2- 172.21.15.84:0/2832796884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e640b0db0 0x7f7e64149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 >> 172.21.15.84:0/2832796884 conn(0x7f7e640af230 msgr2=0x7f7e64157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 shutdown_connections 2023-09-10T00:12:17.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:17.505+0000 7f7e6a1d2640 1 -- 172.21.15.84:0/2832796884 wait complete. 2023-09-10T00:12:17.527 INFO:tasks.ceph:check_enable_crimson: False 2023-09-10T00:12:17.527 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-10T00:12:17.528 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:17.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-10T00:12:17.539 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:17.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-10T00:12:17.592 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:17.592 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-10T00:12:17.604 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:17.601+0000 7fda45af2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-10T00:12:17.617 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:17.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-10T00:12:17.672 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:17.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-10T00:12:17.686 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:17.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-10T00:12:17.706 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:17.704+0000 7fe5fa4de180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-10T00:12:17.719 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:17.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-10T00:12:17.772 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:12:17.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-10T00:12:17.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 54294e9c-0ce2-4e55-af3e-97c5939775bc 0 2023-09-10T00:12:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- 172.21.15.100:0/1340955708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a406cdc0 msgr2=0x7f24a406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.987 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/1340955708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a406cdc0 0x7f24a406d220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f24a40afe70 tx=0x7f249401c810 comp rx=0 tx=0).stop 2023-09-10T00:12:17.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- 172.21.15.100:0/1340955708 shutdown_connections 2023-09-10T00:12:17.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/1340955708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a406cdc0 0x7f24a406d220 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/1340955708 >> v2:172.21.15.84:3300/0 conn(0x7f24a41579d0 0x7f24a406bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- 172.21.15.100:0/1340955708 >> 172.21.15.100:0/1340955708 conn(0x7f24a40af230 msgr2=0x7f24a40af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:17.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- 172.21.15.100:0/1340955708 shutdown_connections 2023-09-10T00:12:17.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- 172.21.15.100:0/1340955708 wait complete. 2023-09-10T00:12:17.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 Processor -- start 2023-09-10T00:12:17.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- start start 2023-09-10T00:12:17.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a406cdc0 0x7f24a40c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24a415b4f0 0x7f24a4159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:17.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415d5c0 con 0x7f24a406cdc0 2023-09-10T00:12:17.992 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415d8a0 con 0x7f24a41579d0 2023-09-10T00:12:17.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24ab4f3640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415db80 con 0x7f24a415b4f0 2023-09-10T00:12:17.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44234/0 (socket says 172.21.15.100:44234) 2023-09-10T00:12:17.993 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 -- 172.21.15.100:0/4278133176 learned_addr learned my addr 172.21.15.100:0/4278133176 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:17.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a9a90640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24a415b4f0 0x7f24a4159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a928f640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a406cdc0 0x7f24a40c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:17.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 -- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24a415b4f0 msgr2=0x7f24a4159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24a415b4f0 0x7f24a4159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.994 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 -- 172.21.15.100:0/4278133176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a406cdc0 msgr2=0x7f24a40c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:17.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a406cdc0 0x7f24a40c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:17.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 -- 172.21.15.100:0/4278133176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009560 con 0x7f24a41579d0 2023-09-10T00:12:17.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.988+0000 7f24a8a8e640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f24940b0040 tx=0x7f24940a5880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:17.995 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940043c0 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2494005020 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a415de60 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494005430 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40c6eb0 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24940b4070 con 0x7f24a41579d0 2023-09-10T00:12:17.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2494003a80 con 0x7f24a41579d0 2023-09-10T00:12:17.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a406e0d0 con 0x7f24a41579d0 2023-09-10T00:12:17.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:17.992+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f24940c4060 con 0x7f24a41579d0 2023-09-10T00:12:18.060 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.060+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "54294e9c-0ce2-4e55-af3e-97c5939775bc", "id": 0} v 0) v1 -- 0x7f24a415e310 con 0x7f24a41579d0 2023-09-10T00:12:18.068 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f2499ffb640 1 -- 172.21.15.100:0/4278133176 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "54294e9c-0ce2-4e55-af3e-97c5939775bc", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f24940ba020 con 0x7f24a41579d0 2023-09-10T00:12:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:0 2023-09-10T00:12:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 msgr2=0x7f24a41469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f24940b0040 tx=0x7f24940a5880 comp rx=0 tx=0).stop 2023-09-10T00:12:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 shutdown_connections 2023-09-10T00:12:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24a415b4f0 0x7f24a4159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24a41579d0 0x7f24a41469c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 --2- 172.21.15.100:0/4278133176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24a406cdc0 0x7f24a40c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.068+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 >> 172.21.15.100:0/4278133176 conn(0x7f24a40af230 msgr2=0x7f24a41564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.072+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 shutdown_connections 2023-09-10T00:12:18.071 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.072+0000 7f24ab4f3640 1 -- 172.21.15.100:0/4278133176 wait complete. 2023-09-10T00:12:18.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 0e7a0d6b-4ef7-4e08-8a41-ae791297f904 1 2023-09-10T00:12:18.091 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:18.089+0000 7fda45af2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-10T00:12:18.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 -- 172.21.15.100:0/2700927462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 msgr2=0x7f710406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.205 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 --2- 172.21.15.100:0/2700927462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406d220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009c80 tx=0x7f70fc01ccb0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 -- 172.21.15.100:0/2700927462 shutdown_connections 2023-09-10T00:12:18.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 --2- 172.21.15.100:0/2700927462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406d220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 --2- 172.21.15.100:0/2700927462 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71041579d0 0x7f710406bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 -- 172.21.15.100:0/2700927462 >> 172.21.15.100:0/2700927462 conn(0x7f71040af230 msgr2=0x7f71040af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.206 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 -- 172.21.15.100:0/2700927462 shutdown_connections 2023-09-10T00:12:18.207 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.204+0000 7f710b542640 1 -- 172.21.15.100:0/2700927462 wait complete. 2023-09-10T00:12:18.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 Processor -- start 2023-09-10T00:12:18.209 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- start start 2023-09-10T00:12:18.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 0x7f71041492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 0x7f7104069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.210 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7104158e50 con 0x7f71041579d0 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71040c5470 con 0x7f710415bc00 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71041497f0 con 0x7f710406cdc0 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f71092de640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 0x7f71041492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44248/0 (socket says 172.21.15.100:44248) 2023-09-10T00:12:18.211 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 -- 172.21.15.100:0/1800160004 learned_addr learned my addr 172.21.15.100:0/1800160004 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:18.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7108add640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 0x7f7104069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 -- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 msgr2=0x7f71041492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 0x7f71041492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 -- 172.21.15.100:0/1800160004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 msgr2=0x7f7104069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 0x7f7104069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 -- 172.21.15.100:0/1800160004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f80094a0 con 0x7f710415bc00 2023-09-10T00:12:18.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f71092de640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 0x7f71041492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:12:18.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7108add640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 0x7f7104069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:18.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f7109adf640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70fc01b360 tx=0x7f70fc005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:18.213 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc004c50 con 0x7f710415bc00 2023-09-10T00:12:18.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f70fc004000 con 0x7f710415bc00 2023-09-10T00:12:18.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0098e0 con 0x7f710415bc00 2023-09-10T00:12:18.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc004ea0 con 0x7f710415bc00 2023-09-10T00:12:18.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104158520 con 0x7f710415bc00 2023-09-10T00:12:18.214 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f70fc0b4040 con 0x7f710415bc00 2023-09-10T00:12:18.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f70fc005790 con 0x7f710415bc00 2023-09-10T00:12:18.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.208+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104158fc0 con 0x7f710415bc00 2023-09-10T00:12:18.215 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.212+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f70fc0bc070 con 0x7f710415bc00 2023-09-10T00:12:18.238 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:18.240+0000 7fe5fa4de180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-10T00:12:18.271 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:18.269+0000 7fda45af2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-10T00:12:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.280+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e7a0d6b-4ef7-4e08-8a41-ae791297f904", "id": 1} v 0) v1 -- 0x7f710406e0d0 con 0x7f710415bc00 2023-09-10T00:12:18.285 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.284+0000 7f70f5ffb640 1 -- 172.21.15.100:0/1800160004 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e7a0d6b-4ef7-4e08-8a41-ae791297f904", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f70fc0b2070 con 0x7f710415bc00 2023-09-10T00:12:18.285 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-09-10T00:12:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 msgr2=0x7f710406a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f70fc01b360 tx=0x7f70fc005b00 comp rx=0 tx=0).stop 2023-09-10T00:12:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 shutdown_connections 2023-09-10T00:12:18.287 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f710415bc00 0x7f710406a380 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71041579d0 0x7f7104069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 --2- 172.21.15.100:0/1800160004 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f710406cdc0 0x7f71041492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 >> 172.21.15.100:0/1800160004 conn(0x7f71040af230 msgr2=0x7f71040b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 shutdown_connections 2023-09-10T00:12:18.288 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.288+0000 7f710b542640 1 -- 172.21.15.100:0/1800160004 wait complete. 2023-09-10T00:12:18.304 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new d46f2396-f2a2-48f5-b32d-98e2fe989b88 2 2023-09-10T00:12:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/3187194820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd958005190 msgr2=0x7fd95800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 --2- 172.21.15.100:0/3187194820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd958005190 0x7fd95800b990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd95c001da0 tx=0x7fd95c01caf0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/3187194820 shutdown_connections 2023-09-10T00:12:18.427 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 --2- 172.21.15.100:0/3187194820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd958005190 0x7fd95800b990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/3187194820 >> 172.21.15.100:0/3187194820 conn(0x7fd96c0c9a00 msgr2=0x7fd96c0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/3187194820 shutdown_connections 2023-09-10T00:12:18.428 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/3187194820 wait complete. 2023-09-10T00:12:18.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 Processor -- start 2023-09-10T00:12:18.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- start start 2023-09-10T00:12:18.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 0x7fd96c0c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.431 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd96c157ce0 0x7fd96c14b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c14db70 con 0x7fd958005190 2023-09-10T00:12:18.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c157850 con 0x7fd96c144080 2023-09-10T00:12:18.432 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c14e040 con 0x7fd96c157ce0 2023-09-10T00:12:18.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44272/0 (socket says 172.21.15.100:44272) 2023-09-10T00:12:18.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 -- 172.21.15.100:0/2906039923 learned_addr learned my addr 172.21.15.100:0/2906039923 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:18.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd970e17640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd96c157ce0 0x7fd96c14b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.433 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96bfff640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 0x7fd96c0c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 -- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd96c157ce0 msgr2=0x7fd96c14b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd96c157ce0 0x7fd96c14b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 -- 172.21.15.100:0/2906039923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 msgr2=0x7fd96c0c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 0x7fd96c0c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.434 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 -- 172.21.15.100:0/2906039923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c14d5f0 con 0x7fd96c144080 2023-09-10T00:12:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96bfff640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 0x7fd96c0c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd96b7fe640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd954006630 tx=0x7fd9540039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:18.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954011900 con 0x7fd96c144080 2023-09-10T00:12:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd954011a60 con 0x7fd96c144080 2023-09-10T00:12:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c14d890 con 0x7fd96c144080 2023-09-10T00:12:18.436 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954011e70 con 0x7fd96c144080 2023-09-10T00:12:18.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c150e60 con 0x7fd96c144080 2023-09-10T00:12:18.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd9540103c0 con 0x7fd96c144080 2023-09-10T00:12:18.437 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.428+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fd954010a90 con 0x7fd96c144080 2023-09-10T00:12:18.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.432+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c1509e0 con 0x7fd96c144080 2023-09-10T00:12:18.438 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:18.432+0000 7fe5fa4de180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-10T00:12:18.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.432+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd96c1509e0 con 0x7fd96c144080 2023-09-10T00:12:18.500 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.500+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d46f2396-f2a2-48f5-b32d-98e2fe989b88", "id": 2} v 0) v1 -- 0x7fd96c073400 con 0x7fd96c144080 2023-09-10T00:12:18.505 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.504+0000 7fd968ff9640 1 -- 172.21.15.100:0/2906039923 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d46f2396-f2a2-48f5-b32d-98e2fe989b88", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd95401f060 con 0x7fd96c144080 2023-09-10T00:12:18.506 INFO:teuthology.orchestra.run.smithi100.stdout:2 2023-09-10T00:12:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 msgr2=0x7fd96c1644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd954006630 tx=0x7fd9540039d0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 shutdown_connections 2023-09-10T00:12:18.507 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd96c157ce0 0x7fd96c14b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd96c144080 0x7fd96c1644b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 --2- 172.21.15.100:0/2906039923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd958005190 0x7fd96c0c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 >> 172.21.15.100:0/2906039923 conn(0x7fd96c0c9a00 msgr2=0x7fd96c0a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 shutdown_connections 2023-09-10T00:12:18.508 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.508+0000 7fd97287a640 1 -- 172.21.15.100:0/2906039923 wait complete. 2023-09-10T00:12:18.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 2ab391fd-5b6e-47cd-a59b-b6121a10314d 3 2023-09-10T00:12:18.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- 172.21.15.100:0/3399767810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1650158a40 msgr2=0x7f16500b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.641 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 --2- 172.21.15.100:0/3399767810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1650158a40 0x7f16500b0350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f16500b1290 tx=0x7f164001c7e0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- 172.21.15.100:0/3399767810 shutdown_connections 2023-09-10T00:12:18.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 --2- 172.21.15.100:0/3399767810 >> v2:172.21.15.84:3300/0 conn(0x7f165006e600 0x7f16500b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.642 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 --2- 172.21.15.100:0/3399767810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1650158a40 0x7f16500b0350 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- 172.21.15.100:0/3399767810 >> 172.21.15.100:0/3399767810 conn(0x7f16500cb350 msgr2=0x7f16500cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- 172.21.15.100:0/3399767810 shutdown_connections 2023-09-10T00:12:18.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- 172.21.15.100:0/3399767810 wait complete. 2023-09-10T00:12:18.643 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 Processor -- start 2023-09-10T00:12:18.644 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.640+0000 7f1656e56640 1 -- start start 2023-09-10T00:12:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 0x7f16501590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 0x7f1650163130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165006c7e0 con 0x7f1650158a40 2023-09-10T00:12:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650156f90 con 0x7f16500cc7d0 2023-09-10T00:12:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650159600 con 0x7f165006e600 2023-09-10T00:12:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40914/0 (socket says 172.21.15.100:40914) 2023-09-10T00:12:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 -- 172.21.15.100:0/2455148699 learned_addr learned my addr 172.21.15.100:0/2455148699 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164ffff640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 0x7f16501590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f16553f3640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 0x7f1650163130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 -- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 msgr2=0x7f16501590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 0x7f16501590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 -- 172.21.15.100:0/2455148699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 msgr2=0x7f1650163130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 0x7f1650163130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 -- 172.21.15.100:0/2455148699 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640009560 con 0x7f165006e600 2023-09-10T00:12:18.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164ffff640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 0x7f16501590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:12:18.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f16553f3640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 0x7f1650163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:18.653 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1654bf2640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1640009850 tx=0x7f16400a5850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640004340 con 0x7f165006e600 2023-09-10T00:12:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1640005020 con 0x7f165006e600 2023-09-10T00:12:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650156380 con 0x7f165006e600 2023-09-10T00:12:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640005430 con 0x7f165006e600 2023-09-10T00:12:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650156940 con 0x7f165006e600 2023-09-10T00:12:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f16400b4070 con 0x7f165006e600 2023-09-10T00:12:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1640003bd0 con 0x7f165006e600 2023-09-10T00:12:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.644+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165006cfb0 con 0x7f165006e600 2023-09-10T00:12:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.648+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f16400bc020 con 0x7f165006e600 2023-09-10T00:12:18.714 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.716+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ab391fd-5b6e-47cd-a59b-b6121a10314d", "id": 3} v 0) v1 -- 0x7f16500cb730 con 0x7f165006e600 2023-09-10T00:12:18.723 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f164d7fa640 1 -- 172.21.15.100:0/2455148699 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ab391fd-5b6e-47cd-a59b-b6121a10314d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16400b2070 con 0x7f165006e600 2023-09-10T00:12:18.723 INFO:teuthology.orchestra.run.smithi100.stdout:3 2023-09-10T00:12:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 msgr2=0x7f1650147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1640009850 tx=0x7f16400a5850 comp rx=0 tx=0).stop 2023-09-10T00:12:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 shutdown_connections 2023-09-10T00:12:18.725 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1650158a40 0x7f1650163130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16500cc7d0 0x7f16501590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 --2- 172.21.15.100:0/2455148699 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f165006e600 0x7f1650147e80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 >> 172.21.15.100:0/2455148699 conn(0x7f16500cb350 msgr2=0x7f16500af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 shutdown_connections 2023-09-10T00:12:18.726 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.724+0000 7f1656e56640 1 -- 172.21.15.100:0/2455148699 wait complete. 2023-09-10T00:12:18.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new b095c2f5-192f-4770-a9f8-375c50d12319 4 2023-09-10T00:12:18.832 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:18.829+0000 7fda45af2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-10T00:12:18.861 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1269663892 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 msgr2=0x7fc9cc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1269663892 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc06d220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009900 tx=0x7fc9c801c830 comp rx=0 tx=0).stop 2023-09-10T00:12:18.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1269663892 shutdown_connections 2023-09-10T00:12:18.862 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1269663892 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc06d220 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1269663892 >> v2:172.21.15.100:3300/0 conn(0x7fc9cc1579d0 0x7fc9cc06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1269663892 >> 172.21.15.100:0/1269663892 conn(0x7fc9cc0af230 msgr2=0x7fc9cc0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1269663892 shutdown_connections 2023-09-10T00:12:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.860+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1269663892 wait complete. 2023-09-10T00:12:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 Processor -- start 2023-09-10T00:12:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- start start 2023-09-10T00:12:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc06cdc0 0x7fc9cc149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc159a70 con 0x7fc9cc06cdc0 2023-09-10T00:12:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc159d50 con 0x7fc9cc1579d0 2023-09-10T00:12:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc15a030 con 0x7fc9cc15bc00 2023-09-10T00:12:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d2526640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44290/0 (socket says 172.21.15.100:44290) 2023-09-10T00:12:18.868 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d2526640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40938/0 (socket says 172.21.15.100:40938) 2023-09-10T00:12:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 -- 172.21.15.100:0/1894942424 learned_addr learned my addr 172.21.15.100:0/1894942424 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 -- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 msgr2=0x7fc9cc0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 -- 172.21.15.100:0/1894942424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc06cdc0 msgr2=0x7fc9cc149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.869 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc06cdc0 0x7fc9cc149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 -- 172.21.15.100:0/1894942424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009560 con 0x7fc9cc1579d0 2023-09-10T00:12:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d1524640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c420 tx=0x7fc9bc00c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0052d0 con 0x7fc9cc1579d0 2023-09-10T00:12:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc9bc007020 con 0x7fc9cc1579d0 2023-09-10T00:12:18.870 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc15a310 con 0x7fc9cc1579d0 2023-09-10T00:12:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc14a130 con 0x7fc9cc1579d0 2023-09-10T00:12:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc007430 con 0x7fc9cc1579d0 2023-09-10T00:12:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc9bc006ae0 con 0x7fc9cc1579d0 2023-09-10T00:12:18.871 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc9bc003b00 con 0x7fc9cc1579d0 2023-09-10T00:12:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.864+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b4005260 con 0x7fc9cc1579d0 2023-09-10T00:12:18.872 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.868+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fc9bc020060 con 0x7fc9cc1579d0 2023-09-10T00:12:18.886 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:18.885+0000 7fda45af2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-10T00:12:18.938 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:18.937+0000 7fda45af2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-10T00:12:18.942 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.944+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b095c2f5-192f-4770-a9f8-375c50d12319", "id": 4} v 0) v1 -- 0x7fc9b40050d0 con 0x7fc9cc1579d0 2023-09-10T00:12:18.950 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9c27fc640 1 -- 172.21.15.100:0/1894942424 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b095c2f5-192f-4770-a9f8-375c50d12319", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9bc0290b0 con 0x7fc9cc1579d0 2023-09-10T00:12:18.950 INFO:teuthology.orchestra.run.smithi100.stdout:4 2023-09-10T00:12:18.951 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 msgr2=0x7fc9cc158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:18.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c420 tx=0x7fc9bc00c8e0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 shutdown_connections 2023-09-10T00:12:18.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc9cc15bc00 0x7fc9cc0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.952 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9cc1579d0 0x7fc9cc158fb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 --2- 172.21.15.100:0/1894942424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9cc06cdc0 0x7fc9cc149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:18.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 >> 172.21.15.100:0/1894942424 conn(0x7fc9cc0af230 msgr2=0x7fc9cc156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:18.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 shutdown_connections 2023-09-10T00:12:18.953 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:18.952+0000 7fc9d3f89640 1 -- 172.21.15.100:0/1894942424 wait complete. 2023-09-10T00:12:18.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new a31746f7-c2f3-4724-874d-bd0b45fc6e5a 5 2023-09-10T00:12:19.015 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.013+0000 7fda45af2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-10T00:12:19.028 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.028+0000 7fe5fa4de180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-10T00:12:19.067 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.065+0000 7fda45af2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-10T00:12:19.085 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.084+0000 7fe5fa4de180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-10T00:12:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 -- 172.21.15.100:0/378589008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6580cd2e0 msgr2=0x7ff65806ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 --2- 172.21.15.100:0/378589008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6580cd2e0 0x7ff65806ac10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff658072e50 tx=0x7ff65001cb60 comp rx=0 tx=0).stop 2023-09-10T00:12:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 -- 172.21.15.100:0/378589008 shutdown_connections 2023-09-10T00:12:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 --2- 172.21.15.100:0/378589008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6580cd2e0 0x7ff65806ac10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 --2- 172.21.15.100:0/378589008 >> v2:172.21.15.84:3300/0 conn(0x7ff658158c60 0x7ff6580b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 -- 172.21.15.100:0/378589008 >> 172.21.15.100:0/378589008 conn(0x7ff6580af230 msgr2=0x7ff6580af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 -- 172.21.15.100:0/378589008 shutdown_connections 2023-09-10T00:12:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.084+0000 7ff66028d640 1 -- 172.21.15.100:0/378589008 wait complete. 2023-09-10T00:12:19.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 Processor -- start 2023-09-10T00:12:19.094 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 -- start start 2023-09-10T00:12:19.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.095 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6580cd2e0 0x7ff6581494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 0x7ff658147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815a9f0 con 0x7ff6580cd2e0 2023-09-10T00:12:19.096 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6581488a0 con 0x7ff658158c60 2023-09-10T00:12:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff66028d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff658154c50 con 0x7ff6580b0db0 2023-09-10T00:12:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e029640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 0x7ff658147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.097 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e029640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40954/0 (socket says 172.21.15.100:40954) 2023-09-10T00:12:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e029640 1 -- 172.21.15.100:0/1269831575 learned_addr learned my addr 172.21.15.100:0/1269831575 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65d828640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6580cd2e0 0x7ff6581494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 -- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 msgr2=0x7ff658148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 -- 172.21.15.100:0/1269831575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6580cd2e0 msgr2=0x7ff6581494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6580cd2e0 0x7ff6581494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 -- 172.21.15.100:0/1269831575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009820 con 0x7ff658158c60 2023-09-10T00:12:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e029640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:12:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff65e82a640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 0x7ff658147430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6500ac000 tx=0x7ff6500a5ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650003b80 con 0x7ff658158c60 2023-09-10T00:12:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.088+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff650003df0 con 0x7ff658158c60 2023-09-10T00:12:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650004290 con 0x7ff658158c60 2023-09-10T00:12:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff658153e90 con 0x7ff658158c60 2023-09-10T00:12:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658154450 con 0x7ff658158c60 2023-09-10T00:12:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff6500b4070 con 0x7ff658158c60 2023-09-10T00:12:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff6500ad440 con 0x7ff658158c60 2023-09-10T00:12:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65806e0d0 con 0x7ff658158c60 2023-09-10T00:12:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.092+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff6500bd070 con 0x7ff658158c60 2023-09-10T00:12:19.143 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.144+0000 7fe5fa4de180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-10T00:12:19.143 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.141+0000 7fda45af2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-10T00:12:19.160 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.160+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a31746f7-c2f3-4724-874d-bd0b45fc6e5a", "id": 5} v 0) v1 -- 0x7ff6580c40a0 con 0x7ff658158c60 2023-09-10T00:12:19.169 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.168+0000 7ff64effd640 1 -- 172.21.15.100:0/1269831575 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a31746f7-c2f3-4724-874d-bd0b45fc6e5a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff6500b2070 con 0x7ff658158c60 2023-09-10T00:12:19.170 INFO:teuthology.orchestra.run.smithi100.stdout:5 2023-09-10T00:12:19.171 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 msgr2=0x7ff658147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 0x7ff658147430 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff6500ac000 tx=0x7ff6500a5ca0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 shutdown_connections 2023-09-10T00:12:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff658158c60 0x7ff658147430 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6580cd2e0 0x7ff6581494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.172 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 --2- 172.21.15.100:0/1269831575 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff6580b0db0 0x7ff658148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 >> 172.21.15.100:0/1269831575 conn(0x7ff6580af230 msgr2=0x7ff6580cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 shutdown_connections 2023-09-10T00:12:19.173 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.172+0000 7ff66028d640 1 -- 172.21.15.100:0/1269831575 wait complete. 2023-09-10T00:12:19.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new fbb9c470-b216-4f33-bf20-aac08393d96c 6 2023-09-10T00:12:19.195 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.193+0000 7fda45af2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-10T00:12:19.233 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.232+0000 7fe5fa4de180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-10T00:12:19.286 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.288+0000 7fe5fa4de180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-10T00:12:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 -- 172.21.15.100:0/3821323610 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e815acf0 msgr2=0x7fe7e815b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 --2- 172.21.15.100:0/3821323610 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e815acf0 0x7fe7e815b1a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009840 tx=0x7fe7dc01c800 comp rx=0 tx=0).stop 2023-09-10T00:12:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 -- 172.21.15.100:0/3821323610 shutdown_connections 2023-09-10T00:12:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 --2- 172.21.15.100:0/3821323610 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e815acf0 0x7fe7e815b1a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 --2- 172.21.15.100:0/3821323610 >> v2:172.21.15.84:3300/0 conn(0x7fe7e81570f0 0x7fe7e806d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.308+0000 7fe7ed340640 1 -- 172.21.15.100:0/3821323610 >> 172.21.15.100:0/3821323610 conn(0x7fe7e80c9a00 msgr2=0x7fe7e80c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- 172.21.15.100:0/3821323610 shutdown_connections 2023-09-10T00:12:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- 172.21.15.100:0/3821323610 wait complete. 2023-09-10T00:12:19.315 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 Processor -- start 2023-09-10T00:12:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- start start 2023-09-10T00:12:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 0x7fe7e814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e815acf0 0x7fe7e81627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814a1b0 con 0x7fe7e81570f0 2023-09-10T00:12:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814e8e0 con 0x7fe7e815acf0 2023-09-10T00:12:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e814ed70 con 0x7fe7e80cb890 2023-09-10T00:12:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40982/0 (socket says 172.21.15.100:40982) 2023-09-10T00:12:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e815acf0 0x7fe7e81627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 -- 172.21.15.100:0/1123383514 learned_addr learned my addr 172.21.15.100:0/1123383514 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e67fc640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 0x7fe7e814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 -- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e815acf0 msgr2=0x7fe7e81627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e815acf0 0x7fe7e81627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 -- 172.21.15.100:0/1123383514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 msgr2=0x7fe7e814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.319 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 0x7fe7e814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 -- 172.21.15.100:0/1123383514 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0094a0 con 0x7fe7e80cb890 2023-09-10T00:12:19.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e67fc640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 0x7fe7e814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:19.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7e6ffd640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c8c0 tx=0x7fe7d800cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:19.320 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8004220 con 0x7fe7e80cb890 2023-09-10T00:12:19.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe7d8004470 con 0x7fe7e80cb890 2023-09-10T00:12:19.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8166800 con 0x7fe7e80cb890 2023-09-10T00:12:19.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8007c10 con 0x7fe7e80cb890 2023-09-10T00:12:19.321 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e814dfb0 con 0x7fe7e80cb890 2023-09-10T00:12:19.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe7d8005020 con 0x7fe7e80cb890 2023-09-10T00:12:19.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe7d8003600 con 0x7fe7e80cb890 2023-09-10T00:12:19.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.312+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8073400 con 0x7fe7e80cb890 2023-09-10T00:12:19.322 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.316+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe7d8037b20 con 0x7fe7e80cb890 2023-09-10T00:12:19.334 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.333+0000 7fda45af2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-10T00:12:19.365 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.364+0000 7fe5fa4de180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-10T00:12:19.382 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.384+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fbb9c470-b216-4f33-bf20-aac08393d96c", "id": 6} v 0) v1 -- 0x7fe7e80b2f00 con 0x7fe7e80cb890 2023-09-10T00:12:19.393 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.392+0000 7fe7cf7fe640 1 -- 172.21.15.100:0/1123383514 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbb9c470-b216-4f33-bf20-aac08393d96c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7d8026070 con 0x7fe7e80cb890 2023-09-10T00:12:19.394 INFO:teuthology.orchestra.run.smithi100.stdout:6 2023-09-10T00:12:19.395 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:19.393+0000 7fda45af2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-10T00:12:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 msgr2=0x7fe7e81662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c8c0 tx=0x7fe7d800cd80 comp rx=0 tx=0).stop 2023-09-10T00:12:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 shutdown_connections 2023-09-10T00:12:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e815acf0 0x7fe7e81627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7e81570f0 0x7fe7e814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 --2- 172.21.15.100:0/1123383514 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7e80cb890 0x7fe7e81662c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 >> 172.21.15.100:0/1123383514 conn(0x7fe7e80c9a00 msgr2=0x7fe7e80cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 shutdown_connections 2023-09-10T00:12:19.398 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.396+0000 7fe7ed340640 1 -- 172.21.15.100:0/1123383514 wait complete. 2023-09-10T00:12:19.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new fef13f9d-3f80-410f-b6cb-be2e4db71a79 7 2023-09-10T00:12:19.419 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.420+0000 7fe5fa4de180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-10T00:12:19.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 -- 172.21.15.100:0/781008070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc06d4d0 msgr2=0x7ff0cc06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 --2- 172.21.15.100:0/781008070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc06bb20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009840 tx=0x7ff0c001c770 comp rx=0 tx=0).stop 2023-09-10T00:12:19.541 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 -- 172.21.15.100:0/781008070 shutdown_connections 2023-09-10T00:12:19.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 --2- 172.21.15.100:0/781008070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc06bb20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 -- 172.21.15.100:0/781008070 >> 172.21.15.100:0/781008070 conn(0x7ff0cc0af230 msgr2=0x7ff0cc0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 -- 172.21.15.100:0/781008070 shutdown_connections 2023-09-10T00:12:19.542 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.540+0000 7ff0d4609640 1 -- 172.21.15.100:0/781008070 wait complete. 2023-09-10T00:12:19.545 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 Processor -- start 2023-09-10T00:12:19.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- start start 2023-09-10T00:12:19.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.546 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc156310 con 0x7ff0cc06d4d0 2023-09-10T00:12:19.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc14af60 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc149a50 con 0x7ff0cc1579d0 2023-09-10T00:12:19.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d1ba4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.547 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44354/0 (socket says 172.21.15.100:44354) 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d1ba4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40984/0 (socket says 172.21.15.100:40984) 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 -- 172.21.15.100:0/123721958 learned_addr learned my addr 172.21.15.100:0/123721958 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d23a5640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 -- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 msgr2=0x7ff0cc155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 -- 172.21.15.100:0/123721958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0cc06d4d0 msgr2=0x7ff0cc149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 -- 172.21.15.100:0/123721958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c00094a0 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d1ba4640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:12:19.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d2ba6640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c3c0 tx=0x7ff0bc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:19.549 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc011790 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff0bc011a00 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc14a350 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc011e10 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.550 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc14a910 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0bc01c760 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff0bc01b3c0 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.544+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc157f90 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.551 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.548+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7ff0cc157f90 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.564 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.564+0000 7fe5fa4de180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-10T00:12:19.613 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.612+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fef13f9d-3f80-410f-b6cb-be2e4db71a79", "id": 7} v 0) v1 -- 0x7ff0cc06e0d0 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.624 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:19.624+0000 7fe5fa4de180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-10T00:12:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0caffd640 1 -- 172.21.15.100:0/123721958 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fef13f9d-3f80-410f-b6cb-be2e4db71a79", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0bc012420 con 0x7ff0cc15b4f0 2023-09-10T00:12:19.626 INFO:teuthology.orchestra.run.smithi100.stdout:7 2023-09-10T00:12:19.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 msgr2=0x7ff0cc149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c3c0 tx=0x7ff0bc00c880 comp rx=0 tx=0).stop 2023-09-10T00:12:19.627 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 shutdown_connections 2023-09-10T00:12:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0cc15b4f0 0x7ff0cc149510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0cc1579d0 0x7ff0cc155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 --2- 172.21.15.100:0/123721958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0cc06d4d0 0x7ff0cc149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 >> 172.21.15.100:0/123721958 conn(0x7ff0cc0af230 msgr2=0x7ff0cc15b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 shutdown_connections 2023-09-10T00:12:19.629 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:12:19.628+0000 7ff0d4609640 1 -- 172.21.15.100:0/123721958 wait complete. 2023-09-10T00:12:19.642 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-10T00:12:19.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-10T00:12:19.645 INFO:tasks.ceph.osd.0:Started 2023-09-10T00:12:19.646 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-10T00:12:19.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-10T00:12:19.648 INFO:tasks.ceph.osd.1:Started 2023-09-10T00:12:19.649 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-10T00:12:19.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-10T00:12:19.652 INFO:tasks.ceph.osd.2:Started 2023-09-10T00:12:19.652 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-10T00:12:19.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-10T00:12:19.654 INFO:tasks.ceph.osd.3:Started 2023-09-10T00:12:19.655 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-10T00:12:19.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-10T00:12:19.657 INFO:tasks.ceph.osd.4:Started 2023-09-10T00:12:19.658 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-10T00:12:19.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-10T00:12:19.660 INFO:tasks.ceph.osd.5:Started 2023-09-10T00:12:19.661 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-10T00:12:19.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-10T00:12:19.663 INFO:tasks.ceph.osd.6:Started 2023-09-10T00:12:19.663 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-10T00:12:19.664 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-10T00:12:19.666 INFO:tasks.ceph.osd.7:Started 2023-09-10T00:12:19.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:19.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2592240769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00c9b60 msgr2=0x7fd7e015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2592240769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00c9b60 0x7fd7e015a1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009840 tx=0x7fd7dc01c770 comp rx=0 tx=0).stop 2023-09-10T00:12:19.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2592240769 shutdown_connections 2023-09-10T00:12:19.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2592240769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e00c9b60 0x7fd7e015a1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2592240769 >> 172.21.15.84:0/2592240769 conn(0x7fd7e00cb7c0 msgr2=0x7fd7e00cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2592240769 shutdown_connections 2023-09-10T00:12:19.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.833+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2592240769 wait complete. 2023-09-10T00:12:19.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 Processor -- start 2023-09-10T00:12:19.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- start start 2023-09-10T00:12:19.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00b0790 0x7fd7e006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 0x7fd7e014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:19.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00b22a0 con 0x7fd7e0159020 2023-09-10T00:12:19.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e014b720 con 0x7fd7e00b0790 2023-09-10T00:12:19.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e014b950 con 0x7fd7e00c9b60 2023-09-10T00:12:19.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46210/0 (socket says 172.21.15.84:46210) 2023-09-10T00:12:19.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 -- 172.21.15.84:0/2005135057 learned_addr learned my addr 172.21.15.84:0/2005135057 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:19.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e5b68640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00b0790 0x7fd7e006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e5367640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 0x7fd7e014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:19.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 -- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 msgr2=0x7fd7e014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 0x7fd7e014b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 -- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00b0790 msgr2=0x7fd7e006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00b0790 0x7fd7e006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 -- 172.21.15.84:0/2005135057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc0094a0 con 0x7fd7e0159020 2023-09-10T00:12:19.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e5367640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 0x7fd7e014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:19.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e6369640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800cac0 tx=0x7fd7d800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:19.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800a850 con 0x7fd7e0159020 2023-09-10T00:12:19.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7d800aaa0 con 0x7fd7e0159020 2023-09-10T00:12:19.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8012420 con 0x7fd7e0159020 2023-09-10T00:12:19.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e014bc30 con 0x7fd7e0159020 2023-09-10T00:12:19.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e00b4790 con 0x7fd7e0159020 2023-09-10T00:12:19.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd7d8012880 con 0x7fd7e0159020 2023-09-10T00:12:19.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd7d801a3b0 con 0x7fd7e0159020 2023-09-10T00:12:19.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.837+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e00b2000 con 0x7fd7e0159020 2023-09-10T00:12:19.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.841+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd7e00b2000 con 0x7fd7e0159020 2023-09-10T00:12:19.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7e00b23e0 con 0x7fd7e0159020 2023-09-10T00:12:19.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7d67fc640 1 -- 172.21.15.84:0/2005135057 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd7e00b23e0 con 0x7fd7e0159020 2023-09-10T00:12:19.900 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:19.900 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:19.618289+0000","last_up_change":"0.000000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 msgr2=0x7fd7e00b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800cac0 tx=0x7fd7d800cbb0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 shutdown_connections 2023-09-10T00:12:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7e0159020 0x7fd7e00b4250 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd7e00c9b60 0x7fd7e014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 --2- 172.21.15.84:0/2005135057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7e00b0790 0x7fd7e006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 >> 172.21.15.84:0/2005135057 conn(0x7fd7e00cb7c0 msgr2=0x7fd7e01521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 shutdown_connections 2023-09-10T00:12:19.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:19.897+0000 7fd7e7dcc640 1 -- 172.21.15.84:0/2005135057 wait complete. 2023-09-10T00:12:19.916 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-10T00:12:19.916 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-10T00:12:19.969 INFO:tasks.ceph.mgr.y.smithi084.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-10T00:12:19.969 INFO:tasks.ceph.mgr.y.smithi084.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-10T00:12:19.969 INFO:tasks.ceph.mgr.y.smithi084.stderr: from numpy import show_config as show_numpy_config 2023-09-10T00:12:20.013 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:20.013+0000 7fda45af2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-10T00:12:20.062 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:12:20.061+0000 7fa865203640 -1 Falling back to public interface 2023-09-10T00:12:20.069 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:12:20.069+0000 7f9cbdce1640 -1 Falling back to public interface 2023-09-10T00:12:20.136 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:20.133+0000 7fda45af2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-10T00:12:20.255 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:12:20.256+0000 7f67a988d640 -1 Falling back to public interface 2023-09-10T00:12:20.279 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:12:20.280+0000 7fcbdab5c640 -1 Falling back to public interface 2023-09-10T00:12:20.279 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:12:20.280+0000 7f26805b9640 -1 Falling back to public interface 2023-09-10T00:12:20.290 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:12:20.292+0000 7f75f214e640 -1 Falling back to public interface 2023-09-10T00:12:20.298 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:20.297+0000 7fda45af2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-10T00:12:20.319 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:12:20.317+0000 7fe2ee3ba640 -1 Falling back to public interface 2023-09-10T00:12:20.319 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:12:20.317+0000 7f4f7ed47640 -1 Falling back to public interface 2023-09-10T00:12:20.321 INFO:tasks.ceph.mgr.x.smithi100.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-09-10T00:12:20.321 INFO:tasks.ceph.mgr.x.smithi100.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-09-10T00:12:20.322 INFO:tasks.ceph.mgr.x.smithi100.stderr: from numpy import show_config as show_numpy_config 2023-09-10T00:12:20.363 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:20.364+0000 7fe5fa4de180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-10T00:12:20.364 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:20.361+0000 7fda45af2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-10T00:12:20.489 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:20.485+0000 7fda45af2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-10T00:12:20.500 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:20.500+0000 7fe5fa4de180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-10T00:12:20.666 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:20.664+0000 7fe5fa4de180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-10T00:12:20.723 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:20.728 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:20.728+0000 7fe5fa4de180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-10T00:12:20.838 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- 172.21.15.84:0/1447271408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 msgr2=0x7f63600b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:20.839 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- 172.21.15.84:0/1447271408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600b3010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6350009900 tx=0x7f635001c890 comp rx=0 tx=0).stop 2023-09-10T00:12:20.839 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- 172.21.15.84:0/1447271408 shutdown_connections 2023-09-10T00:12:20.839 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- 172.21.15.84:0/1447271408 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63600b3550 0x7f636006ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.839 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- 172.21.15.84:0/1447271408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600b3010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.839 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- 172.21.15.84:0/1447271408 >> 172.21.15.84:0/1447271408 conn(0x7f63600af2e0 msgr2=0x7f63600af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:20.840 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- 172.21.15.84:0/1447271408 shutdown_connections 2023-09-10T00:12:20.840 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- 172.21.15.84:0/1447271408 wait complete. 2023-09-10T00:12:20.842 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 Processor -- start 2023-09-10T00:12:20.842 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- start start 2023-09-10T00:12:20.842 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f636006d370 0x7f63600c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:20.843 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63600b3550 0x7f6360155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:20.843 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:20.843 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63601563c0 con 0x7f6360158c30 2023-09-10T00:12:20.843 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63600c52a0 con 0x7f63600b3550 2023-09-10T00:12:20.843 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f636557b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63600c5520 con 0x7f636006d370 2023-09-10T00:12:20.844 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f635f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:20.844 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f635f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37330/0 (socket says 172.21.15.84:37330) 2023-09-10T00:12:20.844 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f635f7fe640 1 -- 172.21.15.84:0/4224153768 learned_addr learned my addr 172.21.15.84:0/4224153768 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:20.844 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f635effd640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f636006d370 0x7f63600c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:20.844 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.837+0000 7f635e7fc640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63600b3550 0x7f6360155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:20.845 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 -- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f636006d370 msgr2=0x7f63600c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:20.845 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f636006d370 0x7f63600c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.845 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 -- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63600b3550 msgr2=0x7f6360155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:20.845 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63600b3550 0x7f6360155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.845 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 -- 172.21.15.84:0/4224153768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350009560 con 0x7f6360158c30 2023-09-10T00:12:20.846 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f635f7fe640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f635800c770 tx=0x7f635800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:20.846 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358003b80 con 0x7f6360158c30 2023-09-10T00:12:20.846 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6358003ce0 con 0x7f6360158c30 2023-09-10T00:12:20.846 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800aab0 con 0x7f6360158c30 2023-09-10T00:12:20.846 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63600c5800 con 0x7f6360158c30 2023-09-10T00:12:20.847 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63600c70a0 con 0x7f6360158c30 2023-09-10T00:12:20.847 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f63580050d0 con 0x7f6360158c30 2023-09-10T00:12:20.847 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6358012be0 con 0x7f6360158c30 2023-09-10T00:12:20.848 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63600c1300 con 0x7f6360158c30 2023-09-10T00:12:20.848 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.841+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6358005560 con 0x7f6360158c30 2023-09-10T00:12:20.849 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:20.848+0000 7fe5fa4de180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-10T00:12:20.902 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6360073390 con 0x7f6360158c30 2023-09-10T00:12:20.903 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f63577fe640 1 -- 172.21.15.84:0/4224153768 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6358005700 con 0x7f6360158c30 2023-09-10T00:12:20.903 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-10T00:12:20.903 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:19.618289+0000","last_up_change":"0.000000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:20.904 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 msgr2=0x7f63600c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:20.905 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f635800c770 tx=0x7f635800cc30 comp rx=0 tx=0).stop 2023-09-10T00:12:20.905 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 shutdown_connections 2023-09-10T00:12:20.905 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6360158c30 0x7f63600c6b60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.905 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63600b3550 0x7f6360155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.905 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 --2- 172.21.15.84:0/4224153768 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f636006d370 0x7f63600c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:20.906 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 >> 172.21.15.84:0/4224153768 conn(0x7f63600af2e0 msgr2=0x7f63600b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:20.906 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 shutdown_connections 2023-09-10T00:12:20.906 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:20.901+0000 7f636557b640 1 -- 172.21.15.84:0/4224153768 wait complete. 2023-09-10T00:12:20.919 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-10T00:12:21.102 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.101+0000 7fda45af2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-10T00:12:21.178 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.177+0000 7fda45af2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-10T00:12:21.349 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.345+0000 7fda45af2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-10T00:12:21.422 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.421+0000 7fda45af2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-10T00:12:21.461 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:21.460+0000 7fe5fa4de180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-10T00:12:21.537 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:21.536+0000 7fe5fa4de180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-10T00:12:21.705 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:21.704+0000 7fe5fa4de180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-10T00:12:21.712 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.709+0000 7fda45af2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-10T00:12:21.772 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:21.769+0000 7fda45af2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-10T00:12:21.779 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:21.780+0000 7fe5fa4de180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-10T00:12:22.072 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:22.072+0000 7fe5fa4de180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-10T00:12:22.131 INFO:tasks.ceph.mgr.x.smithi100.stderr:2023-09-10T00:12:22.132+0000 7fe5fa4de180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-10T00:12:22.812 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:22.809+0000 7fd9ed26a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-10T00:12:22.817 INFO:tasks.ceph.mgr.y.smithi084.stderr:2023-09-10T00:12:22.813+0000 7fd9ed26a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-10T00:12:23.431 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:12:23.429+0000 7fa865203640 -1 osd.1 0 log_to_monitors true 2023-09-10T00:12:23.604 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:12:23.601+0000 7f4f7ed47640 -1 osd.2 0 log_to_monitors true 2023-09-10T00:12:24.008 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:12:24.005+0000 7f9cbdce1640 -1 osd.3 0 log_to_monitors true 2023-09-10T00:12:24.065 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:12:24.064+0000 7f67a988d640 -1 osd.4 0 log_to_monitors true 2023-09-10T00:12:24.107 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:12:24.108+0000 7f26805b9640 -1 osd.5 0 log_to_monitors true 2023-09-10T00:12:24.208 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:12:24.208+0000 7fcbdab5c640 -1 osd.7 0 log_to_monitors true 2023-09-10T00:12:24.208 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:12:24.205+0000 7fe2ee3ba640 -1 osd.0 0 log_to_monitors true 2023-09-10T00:12:24.227 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:12:24.228+0000 7f75f214e640 -1 osd.6 0 log_to_monitors true 2023-09-10T00:12:26.375 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:12:26.373+0000 7fa8611ab640 -1 osd.1 0 waiting for initial osdmap 2023-09-10T00:12:26.407 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:12:26.405+0000 7f4f7acef640 -1 osd.2 0 waiting for initial osdmap 2023-09-10T00:12:26.417 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:12:26.417+0000 7fa858fe0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:26.453 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:12:26.453+0000 7f4f72b24640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:27.174 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:12:27.173+0000 7f9cb9c89640 -1 osd.3 0 waiting for initial osdmap 2023-09-10T00:12:27.180 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:12:27.177+0000 7fe2ea362640 -1 osd.0 0 waiting for initial osdmap 2023-09-10T00:12:27.197 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:12:27.197+0000 7f9cb1abe640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:27.209 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:12:27.209+0000 7fe2e2197640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:27.726 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:27.855 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- 172.21.15.84:0/811327132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 msgr2=0x7fb7640c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:27.855 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 --2- 172.21.15.84:0/811327132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb7640c9030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb754009900 tx=0x7fb75401c890 comp rx=0 tx=0).stop 2023-09-10T00:12:27.855 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- 172.21.15.84:0/811327132 shutdown_connections 2023-09-10T00:12:27.856 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 --2- 172.21.15.84:0/811327132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb7640c9030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:27.856 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- 172.21.15.84:0/811327132 >> 172.21.15.84:0/811327132 conn(0x7fb7640cec60 msgr2=0x7fb7640cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:27.856 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- 172.21.15.84:0/811327132 shutdown_connections 2023-09-10T00:12:27.857 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- 172.21.15.84:0/811327132 wait complete. 2023-09-10T00:12:27.858 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 Processor -- start 2023-09-10T00:12:27.859 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- start start 2023-09-10T00:12:27.859 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7640b0820 0x7fb7640c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:27.859 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:27.859 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb764154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:27.860 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c6890 con 0x7fb7640c9570 2023-09-10T00:12:27.860 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c6b70 con 0x7fb7640cd960 2023-09-10T00:12:27.860 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.853+0000 7fb76c476640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c6e50 con 0x7fb7640b0820 2023-09-10T00:12:27.860 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:27.861 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb76a212640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7640b0820 0x7fb7640c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:27.861 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37404/0 (socket says 172.21.15.84:37404) 2023-09-10T00:12:27.861 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 -- 172.21.15.84:0/3535514902 learned_addr learned my addr 172.21.15.84:0/3535514902 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:27.861 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb76aa13640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb764154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:27.861 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 -- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7640b0820 msgr2=0x7fb7640c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:27.862 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7640b0820 0x7fb7640c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:27.862 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 -- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 msgr2=0x7fb764154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:27.862 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb764154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:27.863 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 -- 172.21.15.84:0/3535514902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009560 con 0x7fb7640c9570 2023-09-10T00:12:27.863 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.857+0000 7fb769a11640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7540194a0 tx=0x7fb7540a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:27.874 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754003800 con 0x7fb7640c9570 2023-09-10T00:12:27.874 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb754003960 con 0x7fb7640c9570 2023-09-10T00:12:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7640c7130 con 0x7fb7640c9570 2023-09-10T00:12:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754003d70 con 0x7fb7640c9570 2023-09-10T00:12:27.875 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76415bfc0 con 0x7fb7640c9570 2023-09-10T00:12:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb764073390 con 0x7fb7640c9570 2023-09-10T00:12:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) v1 ==== 85298+0+0 (secure 0 0 0) 0x7fb7540b4070 con 0x7fb7640c9570 2023-09-10T00:12:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 0x7fb748067f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:27.876 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7fb75411d050 con 0x7fb7640c9570 2023-09-10T00:12:27.877 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb76a212640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 0x7fb748067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:27.877 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.873+0000 7fb76a212640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 0x7fb748067f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb760007fd0 tx=0x7fb760009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:27.965 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:27.961+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7540eb460 con 0x7fb7640c9570 2023-09-10T00:12:28.120 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.117+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7640c6f90 con 0x7fb7640c9570 2023-09-10T00:12:28.121 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb75affd640 1 -- 172.21.15.84:0/3535514902 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8964 (secure 0 0 0) 0x7fb7640c6f90 con 0x7fb7640c9570 2023-09-10T00:12:28.122 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-10T00:12:28.122 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":14,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:27.387448+0000","last_up_change":"2023-09-10T00:12:27.387448+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:28.123 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 msgr2=0x7fb748067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:28.124 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 0x7fb748067f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb760007fd0 tx=0x7fb760009040 comp rx=0 tx=0).stop 2023-09-10T00:12:28.124 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 msgr2=0x7fb76414bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:28.124 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb7540194a0 tx=0x7fb7540a57d0 comp rx=0 tx=0).stop 2023-09-10T00:12:28.124 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 shutdown_connections 2023-09-10T00:12:28.124 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb748065ac0 0x7fb748067f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:28.125 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7640cd960 0x7fb764154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:28.125 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7640c9570 0x7fb76414bca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:28.125 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 --2- 172.21.15.84:0/3535514902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7640b0820 0x7fb7640c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:28.125 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 >> 172.21.15.84:0/3535514902 conn(0x7fb7640cec60 msgr2=0x7fb76406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:28.125 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 shutdown_connections 2023-09-10T00:12:28.126 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:28.121+0000 7fb76c476640 1 -- 172.21.15.84:0/3535514902 wait complete. 2023-09-10T00:12:28.139 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-09-10T00:12:28.141 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:12:28.139+0000 7f267c561640 -1 osd.5 0 waiting for initial osdmap 2023-09-10T00:12:28.170 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:12:28.171+0000 7f2674396640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:28.198 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:12:28.199+0000 7f67a5835640 -1 osd.4 0 waiting for initial osdmap 2023-09-10T00:12:28.199 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:12:28.199+0000 7f75ee0f6640 -1 osd.6 0 waiting for initial osdmap 2023-09-10T00:12:28.207 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:12:28.207+0000 7fcbd6b04640 -1 osd.7 0 waiting for initial osdmap 2023-09-10T00:12:28.230 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:12:28.231+0000 7f679d66a640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:28.230 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:12:28.231+0000 7f75e5f2b640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:28.234 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:12:28.235+0000 7fcbce939640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-10T00:12:34.945 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:35.071 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- 172.21.15.84:0/3294335786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b12d0 msgr2=0x7fd6000695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.071 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- 172.21.15.84:0/3294335786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b12d0 0x7fd6000695b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009900 tx=0x7fd5fc01c850 comp rx=0 tx=0).stop 2023-09-10T00:12:35.072 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- 172.21.15.84:0/3294335786 shutdown_connections 2023-09-10T00:12:35.072 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- 172.21.15.84:0/3294335786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd6000b16b0 0x7fd60006f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.072 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- 172.21.15.84:0/3294335786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b12d0 0x7fd6000695b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.072 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- 172.21.15.84:0/3294335786 >> 172.21.15.84:0/3294335786 conn(0x7fd6000cc6e0 msgr2=0x7fd6000ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.072 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- 172.21.15.84:0/3294335786 shutdown_connections 2023-09-10T00:12:35.073 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- 172.21.15.84:0/3294335786 wait complete. 2023-09-10T00:12:35.075 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 Processor -- start 2023-09-10T00:12:35.076 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- start start 2023-09-10T00:12:35.076 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd600069af0 0x7fd600159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.076 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 0x7fd60015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.076 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.076 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd600151210 con 0x7fd6000b16b0 2023-09-10T00:12:35.077 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60015ab70 con 0x7fd6000b12d0 2023-09-10T00:12:35.077 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd60794e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60015add0 con 0x7fd600069af0 2023-09-10T00:12:35.077 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.077 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37984/0 (socket says 172.21.15.84:37984) 2023-09-10T00:12:35.078 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 -- 172.21.15.84:0/3916491640 learned_addr learned my addr 172.21.15.84:0/3916491640 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:35.078 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd6056ea640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd600069af0 0x7fd600159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.078 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd604ee9640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 0x7fd60015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.078 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 -- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd600069af0 msgr2=0x7fd600159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.078 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd600069af0 0x7fd600159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.079 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 -- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 msgr2=0x7fd60015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.079 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 0x7fd60015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.079 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 -- 172.21.15.84:0/3916491640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009560 con 0x7fd6000b16b0 2023-09-10T00:12:35.080 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd604ee9640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 0x7fd60015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:35.080 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.072+0000 7fd605eeb640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c780 tx=0x7fd5f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.080 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8004b70 con 0x7fd6000b16b0 2023-09-10T00:12:35.080 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd5f800ce90 con 0x7fd6000b16b0 2023-09-10T00:12:35.081 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6001508e0 con 0x7fd6000b16b0 2023-09-10T00:12:35.081 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800aab0 con 0x7fd6000b16b0 2023-09-10T00:12:35.081 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd600150ea0 con 0x7fd6000b16b0 2023-09-10T00:12:35.081 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600151380 con 0x7fd6000b16b0 2023-09-10T00:12:35.081 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd5f800ac10 con 0x7fd6000b16b0 2023-09-10T00:12:35.082 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 0x7fd5e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.082 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5f80836d0 con 0x7fd6000b16b0 2023-09-10T00:12:35.082 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd6056ea640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 0x7fd5e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.083 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.076+0000 7fd6056ea640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 0x7fd5e4067fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0af000 tx=0x7fd5fc01b090 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.083 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.080+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd5f8051370 con 0x7fd6000b16b0 2023-09-10T00:12:35.234 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.236+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd600073390 con 0x7fd6000b16b0 2023-09-10T00:12:35.236 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.236+0000 7fd5f5ffb640 1 -- 172.21.15.84:0/3916491640 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fd5f8054990 con 0x7fd6000b16b0 2023-09-10T00:12:35.236 INFO:teuthology.misc.health.smithi084.stdout: 2023-09-10T00:12:35.237 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":17,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:30.398634+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:35.238 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 msgr2=0x7fd5e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.239 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 0x7fd5e4067fe0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0af000 tx=0x7fd5fc01b090 comp rx=0 tx=0).stop 2023-09-10T00:12:35.239 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 msgr2=0x7fd600149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.239 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800c780 tx=0x7fd5f800cc40 comp rx=0 tx=0).stop 2023-09-10T00:12:35.239 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 shutdown_connections 2023-09-10T00:12:35.240 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd5e4065b20 0x7fd5e4067fe0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.240 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6000b16b0 0x7fd600149290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.240 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000b12d0 0x7fd60015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.240 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 --2- 172.21.15.84:0/3916491640 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd600069af0 0x7fd600159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.240 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 >> 172.21.15.84:0/3916491640 conn(0x7fd6000cc6e0 msgr2=0x7fd600065310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.241 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 shutdown_connections 2023-09-10T00:12:35.241 INFO:teuthology.misc.health.smithi084.stderr:2023-09-10T00:12:35.240+0000 7fd60794e640 1 -- 172.21.15.84:0/3916491640 wait complete. 2023-09-10T00:12:35.254 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-10T00:12:35.255 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-10T00:12:35.255 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-10T00:12:35.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-10T00:12:35.258 INFO:tasks.ceph.mds.a:Started 2023-09-10T00:12:35.258 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-10T00:12:35.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-10T00:12:35.263 INFO:tasks.ceph.mds.c:Started 2023-09-10T00:12:35.263 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-10T00:12:35.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-10T00:12:35.266 INFO:tasks.ceph.mds.b:Started 2023-09-10T00:12:35.267 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-10T00:12:35.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-10T00:12:35.270 INFO:tasks.ceph.mds.d:Started 2023-09-10T00:12:35.270 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-10T00:12:35.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:35.388 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-09-10T00:12:35.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- 172.21.15.84:0/3573586512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 msgr2=0x7f2484005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 --2- 172.21.15.84:0/3573586512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f2484005190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2490009ee0 tx=0x7f249001d5b0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249ebe7640 1 -- 172.21.15.84:0/3573586512 reap_dead start 2023-09-10T00:12:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- 172.21.15.84:0/3573586512 shutdown_connections 2023-09-10T00:12:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- 172.21.15.84:0/3573586512 >> 172.21.15.84:0/3573586512 conn(0x7f24980ca240 msgr2=0x7f24980ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- 172.21.15.84:0/3573586512 shutdown_connections 2023-09-10T00:12:35.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- 172.21.15.84:0/3573586512 wait complete. 2023-09-10T00:12:35.397 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-09-10T00:12:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 Processor -- start 2023-09-10T00:12:35.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- start start 2023-09-10T00:12:35.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24980c6b10 0x7f249814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24980b1560 0x7f24980b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980b1f20 con 0x7f2484004d10 2023-09-10T00:12:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2498158550 con 0x7f24980c6b10 2023-09-10T00:12:35.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f24a064a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c7380 con 0x7f24980b1560 2023-09-10T00:12:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38050/0 (socket says 172.21.15.84:38050) 2023-09-10T00:12:35.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 -- 172.21.15.84:0/3654802033 learned_addr learned my addr 172.21.15.84:0/3654802033 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249ebe7640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24980b1560 0x7f24980b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249dbe5640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24980c6b10 0x7f249814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 -- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24980b1560 msgr2=0x7f24980b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24980b1560 0x7f24980b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 -- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24980c6b10 msgr2=0x7f249814fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24980c6b10 0x7f249814fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 -- 172.21.15.84:0/3654802033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980aa850 con 0x7f2484004d10 2023-09-10T00:12:35.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.396+0000 7f249e3e6640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9a0 tx=0x7f249400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400cbe0 con 0x7f2484004d10 2023-09-10T00:12:35.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24980aab30 con 0x7f2484004d10 2023-09-10T00:12:35.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f249400cd40 con 0x7f2484004d10 2023-09-10T00:12:35.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2498150220 con 0x7f2484004d10 2023-09-10T00:12:35.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494005280 con 0x7f2484004d10 2023-09-10T00:12:35.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24980caf90 con 0x7f2484004d10 2023-09-10T00:12:35.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f24940053e0 con 0x7f2484004d10 2023-09-10T00:12:35.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 0x7f247c068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2494014070 con 0x7f2484004d10 2023-09-10T00:12:35.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f249dbe5640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 0x7f247c068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.400+0000 7f249dbe5640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 0x7f247c068070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24880017b0 tx=0x7f2488006040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.410 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2023-09-10T00:12:35.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.404+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2494051440 con 0x7f2484004d10 2023-09-10T00:12:35.411 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2023-09-10T00:12:35.563 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.564+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2498073400 con 0x7f2484004d10 2023-09-10T00:12:35.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.564+0000 7f248effd640 1 -- 172.21.15.84:0/3654802033 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f2494054a60 con 0x7f2484004d10 2023-09-10T00:12:35.565 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:35.566 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:30.398634+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:35.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 msgr2=0x7f247c068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 0x7f247c068070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24880017b0 tx=0x7f2488006040 comp rx=0 tx=0).stop 2023-09-10T00:12:35.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 msgr2=0x7f24980adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9a0 tx=0x7f249400ee60 comp rx=0 tx=0).stop 2023-09-10T00:12:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 shutdown_connections 2023-09-10T00:12:35.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f247c065bb0 0x7f247c068070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f24980b1560 0x7f24980b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24980c6b10 0x7f249814fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 --2- 172.21.15.84:0/3654802033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2484004d10 0x7f24980adc00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 >> 172.21.15.84:0/3654802033 conn(0x7f24980ca240 msgr2=0x7f249806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 shutdown_connections 2023-09-10T00:12:35.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.568+0000 7f24a064a640 1 -- 172.21.15.84:0/3654802033 wait complete. 2023-09-10T00:12:35.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-10T00:12:35.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:12:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/4089427678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0cefd0 msgr2=0x7f073c069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- 172.21.15.84:0/4089427678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0cefd0 0x7f073c069cc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0734009c80 tx=0x7f073401f540 comp rx=0 tx=0).stop 2023-09-10T00:12:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/4089427678 shutdown_connections 2023-09-10T00:12:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- 172.21.15.84:0/4089427678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0cefd0 0x7f073c069cc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- 172.21.15.84:0/4089427678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0b2570 0x7f073c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/4089427678 >> 172.21.15.84:0/4089427678 conn(0x7f073c0cd570 msgr2=0x7f073c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/4089427678 shutdown_connections 2023-09-10T00:12:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/4089427678 wait complete. 2023-09-10T00:12:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 Processor -- start 2023-09-10T00:12:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- start start 2023-09-10T00:12:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f073c0b2570 0x7f073c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0cefd0 0x7f073c0d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1e39d0 con 0x7f073c0ceb70 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1e4810 con 0x7f073c0b2570 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1e3c00 con 0x7f073c0cefd0 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38060/0 (socket says 172.21.15.84:38060) 2023-09-10T00:12:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 -- 172.21.15.84:0/2541834708 learned_addr learned my addr 172.21.15.84:0/2541834708 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f073bfff640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0cefd0 0x7f073c0d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f073b7fe640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f073c0b2570 0x7f073c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 -- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0cefd0 msgr2=0x7f073c0d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0cefd0 0x7f073c0d0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 -- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f073c0b2570 msgr2=0x7f073c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f073c0b2570 0x7f073c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 -- 172.21.15.84:0/2541834708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340098e0 con 0x7f073c0ceb70 2023-09-10T00:12:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0732ffd640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f072400c490 tx=0x7f0724001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724003600 con 0x7f073c0ceb70 2023-09-10T00:12:35.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0724003780 con 0x7f073c0ceb70 2023-09-10T00:12:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c1e3ee0 con 0x7f073c0ceb70 2023-09-10T00:12:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724003bd0 con 0x7f073c0ceb70 2023-09-10T00:12:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.720+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c1e44a0 con 0x7f073c0ceb70 2023-09-10T00:12:35.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c1e49a0 con 0x7f073c0ceb70 2023-09-10T00:12:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0724003d30 con 0x7f073c0ceb70 2023-09-10T00:12:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f0738ff9640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 0x7f071c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:35.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0724082410 con 0x7f073c0ceb70 2023-09-10T00:12:35.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f073b7fe640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 0x7f071c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:35.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.724+0000 7f073b7fe640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 0x7f071c067fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f072c005fd0 tx=0x7f072c00c460 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:35.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.728+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f07240500b0 con 0x7f073c0ceb70 2023-09-10T00:12:35.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.884+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f073c0ca8e0 con 0x7f073c0ceb70 2023-09-10T00:12:35.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.884+0000 7f0738ff9640 1 -- 172.21.15.84:0/2541834708 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0724017020 con 0x7f073c0ceb70 2023-09-10T00:12:35.885 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:12:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 msgr2=0x7f071c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 0x7f071c067fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f072c005fd0 tx=0x7f072c00c460 comp rx=0 tx=0).stop 2023-09-10T00:12:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 msgr2=0x7f073c1e3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f072400c490 tx=0x7f0724001e80 comp rx=0 tx=0).stop 2023-09-10T00:12:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 shutdown_connections 2023-09-10T00:12:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f071c065b20 0x7f071c067fe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f073c0cefd0 0x7f073c0d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f073c0ceb70 0x7f073c1e3490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 --2- 172.21.15.84:0/2541834708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f073c0b2570 0x7f073c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 >> 172.21.15.84:0/2541834708 conn(0x7f073c0cd570 msgr2=0x7f073c0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 shutdown_connections 2023-09-10T00:12:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:35.888+0000 7f0741c8c640 1 -- 172.21.15.84:0/2541834708 wait complete. 2023-09-10T00:12:35.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:12:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.028+0000 7fc9594f2640 1 -- 172.21.15.84:0/2595095362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954070360 msgr2=0x7fc9540707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.028+0000 7fc9594f2640 1 --2- 172.21.15.84:0/2595095362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954070360 0x7fc9540707f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00acd0 tx=0x7fc94c01dd70 comp rx=0 tx=0).stop 2023-09-10T00:12:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/2595095362 shutdown_connections 2023-09-10T00:12:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 --2- 172.21.15.84:0/2595095362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc954070360 0x7fc9540707f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/2595095362 >> 172.21.15.84:0/2595095362 conn(0x7fc9540cca70 msgr2=0x7fc9540cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:36.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/2595095362 shutdown_connections 2023-09-10T00:12:36.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/2595095362 wait complete. 2023-09-10T00:12:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 Processor -- start 2023-09-10T00:12:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- start start 2023-09-10T00:12:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 0x7fc9541499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc954158210 0x7fc95414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95414c810 con 0x7fc9540ade00 2023-09-10T00:12:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc954149fc0 con 0x7fc954070360 2023-09-10T00:12:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95414a2a0 con 0x7fc954158210 2023-09-10T00:12:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38084/0 (socket says 172.21.15.84:38084) 2023-09-10T00:12:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 -- 172.21.15.84:0/1282508281 learned_addr learned my addr 172.21.15.84:0/1282508281 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9537fe640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc954158210 0x7fc95414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc952ffd640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 0x7fc9541499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:36.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 -- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc954158210 msgr2=0x7fc95414e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc954158210 0x7fc95414e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 -- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 msgr2=0x7fc9541499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 0x7fc9541499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 -- 172.21.15.84:0/1282508281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c00a930 con 0x7fc9540ade00 2023-09-10T00:12:36.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc952ffd640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 0x7fc9541499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9527fc640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc944001ec0 tx=0x7fc94400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440054e0 con 0x7fc9540ade00 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc944003600 con 0x7fc9540ade00 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944003a10 con 0x7fc9540ade00 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc954147c10 con 0x7fc9540ade00 2023-09-10T00:12:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.032+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540c3480 con 0x7fc9540ade00 2023-09-10T00:12:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc954148130 con 0x7fc9540ade00 2023-09-10T00:12:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc944003b70 con 0x7fc9540ade00 2023-09-10T00:12:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc94b7fe640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 0x7fc934068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc944082760 con 0x7fc9540ade00 2023-09-10T00:12:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc952ffd640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 0x7fc934068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.036+0000 7fc952ffd640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 0x7fc934068010 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc93c003e40 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.040+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc954148130 con 0x7fc9540ade00 2023-09-10T00:12:36.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.228+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc954148130 con 0x7fc9540ade00 2023-09-10T00:12:36.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc94b7fe640 1 -- 172.21.15.84:0/1282508281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7fc954148130 con 0x7fc9540ade00 2023-09-10T00:12:36.231 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:36.231 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-10T00:12:36.231 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2023-09-10T00:12:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 msgr2=0x7fc934068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 0x7fc934068010 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc93c003e40 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2023-09-10T00:12:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 msgr2=0x7fc9540c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc944001ec0 tx=0x7fc94400c8e0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 shutdown_connections 2023-09-10T00:12:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc934065b50 0x7fc934068010 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc954158210 0x7fc95414e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ade00 0x7fc9540c2f40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 --2- 172.21.15.84:0/1282508281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc954070360 0x7fc9541499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 >> 172.21.15.84:0/1282508281 conn(0x7fc9540cca70 msgr2=0x7fc9540cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:36.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 shutdown_connections 2023-09-10T00:12:36.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:36.232+0000 7fc9594f2640 1 -- 172.21.15.84:0/1282508281 wait complete. 2023-09-10T00:12:38.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:12:38.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- 172.21.15.84:0/1748763468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 msgr2=0x7fbb040afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/1748763468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb040afe20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009900 tx=0x7fbaec01c7f0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- 172.21.15.84:0/1748763468 shutdown_connections 2023-09-10T00:12:38.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/1748763468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb040afe20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- 172.21.15.84:0/1748763468 >> 172.21.15.84:0/1748763468 conn(0x7fbb040cca70 msgr2=0x7fbb040cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:38.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- 172.21.15.84:0/1748763468 shutdown_connections 2023-09-10T00:12:38.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- 172.21.15.84:0/1748763468 wait complete. 2023-09-10T00:12:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 Processor -- start 2023-09-10T00:12:38.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.384+0000 7fbb09e2a640 1 -- start start 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 0x7fbb040c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0406d250 0x7fbb040c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040c6a40 con 0x7fbb040afa40 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040ca670 con 0x7fbb0406d250 2023-09-10T00:12:38.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040c9ee0 con 0x7fbb0406a6e0 2023-09-10T00:12:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38108/0 (socket says 172.21.15.84:38108) 2023-09-10T00:12:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 -- 172.21.15.84:0/2415898619 learned_addr learned my addr 172.21.15.84:0/2415898619 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:38.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbafbfff640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0406d250 0x7fbb040c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb037fe640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 0x7fbb040c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 -- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 msgr2=0x7fbb040c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 0x7fbb040c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 -- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0406d250 msgr2=0x7fbb040c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0406d250 0x7fbb040c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 -- 172.21.15.84:0/2415898619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec009560 con 0x7fbb040afa40 2023-09-10T00:12:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb037fe640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 0x7fbb040c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb03fff640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00c770 tx=0x7fbafc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc006d60 con 0x7fbb040afa40 2023-09-10T00:12:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbafc00ce80 con 0x7fbb040afa40 2023-09-10T00:12:38.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb040ca8c0 con 0x7fbb040afa40 2023-09-10T00:12:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc003be0 con 0x7fbb040afa40 2023-09-10T00:12:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb040cae80 con 0x7fbb040afa40 2023-09-10T00:12:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb040712c0 con 0x7fbb040afa40 2023-09-10T00:12:38.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbafc003d40 con 0x7fbb040afa40 2023-09-10T00:12:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 0x7fbae4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbafc082d30 con 0x7fbb040afa40 2023-09-10T00:12:38.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb037fe640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 0x7fbae4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.388+0000 7fbb037fe640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 0x7fbae4067fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0af000 tx=0x7fbaec01b030 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:38.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.392+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbafc050a60 con 0x7fbb040afa40 2023-09-10T00:12:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.576+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb040ad6e0 con 0x7fbb040afa40 2023-09-10T00:12:38.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb00ff9640 1 -- 172.21.15.84:0/2415898619 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7fbafc054080 con 0x7fbb040afa40 2023-09-10T00:12:38.579 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:38.580 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-10T00:12:38.580 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2023-09-10T00:12:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 msgr2=0x7fbae4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 0x7fbae4067fe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0af000 tx=0x7fbaec01b030 comp rx=0 tx=0).stop 2023-09-10T00:12:38.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 msgr2=0x7fbb0414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00c770 tx=0x7fbafc00cc30 comp rx=0 tx=0).stop 2023-09-10T00:12:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 shutdown_connections 2023-09-10T00:12:38.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbae4065b20 0x7fbae4067fe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb040afa40 0x7fbb0414e160 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb0406d250 0x7fbb040c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 --2- 172.21.15.84:0/2415898619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb0406a6e0 0x7fbb040c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 >> 172.21.15.84:0/2415898619 conn(0x7fbb040cca70 msgr2=0x7fbb0415b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 shutdown_connections 2023-09-10T00:12:38.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.580+0000 7fbb09e2a640 1 -- 172.21.15.84:0/2415898619 wait complete. 2023-09-10T00:12:38.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/2110916445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa50c004d10 msgr2=0x7fa50c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 --2- 172.21.15.84:0/2110916445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa50c004d10 0x7fa50c005190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009eb0 tx=0x7fa51c01d590 comp rx=0 tx=0).stop 2023-09-10T00:12:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 -- 172.21.15.84:0/2110916445 reap_dead start 2023-09-10T00:12:38.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/2110916445 shutdown_connections 2023-09-10T00:12:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/2110916445 >> 172.21.15.84:0/2110916445 conn(0x7fa5240cd770 msgr2=0x7fa5240cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/2110916445 shutdown_connections 2023-09-10T00:12:38.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/2110916445 wait complete. 2023-09-10T00:12:38.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 Processor -- start 2023-09-10T00:12:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- start start 2023-09-10T00:12:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 0x7fa5241f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5240c3470 0x7fa5240c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52414d170 con 0x7fa5240ad3d0 2023-09-10T00:12:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c3e30 con 0x7fa5240c3470 2023-09-10T00:12:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240addc0 con 0x7fa50c004d10 2023-09-10T00:12:38.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38124/0 (socket says 172.21.15.84:38124) 2023-09-10T00:12:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 -- 172.21.15.84:0/514022973 learned_addr learned my addr 172.21.15.84:0/514022973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa5237fe640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 0x7fa5241f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 -- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 msgr2=0x7fa5241f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 0x7fa5241f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 -- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5240c3470 msgr2=0x7fa5240c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5240c3470 0x7fa5240c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 -- 172.21.15.84:0/514022973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52414d380 con 0x7fa5240ad3d0 2023-09-10T00:12:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa5237fe640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 0x7fa5241f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:38.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa523fff640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009eb0 tx=0x7fa51c0abf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0b6070 con 0x7fa5240ad3d0 2023-09-10T00:12:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa51c009200 con 0x7fa5240ad3d0 2023-09-10T00:12:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52414d660 con 0x7fa5240ad3d0 2023-09-10T00:12:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c004a50 con 0x7fa5240ad3d0 2023-09-10T00:12:38.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52414dc20 con 0x7fa5240ad3d0 2023-09-10T00:12:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.708+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52406e040 con 0x7fa5240ad3d0 2023-09-10T00:12:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.712+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa51c0a7040 con 0x7fa5240ad3d0 2023-09-10T00:12:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.712+0000 7fa50bfff640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 0x7fa510068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.712+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa51c11dce0 con 0x7fa5240ad3d0 2023-09-10T00:12:38.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.712+0000 7fa5237fe640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 0x7fa510068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.712+0000 7fa5237fe640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 0x7fa510068010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa518009aa0 tx=0x7fa5180091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.716+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa51c0eb8f0 con 0x7fa5240ad3d0 2023-09-10T00:12:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.868+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5240c4460 con 0x7fa5240ad3d0 2023-09-10T00:12:38.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa50bfff640 1 -- 172.21.15.84:0/514022973 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fa51c0c0070 con 0x7fa5240ad3d0 2023-09-10T00:12:38.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:38.871 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":17,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:30.398634+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:38.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 msgr2=0x7fa510068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 0x7fa510068010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa518009aa0 tx=0x7fa5180091e0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 msgr2=0x7fa5240ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:38.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa51c009eb0 tx=0x7fa51c0abf30 comp rx=0 tx=0).stop 2023-09-10T00:12:38.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 shutdown_connections 2023-09-10T00:12:38.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa510065b50 0x7fa510068010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa5240ad3d0 0x7fa5240ad880 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5240c3470 0x7fa5240c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 --2- 172.21.15.84:0/514022973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa50c004d10 0x7fa5241f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:38.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 >> 172.21.15.84:0/514022973 conn(0x7fa5240cd770 msgr2=0x7fa5240ab850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:38.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 shutdown_connections 2023-09-10T00:12:38.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:38.872+0000 7fa529d7f640 1 -- 172.21.15.84:0/514022973 wait complete. 2023-09-10T00:12:38.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-10T00:12:38.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:12:39.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- 172.21.15.84:0/1737453640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87e80047d0 msgr2=0x7f87e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 --2- 172.21.15.84:0/1737453640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87e80047d0 0x7f87e8004c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87f4006f30 tx=0x7f87f401cf20 comp rx=0 tx=0).stop 2023-09-10T00:12:39.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- 172.21.15.84:0/1737453640 shutdown_connections 2023-09-10T00:12:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 --2- 172.21.15.84:0/1737453640 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87e80047d0 0x7f87e8004c50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- 172.21.15.84:0/1737453640 >> 172.21.15.84:0/1737453640 conn(0x7f88000cd570 msgr2=0x7f88000cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- 172.21.15.84:0/1737453640 shutdown_connections 2023-09-10T00:12:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- 172.21.15.84:0/1737453640 wait complete. 2023-09-10T00:12:39.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 Processor -- start 2023-09-10T00:12:39.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- start start 2023-09-10T00:12:39.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87e80047d0 0x7f88001524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8800155c90 0x7f88001e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8800158560 con 0x7f88001e0f60 2023-09-10T00:12:39.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001e13e0 con 0x7f87e80047d0 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.020+0000 7f8806abd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800159030 con 0x7f8800155c90 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38150/0 (socket says 172.21.15.84:38150) 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 -- 172.21.15.84:0/2495152703 learned_addr learned my addr 172.21.15.84:0/2495152703 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f880505a640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8800155c90 0x7f88001e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8804859640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87e80047d0 0x7f88001524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 -- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8800155c90 msgr2=0x7f88001e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8800155c90 0x7f88001e5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 -- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87e80047d0 msgr2=0x7f88001524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87e80047d0 0x7f88001524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 -- 172.21.15.84:0/2495152703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800158790 con 0x7f88001e0f60 2023-09-10T00:12:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fffff640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87f401cd50 tx=0x7f87f4006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40b4040 con 0x7f88001e0f60 2023-09-10T00:12:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f87f4006450 con 0x7f88001e0f60 2023-09-10T00:12:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800158a70 con 0x7f88001e0f60 2023-09-10T00:12:39.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4003860 con 0x7f88001e0f60 2023-09-10T00:12:39.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88001e1e70 con 0x7f88001e0f60 2023-09-10T00:12:39.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880006c610 con 0x7f88001e0f60 2023-09-10T00:12:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f87f40039c0 con 0x7f88001e0f60 2023-09-10T00:12:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 0x7f87ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87f411d460 con 0x7f88001e0f60 2023-09-10T00:12:39.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8804859640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 0x7f87ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.024+0000 7f8804859640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 0x7f87ec067fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88000631b0 tx=0x7f87f00091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.028+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f87f40eb190 con 0x7f88001e0f60 2023-09-10T00:12:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.168+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88000c6e20 con 0x7f88001e0f60 2023-09-10T00:12:39.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.168+0000 7f87fd7fa640 1 -- 172.21.15.84:0/2495152703 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87f40c0020 con 0x7f88001e0f60 2023-09-10T00:12:39.170 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:12:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 msgr2=0x7f87ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 0x7f87ec067fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88000631b0 tx=0x7f87f00091e0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 msgr2=0x7f8800158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f87f401cd50 tx=0x7f87f4006040 comp rx=0 tx=0).stop 2023-09-10T00:12:39.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 shutdown_connections 2023-09-10T00:12:39.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f87ec065b20 0x7f87ec067fe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8800155c90 0x7f88001e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88001e0f60 0x7f8800158020 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 --2- 172.21.15.84:0/2495152703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87e80047d0 0x7f88001524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 >> 172.21.15.84:0/2495152703 conn(0x7f88000cd570 msgr2=0x7f8800154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 shutdown_connections 2023-09-10T00:12:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.172+0000 7f8806abd640 1 -- 172.21.15.84:0/2495152703 wait complete. 2023-09-10T00:12:39.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-10T00:12:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 -- 172.21.15.84:0/1387002000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce0806d250 msgr2=0x7fce0806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 --2- 172.21.15.84:0/1387002000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce0806d250 0x7fce0806fad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce0806daa0 tx=0x7fce0001cad0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 -- 172.21.15.84:0/1387002000 shutdown_connections 2023-09-10T00:12:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 --2- 172.21.15.84:0/1387002000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce0806d250 0x7fce0806fad0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 --2- 172.21.15.84:0/1387002000 >> v2:172.21.15.100:3300/0 conn(0x7fce0806a6e0 0x7fce080afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 -- 172.21.15.84:0/1387002000 >> 172.21.15.84:0/1387002000 conn(0x7fce080cca70 msgr2=0x7fce080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 -- 172.21.15.84:0/1387002000 shutdown_connections 2023-09-10T00:12:39.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.304+0000 7fce10235640 1 -- 172.21.15.84:0/1387002000 wait complete. 2023-09-10T00:12:39.308 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:12:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 Processor -- start 2023-09-10T00:12:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- start start 2023-09-10T00:12:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce0806a6e0 0x7fce080c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce0806d250 0x7fce081535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08155990 con 0x7fce080afa40 2023-09-10T00:12:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0815b880 con 0x7fce0806d250 2023-09-10T00:12:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce08155060 con 0x7fce0806a6e0 2023-09-10T00:12:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38166/0 (socket says 172.21.15.84:38166) 2023-09-10T00:12:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 -- 172.21.15.84:0/3305196924 learned_addr learned my addr 172.21.15.84:0/3305196924 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:39.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 -- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce0806a6e0 msgr2=0x7fce080c0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0dfd1640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce0806a6e0 0x7fce080c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0d7d0640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce0806d250 0x7fce081535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce0806a6e0 0x7fce080c0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 -- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce0806d250 msgr2=0x7fce081535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce0806d250 0x7fce081535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 -- 172.21.15.84:0/3305196924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce00009820 con 0x7fce080afa40 2023-09-10T00:12:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce0e7d2640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce0001c540 tx=0x7fce00009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00004040 con 0x7fce080afa40 2023-09-10T00:12:39.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce00004290 con 0x7fce080afa40 2023-09-10T00:12:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce08155340 con 0x7fce080afa40 2023-09-10T00:12:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00004600 con 0x7fce080afa40 2023-09-10T00:12:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce080c14f0 con 0x7fce080afa40 2023-09-10T00:12:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce080c16e0 con 0x7fce080afa40 2023-09-10T00:12:39.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.308+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fce00004760 con 0x7fce080afa40 2023-09-10T00:12:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.312+0000 7fcdfe7fc640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 0x7fcdec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.312+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce0011e390 con 0x7fce080afa40 2023-09-10T00:12:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.312+0000 7fce0dfd1640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 0x7fcdec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.312+0000 7fce0dfd1640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 0x7fcdec067fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce04000f70 tx=0x7fce04009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:12:39.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.316+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fce080c16e0 con 0x7fce080afa40 2023-09-10T00:12:39.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.460+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fce080c16e0 con 0x7fce080afa40 2023-09-10T00:12:39.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.460+0000 7fcdfe7fc640 1 -- 172.21.15.84:0/3305196924 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fce000b2060 con 0x7fce080afa40 2023-09-10T00:12:39.462 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:39.462 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-09-10T00:12:39.462 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:12:39.463 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-09-10T00:12:39.463 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-09-10T00:12:39.463 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:12:39.463 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-09-10T00:12:39.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 msgr2=0x7fcdec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 0x7fcdec067fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce04000f70 tx=0x7fce04009040 comp rx=0 tx=0).stop 2023-09-10T00:12:39.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 msgr2=0x7fce08153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce0001c540 tx=0x7fce00009280 comp rx=0 tx=0).stop 2023-09-10T00:12:39.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 shutdown_connections 2023-09-10T00:12:39.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcdec065b20 0x7fcdec067fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce080afa40 0x7fce08153ae0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce0806d250 0x7fce081535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 --2- 172.21.15.84:0/3305196924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce0806a6e0 0x7fce080c0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 >> 172.21.15.84:0/3305196924 conn(0x7fce080cca70 msgr2=0x7fce080ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:39.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 shutdown_connections 2023-09-10T00:12:39.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.464+0000 7fce10235640 1 -- 172.21.15.84:0/3305196924 wait complete. 2023-09-10T00:12:39.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-10T00:12:39.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-10T00:12:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 -- 172.21.15.84:0/3492862462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 msgr2=0x7fc1cc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 --2- 172.21.15.84:0/3492862462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc06c540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc06f4e0 tx=0x7fc1c801c830 comp rx=0 tx=0).stop 2023-09-10T00:12:39.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 -- 172.21.15.84:0/3492862462 shutdown_connections 2023-09-10T00:12:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 --2- 172.21.15.84:0/3492862462 >> v2:172.21.15.100:3300/0 conn(0x7fc1cc06ca80 0x7fc1cc0b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 --2- 172.21.15.84:0/3492862462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc06c540 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 -- 172.21.15.84:0/3492862462 >> 172.21.15.84:0/3492862462 conn(0x7fc1cc0c91a0 msgr2=0x7fc1cc0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 -- 172.21.15.84:0/3492862462 shutdown_connections 2023-09-10T00:12:39.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 -- 172.21.15.84:0/3492862462 wait complete. 2023-09-10T00:12:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.608+0000 7fc1d315c640 1 Processor -- start 2023-09-10T00:12:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- start start 2023-09-10T00:12:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc1cc069a00 0x7fc1cc070230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1cc06ca80 0x7fc1cc161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc1f25c0 con 0x7fc1cc1414a0 2023-09-10T00:12:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc1624d0 con 0x7fc1cc06ca80 2023-09-10T00:12:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc15c220 con 0x7fc1cc069a00 2023-09-10T00:12:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38186/0 (socket says 172.21.15.84:38186) 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 -- 172.21.15.84:0/867524320 learned_addr learned my addr 172.21.15.84:0/867524320 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d0ef8640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc1cc069a00 0x7fc1cc070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 -- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc1cc069a00 msgr2=0x7fc1cc070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc1cc069a00 0x7fc1cc070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 -- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1cc06ca80 msgr2=0x7fc1cc161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:39.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1cc06ca80 0x7fc1cc161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 -- 172.21.15.84:0/867524320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009560 con 0x7fc1cc1414a0 2023-09-10T00:12:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d16f9640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c780 tx=0x7fc1c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c400a9f0 con 0x7fc1cc1414a0 2023-09-10T00:12:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc1c400ac40 con 0x7fc1cc1414a0 2023-09-10T00:12:39.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc0708c0 con 0x7fc1cc1414a0 2023-09-10T00:12:39.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4012680 con 0x7fc1cc1414a0 2023-09-10T00:12:39.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc15c470 con 0x7fc1cc1414a0 2023-09-10T00:12:39.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc04d8c0 con 0x7fc1cc1414a0 2023-09-10T00:12:39.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc1c401a3b0 con 0x7fc1cc1414a0 2023-09-10T00:12:39.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 0x7fc1b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:39.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc1c4083370 con 0x7fc1cc1414a0 2023-09-10T00:12:39.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d0ef8640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 0x7fc1b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:39.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.612+0000 7fc1d0ef8640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 0x7fc1b8067fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80af000 tx=0x7fc1c801b070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:39.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.616+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc1c4051010 con 0x7fc1cc1414a0 2023-09-10T00:12:39.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:39.772+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc1cc0afb00 con 0x7fc1cc1414a0 2023-09-10T00:12:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1c17fa640 1 -- 172.21.15.84:0/867524320 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc1c4054630 con 0x7fc1cc1414a0 2023-09-10T00:12:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-09-10T00:12:40.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 msgr2=0x7fc1b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 0x7fc1b8067fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80af000 tx=0x7fc1c801b070 comp rx=0 tx=0).stop 2023-09-10T00:12:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 msgr2=0x7fc1cc1552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c780 tx=0x7fc1c400cc40 comp rx=0 tx=0).stop 2023-09-10T00:12:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 shutdown_connections 2023-09-10T00:12:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc1b8065b20 0x7fc1b8067fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1cc1414a0 0x7fc1cc1552a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1cc06ca80 0x7fc1cc161f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 --2- 172.21.15.84:0/867524320 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc1cc069a00 0x7fc1cc070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 >> 172.21.15.84:0/867524320 conn(0x7fc1cc0c91a0 msgr2=0x7fc1cc0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 shutdown_connections 2023-09-10T00:12:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.456+0000 7fc1d315c640 1 -- 172.21.15.84:0/867524320 wait complete. 2023-09-10T00:12:40.483 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-09-10T00:12:40.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- 172.21.15.84:0/3159105133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006bec0 msgr2=0x7fe00015ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:40.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3159105133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006bec0 0x7fe00015ad70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe000070640 tx=0x7fdff801c8a0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- 172.21.15.84:0/3159105133 shutdown_connections 2023-09-10T00:12:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3159105133 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006bec0 0x7fe00015ad70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3159105133 >> v2:172.21.15.100:3300/0 conn(0x7fe00006ba80 0x7fe00015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3159105133 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 0x7fe00006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- 172.21.15.84:0/3159105133 >> 172.21.15.84:0/3159105133 conn(0x7fe0000aec00 msgr2=0x7fe0000cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- 172.21.15.84:0/3159105133 shutdown_connections 2023-09-10T00:12:40.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- 172.21.15.84:0/3159105133 wait complete. 2023-09-10T00:12:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 Processor -- start 2023-09-10T00:12:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.612+0000 7fe0078ab640 1 -- start start 2023-09-10T00:12:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 0x7fe000149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 0x7fe00014a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00014fa60 con 0x7fe00006ba80 2023-09-10T00:12:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00014a770 con 0x7fe00006bec0 2023-09-10T00:12:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00014ebb0 con 0x7fe00006fa60 2023-09-10T00:12:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33188/0 (socket says 172.21.15.84:33188) 2023-09-10T00:12:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 -- 172.21.15.84:0/3031183615 learned_addr learned my addr 172.21.15.84:0/3031183615 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005e48640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 0x7fe00014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe004e46640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 0x7fe000149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 -- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 msgr2=0x7fe00014a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 0x7fe00014a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 -- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 msgr2=0x7fe000149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 0x7fe000149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 -- 172.21.15.84:0/3031183615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009560 con 0x7fe00006ba80 2023-09-10T00:12:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe004e46640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 0x7fe000149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe005647640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00ccb0 tx=0x7fdffc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00f450 con 0x7fe00006ba80 2023-09-10T00:12:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdffc00f6a0 con 0x7fe00006ba80 2023-09-10T00:12:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000163260 con 0x7fe00006ba80 2023-09-10T00:12:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc00fab0 con 0x7fe00006ba80 2023-09-10T00:12:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00014f0c0 con 0x7fe00006ba80 2023-09-10T00:12:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0000713a0 con 0x7fe00006ba80 2023-09-10T00:12:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdffc00fc10 con 0x7fe00006ba80 2023-09-10T00:12:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 0x7fdfe4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe004e46640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 0x7fdfe4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fdffc083a40 con 0x7fe00006ba80 2023-09-10T00:12:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.616+0000 7fe004e46640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 0x7fdfe4067fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe000153f90 tx=0x7fdff0008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.620+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdffc085e60 con 0x7fe00006ba80 2023-09-10T00:12:40.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:40.764+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe000163260 con 0x7fe00006ba80 2023-09-10T00:12:41.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.467+0000 7fdff5ffb640 1 -- 172.21.15.84:0/3031183615 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe000163260 con 0x7fe00006ba80 2023-09-10T00:12:41.469 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-09-10T00:12:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 msgr2=0x7fdfe4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 0x7fdfe4067fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe000153f90 tx=0x7fdff0008040 comp rx=0 tx=0).stop 2023-09-10T00:12:41.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 msgr2=0x7fe00014e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00ccb0 tx=0x7fdffc00a620 comp rx=0 tx=0).stop 2023-09-10T00:12:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 shutdown_connections 2023-09-10T00:12:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdfe4065b20 0x7fdfe4067fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe00006fa60 0x7fe00014a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe00006bec0 0x7fe000149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 --2- 172.21.15.84:0/3031183615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe00006ba80 0x7fe00014e670 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 >> 172.21.15.84:0/3031183615 conn(0x7fe0000aec00 msgr2=0x7fe00014d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 shutdown_connections 2023-09-10T00:12:41.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.471+0000 7fe0078ab640 1 -- 172.21.15.84:0/3031183615 wait complete. 2023-09-10T00:12:41.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-10T00:12:41.635 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- 172.21.15.84:0/3110404631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc1579d0 msgr2=0x7fcefc06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- 172.21.15.84:0/3110404631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc1579d0 0x7fcefc06bb20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0afde0 tx=0x7fceec01c7d0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- 172.21.15.84:0/3110404631 shutdown_connections 2023-09-10T00:12:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- 172.21.15.84:0/3110404631 >> v2:172.21.15.100:3300/0 conn(0x7fcefc15bc00 0x7fcefc06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.636 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- 172.21.15.84:0/3110404631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc1579d0 0x7fcefc06bb20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- 172.21.15.84:0/3110404631 >> 172.21.15.84:0/3110404631 conn(0x7fcefc0af230 msgr2=0x7fcefc0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- 172.21.15.84:0/3110404631 shutdown_connections 2023-09-10T00:12:41.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- 172.21.15.84:0/3110404631 wait complete. 2023-09-10T00:12:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 Processor -- start 2023-09-10T00:12:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- start start 2023-09-10T00:12:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcefc06cdc0 0x7fcefc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcefc1579d0 0x7fcefc1f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15a580 con 0x7fcefc15bc00 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc159620 con 0x7fcefc1579d0 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcf00c20640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc159900 con 0x7fcefc06cdc0 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33192/0 (socket says 172.21.15.84:33192) 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 -- 172.21.15.84:0/111711871 learned_addr learned my addr 172.21.15.84:0/111711871 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefa59c640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcefc06cdc0 0x7fcefc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:41.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcef9d9b640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcefc1579d0 0x7fcefc1f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:41.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 -- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcefc06cdc0 msgr2=0x7fcefc1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:41.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcefc06cdc0 0x7fcefc1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 -- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcefc1579d0 msgr2=0x7fcefc1f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcefc1579d0 0x7fcefc1f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.635+0000 7fcefad9d640 1 -- 172.21.15.84:0/111711871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec009560 con 0x7fcefc15bc00 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcefad9d640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcef400ca60 tx=0x7fcef400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4007d90 con 0x7fcefc15bc00 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcef4004b30 con 0x7fcefc15bc00 2023-09-10T00:12:41.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4005020 con 0x7fcefc15bc00 2023-09-10T00:12:41.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc159be0 con 0x7fcefc15bc00 2023-09-10T00:12:41.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc15a1a0 con 0x7fcefc15bc00 2023-09-10T00:12:41.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc06e0d0 con 0x7fcefc15bc00 2023-09-10T00:12:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcef4005180 con 0x7fcefc15bc00 2023-09-10T00:12:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 0x7fcedc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcef4083d00 con 0x7fcefc15bc00 2023-09-10T00:12:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcefa59c640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 0x7fcedc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.639+0000 7fcefa59c640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 0x7fcedc067fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceec0af000 tx=0x7fceec01b010 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:41.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.643+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcef40518d0 con 0x7fcefc15bc00 2023-09-10T00:12:41.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:41.831+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcefc0c7b00 con 0x7fcefc15bc00 2023-09-10T00:12:42.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.471+0000 7fceeaffd640 1 -- 172.21.15.84:0/111711871 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcef401d020 con 0x7fcefc15bc00 2023-09-10T00:12:42.472 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2023-09-10T00:12:42.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 msgr2=0x7fcedc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:42.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 0x7fcedc067fe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceec0af000 tx=0x7fceec01b010 comp rx=0 tx=0).stop 2023-09-10T00:12:42.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 msgr2=0x7fcefc1482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:42.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcef400ca60 tx=0x7fcef400cf20 comp rx=0 tx=0).stop 2023-09-10T00:12:42.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 shutdown_connections 2023-09-10T00:12:42.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcedc065b20 0x7fcedc067fe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcefc15bc00 0x7fcefc1482a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcefc1579d0 0x7fcefc1f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 --2- 172.21.15.84:0/111711871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcefc06cdc0 0x7fcefc1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 >> 172.21.15.84:0/111711871 conn(0x7fcefc0af230 msgr2=0x7fcefc0cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:42.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 shutdown_connections 2023-09-10T00:12:42.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.475+0000 7fcf00c20640 1 -- 172.21.15.84:0/111711871 wait complete. 2023-09-10T00:12:42.505 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-09-10T00:12:42.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-09-10T00:12:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/1174255278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 msgr2=0x7f1ddc0cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:42.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- 172.21.15.84:0/1174255278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc0cedb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009900 tx=0x7f1dd401c890 comp rx=0 tx=0).stop 2023-09-10T00:12:42.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/1174255278 shutdown_connections 2023-09-10T00:12:42.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- 172.21.15.84:0/1174255278 >> v2:172.21.15.100:3300/0 conn(0x7f1ddc06ba10 0x7f1ddc0b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- 172.21.15.84:0/1174255278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc0cedb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/1174255278 >> 172.21.15.84:0/1174255278 conn(0x7f1ddc0d0c20 msgr2=0x7f1ddc0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/1174255278 shutdown_connections 2023-09-10T00:12:42.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/1174255278 wait complete. 2023-09-10T00:12:42.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 Processor -- start 2023-09-10T00:12:42.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- start start 2023-09-10T00:12:42.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:42.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:42.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc15acc0 0x7f1ddc0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:42.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc14d9a0 con 0x7f1ddc06ba10 2023-09-10T00:12:42.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc14e010 con 0x7f1ddc15acc0 2023-09-10T00:12:42.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc14e2f0 con 0x7f1ddc0d05c0 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33206/0 (socket says 172.21.15.84:33206) 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 -- 172.21.15.84:0/726554878 learned_addr learned my addr 172.21.15.84:0/726554878 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddb7fe640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de08df640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc15acc0 0x7f1ddc0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:42.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 -- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 msgr2=0x7f1ddc14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 -- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc15acc0 msgr2=0x7f1ddc0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc15acc0 0x7f1ddc0c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:42.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 -- 172.21.15.84:0/726554878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4009560 con 0x7f1ddc06ba10 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddb7fe640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1ddbfff640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c7a0 tx=0x7f1dcc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc003b80 con 0x7f1ddc06ba10 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1dcc003ce0 con 0x7f1ddc06ba10 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc14e5d0 con 0x7f1ddc06ba10 2023-09-10T00:12:42.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.643+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00aab0 con 0x7f1ddc06ba10 2023-09-10T00:12:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc14eb90 con 0x7f1ddc06ba10 2023-09-10T00:12:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc14ed80 con 0x7f1ddc06ba10 2023-09-10T00:12:42.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1dcc00ac10 con 0x7f1ddc06ba10 2023-09-10T00:12:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1dd8ff9640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 0x7f1dc8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dcc0832f0 con 0x7f1ddc06ba10 2023-09-10T00:12:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1ddb7fe640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 0x7f1dc8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:42.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.647+0000 7f1ddb7fe640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 0x7f1dc8067fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc15d8c0 tx=0x7f1dd00091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:42.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.651+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1dcc050c30 con 0x7f1ddc06ba10 2023-09-10T00:12:42.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:42.811+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f1ddc0722f0 con 0x7f1ddc06ba10 2023-09-10T00:12:43.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.475+0000 7f1dd8ff9640 1 -- 172.21.15.84:0/726554878 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1dcc054250 con 0x7f1ddc06ba10 2023-09-10T00:12:43.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 msgr2=0x7f1dc8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:43.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 0x7f1dc8067fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc15d8c0 tx=0x7f1dd00091e0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 msgr2=0x7f1ddc0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:43.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c7a0 tx=0x7f1dcc00cc60 comp rx=0 tx=0).stop 2023-09-10T00:12:43.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 shutdown_connections 2023-09-10T00:12:43.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1dc8065b20 0x7f1dc8067fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc15acc0 0x7f1ddc0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1ddc0d05c0 0x7f1ddc14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 --2- 172.21.15.84:0/726554878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ddc06ba10 0x7f1ddc0ca620 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 >> 172.21.15.84:0/726554878 conn(0x7f1ddc0d0c20 msgr2=0x7f1ddc0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:43.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 shutdown_connections 2023-09-10T00:12:43.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.479+0000 7f1de2342640 1 -- 172.21.15.84:0/726554878 wait complete. 2023-09-10T00:12:43.502 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-09-10T00:12:43.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 -- 172.21.15.84:0/4034392728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 msgr2=0x7ffbe000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:43.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 --2- 172.21.15.84:0/4034392728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbe000b990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009e30 tx=0x7ffbec01d190 comp rx=0 tx=0).stop 2023-09-10T00:12:43.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 -- 172.21.15.84:0/4034392728 shutdown_connections 2023-09-10T00:12:43.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 --2- 172.21.15.84:0/4034392728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbe000b990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 -- 172.21.15.84:0/4034392728 >> 172.21.15.84:0/4034392728 conn(0x7ffbf40c9500 msgr2=0x7ffbf40c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 -- 172.21.15.84:0/4034392728 shutdown_connections 2023-09-10T00:12:43.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.643+0000 7ffbfae80640 1 -- 172.21.15.84:0/4034392728 wait complete. 2023-09-10T00:12:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 Processor -- start 2023-09-10T00:12:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- start start 2023-09-10T00:12:43.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbf414fdf0 0x7ffbf4157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffbf414f080 0x7ffbf40cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40c6450 con 0x7ffbe0005190 2023-09-10T00:12:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40c4360 con 0x7ffbf414fdf0 2023-09-10T00:12:43.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf40c3750 con 0x7ffbf414f080 2023-09-10T00:12:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33214/0 (socket says 172.21.15.84:33214) 2023-09-10T00:12:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 -- 172.21.15.84:0/3892317974 learned_addr learned my addr 172.21.15.84:0/3892317974 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf3fff640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbf414fdf0 0x7ffbf4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:43.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf941d640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffbf414f080 0x7ffbf40cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 -- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffbf414f080 msgr2=0x7ffbf40cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffbf414f080 0x7ffbf40cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 -- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbf414fdf0 msgr2=0x7ffbf4157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbf414fdf0 0x7ffbf4157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:43.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 -- 172.21.15.84:0/3892317974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf40c3a30 con 0x7ffbe0005190 2023-09-10T00:12:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf8c1c640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d780 tx=0x7ffbdc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0050d0 con 0x7ffbe0005190 2023-09-10T00:12:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffbdc005230 con 0x7ffbe0005190 2023-09-10T00:12:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf40c3d10 con 0x7ffbe0005190 2023-09-10T00:12:43.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc00b6c0 con 0x7ffbe0005190 2023-09-10T00:12:43.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf40c4d30 con 0x7ffbe0005190 2023-09-10T00:12:43.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf40712c0 con 0x7ffbe0005190 2023-09-10T00:12:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.647+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ffbdc00b820 con 0x7ffbe0005190 2023-09-10T00:12:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.651+0000 7ffbf17fa640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 0x7ffbd4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.651+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ffbdc083020 con 0x7ffbe0005190 2023-09-10T00:12:43.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.651+0000 7ffbf3fff640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 0x7ffbd4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:43.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.651+0000 7ffbf3fff640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 0x7ffbd4068010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffbf4157b20 tx=0x7ffbe4006070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:43.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.655+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ffbdc050890 con 0x7ffbe0005190 2023-09-10T00:12:43.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:43.807+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffbf406d510 con 0x7ffbe0005190 2023-09-10T00:12:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.543+0000 7ffbf17fa640 1 -- 172.21.15.84:0/3892317974 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7ffbdc019100 con 0x7ffbe0005190 2023-09-10T00:12:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' created 2023-09-10T00:12:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 msgr2=0x7ffbd4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 0x7ffbd4068010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffbf4157b20 tx=0x7ffbe4006070 comp rx=0 tx=0).stop 2023-09-10T00:12:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 msgr2=0x7ffbf40c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:45.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00d780 tx=0x7ffbdc00db80 comp rx=0 tx=0).stop 2023-09-10T00:12:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 shutdown_connections 2023-09-10T00:12:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ffbd4065b50 0x7ffbd4068010 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffbf414f080 0x7ffbf40cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbf414fdf0 0x7ffbf4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 --2- 172.21.15.84:0/3892317974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffbe0005190 0x7ffbf40c47f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 >> 172.21.15.84:0/3892317974 conn(0x7ffbf40c9500 msgr2=0x7ffbf40ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 shutdown_connections 2023-09-10T00:12:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.547+0000 7ffbfae80640 1 -- 172.21.15.84:0/3892317974 wait complete. 2023-09-10T00:12:45.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-09-10T00:12:45.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- 172.21.15.84:0/1939383544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae90071280 msgr2=0x7fae900c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:45.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 --2- 172.21.15.84:0/1939383544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae90071280 0x7fae900c9bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae80009900 tx=0x7fae8001c850 comp rx=0 tx=0).stop 2023-09-10T00:12:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- 172.21.15.84:0/1939383544 shutdown_connections 2023-09-10T00:12:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 --2- 172.21.15.84:0/1939383544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae90071280 0x7fae900c9bb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- 172.21.15.84:0/1939383544 >> 172.21.15.84:0/1939383544 conn(0x7fae900af240 msgr2=0x7fae900af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- 172.21.15.84:0/1939383544 shutdown_connections 2023-09-10T00:12:45.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- 172.21.15.84:0/1939383544 wait complete. 2023-09-10T00:12:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 Processor -- start 2023-09-10T00:12:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- start start 2023-09-10T00:12:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae90071280 0x7fae9014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:45.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 0x7fae90145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9014dc00 con 0x7fae900ac6b0 2023-09-10T00:12:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9014cff0 con 0x7fae90071280 2023-09-10T00:12:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae97856640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9014d2d0 con 0x7fae90157ac0 2023-09-10T00:12:45.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:45.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33236/0 (socket says 172.21.15.84:33236) 2023-09-10T00:12:45.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 -- 172.21.15.84:0/106781063 learned_addr learned my addr 172.21.15.84:0/106781063 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:45.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae95df3640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 0x7fae90145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:45.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae955f2640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae90071280 0x7fae9014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:45.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 -- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 msgr2=0x7fae90145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:45.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 0x7fae90145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 -- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae90071280 msgr2=0x7fae9014b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:45.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae90071280 0x7fae9014b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:45.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 -- 172.21.15.84:0/106781063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009560 con 0x7fae900ac6b0 2023-09-10T00:12:45.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae95df3640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 0x7fae90145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.703+0000 7fae94df1640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae80019460 tx=0x7fae800a56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80003800 con 0x7fae900ac6b0 2023-09-10T00:12:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fae800a58e0 con 0x7fae900ac6b0 2023-09-10T00:12:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80003cd0 con 0x7fae900ac6b0 2023-09-10T00:12:45.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9014d5b0 con 0x7fae900ac6b0 2023-09-10T00:12:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90144b90 con 0x7fae900ac6b0 2023-09-10T00:12:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae900722f0 con 0x7fae900ac6b0 2023-09-10T00:12:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fae800b4070 con 0x7fae900ac6b0 2023-09-10T00:12:45.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 0x7fae74068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fae8011de00 con 0x7fae900ac6b0 2023-09-10T00:12:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae955f2640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 0x7fae74068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:45.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.707+0000 7fae955f2640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 0x7fae74068010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00a790 tx=0x7fae8c008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:45.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.711+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fae800eb480 con 0x7fae900ac6b0 2023-09-10T00:12:45.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:45.863+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fae900716a0 con 0x7fae900ac6b0 2023-09-10T00:12:46.428 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T00:12:46.427+0000 7f6a65eda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-10T00:12:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.547+0000 7fae85ffb640 1 -- 172.21.15.84:0/106781063 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae800eeaa0 con 0x7fae900ac6b0 2023-09-10T00:12:46.548 INFO:teuthology.orchestra.run.smithi084.stderr:set pool 4 allow_ec_overwrites to true 2023-09-10T00:12:46.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 msgr2=0x7fae74068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 0x7fae74068010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fae8c00a790 tx=0x7fae8c008040 comp rx=0 tx=0).stop 2023-09-10T00:12:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 msgr2=0x7fae90148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:46.553 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae80019460 tx=0x7fae800a56f0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 shutdown_connections 2023-09-10T00:12:46.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fae74065b50 0x7fae74068010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae90157ac0 0x7fae90145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fae900ac6b0 0x7fae90148c80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 --2- 172.21.15.84:0/106781063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae90071280 0x7fae9014b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 >> 172.21.15.84:0/106781063 conn(0x7fae900af240 msgr2=0x7fae90151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:46.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 shutdown_connections 2023-09-10T00:12:46.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.551+0000 7fae97856640 1 -- 172.21.15.84:0/106781063 wait complete. 2023-09-10T00:12:46.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-09-10T00:12:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 -- 172.21.15.84:0/902873032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd406fa60 msgr2=0x7f6cd40ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/902873032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd406fa60 0x7f6cd40ca550 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009840 tx=0x7f6cc401c7d0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 -- 172.21.15.84:0/902873032 shutdown_connections 2023-09-10T00:12:46.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/902873032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd40cbd60 0x7f6cd41591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/902873032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd406fa60 0x7f6cd40ca550 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 -- 172.21.15.84:0/902873032 >> 172.21.15.84:0/902873032 conn(0x7f6cd40aec00 msgr2=0x7f6cd40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 -- 172.21.15.84:0/902873032 shutdown_connections 2023-09-10T00:12:46.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.711+0000 7f6cd9a90640 1 -- 172.21.15.84:0/902873032 wait complete. 2023-09-10T00:12:46.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 Processor -- start 2023-09-10T00:12:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- start start 2023-09-10T00:12:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd406fa60 0x7f6cd41391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 0x7f6cd413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:46.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd41554a0 con 0x7f6cd40cbd60 2023-09-10T00:12:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd413d070 con 0x7f6cd40af770 2023-09-10T00:12:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd413d350 con 0x7f6cd406fa60 2023-09-10T00:12:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33246/0 (socket says 172.21.15.84:33246) 2023-09-10T00:12:46.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 -- 172.21.15.84:0/1432569245 learned_addr learned my addr 172.21.15.84:0/1432569245 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd37fe640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd406fa60 0x7f6cd41391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd2ffd640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 0x7f6cd413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 -- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd406fa60 msgr2=0x7f6cd41391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd406fa60 0x7f6cd41391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 -- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 msgr2=0x7f6cd413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 0x7f6cd413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 -- 172.21.15.84:0/1432569245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0098e0 con 0x7f6cd40cbd60 2023-09-10T00:12:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd2ffd640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 0x7f6cd413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:12:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd3fff640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00ef20 tx=0x7f6ccc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc003980 con 0x7f6cd40cbd60 2023-09-10T00:12:46.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ccc003bd0 con 0x7f6cd40cbd60 2023-09-10T00:12:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004020 con 0x7f6cd40cbd60 2023-09-10T00:12:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc40094a0 con 0x7f6cd40cbd60 2023-09-10T00:12:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd4155130 con 0x7f6cd40cbd60 2023-09-10T00:12:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd4155650 con 0x7f6cd40cbd60 2023-09-10T00:12:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.715+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6ccc00a040 con 0x7f6cd40cbd60 2023-09-10T00:12:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.719+0000 7f6cbbfff640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 0x7f6cc0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.719+0000 7f6cd37fe640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 0x7f6cc0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.719+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6ccc083a90 con 0x7f6cd40cbd60 2023-09-10T00:12:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.719+0000 7f6cd37fe640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 0x7f6cc0067fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40af000 tx=0x7f6cc401b010 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.723+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6cd4155650 con 0x7f6cd40cbd60 2023-09-10T00:12:46.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:46.911+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f6cd40cc250 con 0x7f6cd40cbd60 2023-09-10T00:12:47.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.571+0000 7f6cbbfff640 1 -- 172.21.15.84:0/1432569245 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6ccc01a0b0 con 0x7f6cd40cbd60 2023-09-10T00:12:47.572 INFO:teuthology.orchestra.run.smithi084.stderr:added data pool 4 to fsmap 2023-09-10T00:12:47.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.571+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 msgr2=0x7f6cc0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.571+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 0x7f6cc0067fe0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40af000 tx=0x7f6cc401b010 comp rx=0 tx=0).stop 2023-09-10T00:12:47.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.571+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 msgr2=0x7f6cd40c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.571+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00ef20 tx=0x7f6ccc00c800 comp rx=0 tx=0).stop 2023-09-10T00:12:47.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 shutdown_connections 2023-09-10T00:12:47.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6cc0065b20 0x7f6cc0067fe0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6cd40cbd60 0x7f6cd40c8c30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cd40af770 0x7f6cd413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 --2- 172.21.15.84:0/1432569245 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6cd406fa60 0x7f6cd41391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 >> 172.21.15.84:0/1432569245 conn(0x7f6cd40aec00 msgr2=0x7f6cd415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:47.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 shutdown_connections 2023-09-10T00:12:47.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.575+0000 7f6cd9a90640 1 -- 172.21.15.84:0/1432569245 wait complete. 2023-09-10T00:12:47.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:12:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- 172.21.15.84:0/1538509512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0708005190 msgr2=0x7f070800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 --2- 172.21.15.84:0/1538509512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0708005190 0x7f070800b990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0718001da0 tx=0x7f071801cb20 comp rx=0 tx=0).stop 2023-09-10T00:12:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- 172.21.15.84:0/1538509512 shutdown_connections 2023-09-10T00:12:47.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 --2- 172.21.15.84:0/1538509512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0708005190 0x7f070800b990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- 172.21.15.84:0/1538509512 >> 172.21.15.84:0/1538509512 conn(0x7f07200b25b0 msgr2=0x7f07200b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:47.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- 172.21.15.84:0/1538509512 shutdown_connections 2023-09-10T00:12:47.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- 172.21.15.84:0/1538509512 wait complete. 2023-09-10T00:12:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 Processor -- start 2023-09-10T00:12:47.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.719+0000 7f072708d640 1 -- start start 2023-09-10T00:12:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0708005190 0x7f07201541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 0x7f07200c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:47.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072006afb0 con 0x7f07200c93b0 2023-09-10T00:12:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200ca9b0 con 0x7f0708005190 2023-09-10T00:12:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c6880 con 0x7f07200c6eb0 2023-09-10T00:12:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:47.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33262/0 (socket says 172.21.15.84:33262) 2023-09-10T00:12:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 -- 172.21.15.84:0/4158406297 learned_addr learned my addr 172.21.15.84:0/4158406297 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071ffff640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 0x7f07200c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f0724e29640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0708005190 0x7f07201541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:47.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 -- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 msgr2=0x7f07200c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 0x7f07200c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 -- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0708005190 msgr2=0x7f07201541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0708005190 0x7f07201541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 -- 172.21.15.84:0/4158406297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200c6340 con 0x7f07200c93b0 2023-09-10T00:12:47.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071ffff640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 0x7f07200c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:12:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072562a640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f071801c590 tx=0x7f07180a6f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718003b80 con 0x7f07200c93b0 2023-09-10T00:12:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0718003dd0 con 0x7f07200c93b0 2023-09-10T00:12:47.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718006380 con 0x7f07200c93b0 2023-09-10T00:12:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720154720 con 0x7f07200c93b0 2023-09-10T00:12:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07200c57c0 con 0x7f07200c93b0 2023-09-10T00:12:47.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072006c610 con 0x7f07200c93b0 2023-09-10T00:12:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f07180064e0 con 0x7f07200c93b0 2023-09-10T00:12:47.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 0x7f070c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:47.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f0724e29640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 0x7f070c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f071811ddc0 con 0x7f07200c93b0 2023-09-10T00:12:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.723+0000 7f0724e29640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 0x7f070c068010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f071000fad0 tx=0x7f071000f4b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:47.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.727+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f07180eb430 con 0x7f07200c93b0 2023-09-10T00:12:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0720073400 con 0x7f07200c93b0 2023-09-10T00:12:47.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f071d7fa640 1 -- 172.21.15.84:0/4158406297 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f07180eea50 con 0x7f07200c93b0 2023-09-10T00:12:47.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:47.917 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:12:46.913962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-10T00:12:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-09-10T00:12:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 msgr2=0x7f070c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 0x7f070c068010 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f071000fad0 tx=0x7f071000f4b0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 msgr2=0x7f07200c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f071801c590 tx=0x7f07180a6f00 comp rx=0 tx=0).stop 2023-09-10T00:12:47.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 shutdown_connections 2023-09-10T00:12:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f070c065b50 0x7f070c068010 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07200c93b0 0x7f07200c9830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f07200c6eb0 0x7f07200c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 --2- 172.21.15.84:0/4158406297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0708005190 0x7f07201541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:47.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 >> 172.21.15.84:0/4158406297 conn(0x7f07200b25b0 msgr2=0x7f07200b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 shutdown_connections 2023-09-10T00:12:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:47.915+0000 7f072708d640 1 -- 172.21.15.84:0/4158406297 wait complete. 2023-09-10T00:12:47.932 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:48.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/293739852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed80004d10 msgr2=0x7fed80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 --2- 172.21.15.84:0/293739852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed80004d10 0x7fed80005190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009e30 tx=0x7fed8c01d150 comp rx=0 tx=0).stop 2023-09-10T00:12:48.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 -- 172.21.15.84:0/293739852 reap_dead start 2023-09-10T00:12:48.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/293739852 shutdown_connections 2023-09-10T00:12:48.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/293739852 >> 172.21.15.84:0/293739852 conn(0x7fed940cca70 msgr2=0x7fed940cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/293739852 shutdown_connections 2023-09-10T00:12:48.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/293739852 wait complete. 2023-09-10T00:12:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 Processor -- start 2023-09-10T00:12:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- start start 2023-09-10T00:12:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 0x7fed940c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed94157650 0x7fed9414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9414e2e0 con 0x7fed9414ef30 2023-09-10T00:12:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9414f3b0 con 0x7fed9414cb70 2023-09-10T00:12:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed94157d60 con 0x7fed94157650 2023-09-10T00:12:48.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33280/0 (socket says 172.21.15.84:33280) 2023-09-10T00:12:48.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 -- 172.21.15.84:0/4248473091 learned_addr learned my addr 172.21.15.84:0/4248473091 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:48.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed8bfff640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed94157650 0x7fed9414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed9259c640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 0x7fed940c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 -- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed94157650 msgr2=0x7fed9414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed94157650 0x7fed9414e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 -- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 msgr2=0x7fed940c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 0x7fed940c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 -- 172.21.15.84:0/4248473091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94157ab0 con 0x7fed9414ef30 2023-09-10T00:12:48.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed9259c640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 0x7fed940c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed92d9d640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed8c002240 tx=0x7fed8c0ada10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0adc90 con 0x7fed9414ef30 2023-09-10T00:12:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fed8c004a50 con 0x7fed9414ef30 2023-09-10T00:12:48.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c004e00 con 0x7fed9414ef30 2023-09-10T00:12:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9414d940 con 0x7fed9414ef30 2023-09-10T00:12:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.043+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9414df00 con 0x7fed9414ef30 2023-09-10T00:12:48.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9414e420 con 0x7fed9414ef30 2023-09-10T00:12:48.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fed8c0b3070 con 0x7fed9414ef30 2023-09-10T00:12:48.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed8affd640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 0x7fed74067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed8c0a5e40 con 0x7fed9414ef30 2023-09-10T00:12:48.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed9259c640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 0x7fed74067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.047+0000 7fed9259c640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 0x7fed74067fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed84001060 tx=0x7fed84000bd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.051+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fed8c0ec3e0 con 0x7fed9414ef30 2023-09-10T00:12:48.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.203+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed940712c0 con 0x7fed9414ef30 2023-09-10T00:12:48.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.203+0000 7fed8affd640 1 -- 172.21.15.84:0/4248473091 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7fed8c0b1020 con 0x7fed9414ef30 2023-09-10T00:12:48.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:48.208 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:46.913510+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:48.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 msgr2=0x7fed74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 0x7fed74067fe0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed84001060 tx=0x7fed84000bd0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 msgr2=0x7fed940c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed8c002240 tx=0x7fed8c0ada10 comp rx=0 tx=0).stop 2023-09-10T00:12:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 shutdown_connections 2023-09-10T00:12:48.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fed74065b20 0x7fed74067fe0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fed9414ef30 0x7fed940c3740 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fed94157650 0x7fed9414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 --2- 172.21.15.84:0/4248473091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9414cb70 0x7fed940c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 >> 172.21.15.84:0/4248473091 conn(0x7fed940cca70 msgr2=0x7fed940ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 shutdown_connections 2023-09-10T00:12:48.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.207+0000 7fed98f22640 1 -- 172.21.15.84:0/4248473091 wait complete. 2023-09-10T00:12:48.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- 172.21.15.84:0/2779396790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 msgr2=0x7f7efc0c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- 172.21.15.84:0/2779396790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c95f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0cd770 tx=0x7f7eec01c880 comp rx=0 tx=0).stop 2023-09-10T00:12:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- 172.21.15.84:0/2779396790 shutdown_connections 2023-09-10T00:12:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- 172.21.15.84:0/2779396790 >> v2:172.21.15.100:3300/0 conn(0x7f7efc06cec0 0x7f7efc06d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- 172.21.15.84:0/2779396790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7efc0ace30 0x7f7efc0c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- 172.21.15.84:0/2779396790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c95f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- 172.21.15.84:0/2779396790 >> 172.21.15.84:0/2779396790 conn(0x7f7efc0ca240 msgr2=0x7f7efc0ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- 172.21.15.84:0/2779396790 shutdown_connections 2023-09-10T00:12:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- 172.21.15.84:0/2779396790 wait complete. 2023-09-10T00:12:48.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 Processor -- start 2023-09-10T00:12:48.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- start start 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7efc06cec0 0x7f7efc0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7efc0ace30 0x7f7efc151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c1890 con 0x7f7efc0aca50 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c1b70 con 0x7f7efc0ace30 2023-09-10T00:12:48.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7f018fb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c1e50 con 0x7f7efc06cec0 2023-09-10T00:12:48.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7efa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7efa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33296/0 (socket says 172.21.15.84:33296) 2023-09-10T00:12:48.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.351+0000 7f7efa7fc640 1 -- 172.21.15.84:0/1331679159 learned_addr learned my addr 172.21.15.84:0/1331679159 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:48.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 -- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7efc06cec0 msgr2=0x7f7efc0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7efc06cec0 0x7f7efc0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 -- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7efc0ace30 msgr2=0x7f7efc151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7efc0ace30 0x7f7efc151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 -- 172.21.15.84:0/1331679159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009560 con 0x7f7efc0aca50 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efa7fc640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0005d10 tx=0x7f7ef000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0009a30 con 0x7f7efc0aca50 2023-09-10T00:12:48.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ef0009c80 con 0x7f7efc0aca50 2023-09-10T00:12:48.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc0c2130 con 0x7f7efc0aca50 2023-09-10T00:12:48.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0005280 con 0x7f7efc0aca50 2023-09-10T00:12:48.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0c3e30 con 0x7f7efc0aca50 2023-09-10T00:12:48.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0caf90 con 0x7f7efc0aca50 2023-09-10T00:12:48.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7ef00053e0 con 0x7f7efc0aca50 2023-09-10T00:12:48.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 0x7f7ee8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ef00837d0 con 0x7f7efc0aca50 2023-09-10T00:12:48.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efaffd640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 0x7f7ee8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.355+0000 7f7efaffd640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 0x7f7ee8067fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0af000 tx=0x7f7eec019620 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.359+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7ef0050e30 con 0x7f7efc0aca50 2023-09-10T00:12:48.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.515+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7efc073400 con 0x7f7efc0aca50 2023-09-10T00:12:48.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.515+0000 7f7ee3fff640 1 -- 172.21.15.84:0/1331679159 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18347 (secure 0 0 0) 0x7f7ef0017090 con 0x7f7efc0aca50 2023-09-10T00:12:48.517 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:48.517 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:46.913510+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:48.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 msgr2=0x7f7ee8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 0x7f7ee8067fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0af000 tx=0x7f7eec019620 comp rx=0 tx=0).stop 2023-09-10T00:12:48.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 msgr2=0x7f7efc0c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0005d10 tx=0x7f7ef000dbb0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 shutdown_connections 2023-09-10T00:12:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7ee8065b20 0x7f7ee8067fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7efc0ace30 0x7f7efc151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7efc0aca50 0x7f7efc0c38f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 --2- 172.21.15.84:0/1331679159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7efc06cec0 0x7f7efc0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 >> 172.21.15.84:0/1331679159 conn(0x7f7efc0ca240 msgr2=0x7f7efc155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 shutdown_connections 2023-09-10T00:12:48.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.519+0000 7f7f018fb640 1 -- 172.21.15.84:0/1331679159 wait complete. 2023-09-10T00:12:48.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:12:48.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 -- 172.21.15.84:0/2128243835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 msgr2=0x7f7f400c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 --2- 172.21.15.84:0/2128243835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c01c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7f4006b120 tx=0x7f7f3001c870 comp rx=0 tx=0).stop 2023-09-10T00:12:48.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 -- 172.21.15.84:0/2128243835 shutdown_connections 2023-09-10T00:12:48.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 --2- 172.21.15.84:0/2128243835 >> v2:172.21.15.100:3300/0 conn(0x7f7f400b1cd0 0x7f7f4006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 --2- 172.21.15.84:0/2128243835 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 0x7f7f400b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 --2- 172.21.15.84:0/2128243835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c01c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 -- 172.21.15.84:0/2128243835 >> 172.21.15.84:0/2128243835 conn(0x7f7f400cca70 msgr2=0x7f7f400cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 -- 172.21.15.84:0/2128243835 shutdown_connections 2023-09-10T00:12:48.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.663+0000 7f7f456a0640 1 -- 172.21.15.84:0/2128243835 wait complete. 2023-09-10T00:12:48.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 Processor -- start 2023-09-10T00:12:48.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- start start 2023-09-10T00:12:48.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f400b1cd0 0x7f7f4014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 0x7f7f400c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f401528d0 con 0x7f7f40158a90 2023-09-10T00:12:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f40152b70 con 0x7f7f400b1cd0 2023-09-10T00:12:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f40152e50 con 0x7f7f400c0700 2023-09-10T00:12:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33312/0 (socket says 172.21.15.84:33312) 2023-09-10T00:12:48.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 -- 172.21.15.84:0/163839317 learned_addr learned my addr 172.21.15.84:0/163839317 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:48.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3effd640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f400b1cd0 0x7f7f4014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3e7fc640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 0x7f7f400c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 -- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 msgr2=0x7f7f400c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 0x7f7f400c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 -- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f400b1cd0 msgr2=0x7f7f4014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f400b1cd0 0x7f7f4014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 -- 172.21.15.84:0/163839317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30009560 con 0x7f7f40158a90 2023-09-10T00:12:48.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f3f7fe640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800ca60 tx=0x7f7f3800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3800adc0 con 0x7f7f40158a90 2023-09-10T00:12:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f38004c40 con 0x7f7f40158a90 2023-09-10T00:12:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f40153130 con 0x7f7f40158a90 2023-09-10T00:12:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38005280 con 0x7f7f40158a90 2023-09-10T00:12:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f400c62e0 con 0x7f7f40158a90 2023-09-10T00:12:48.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f400712c0 con 0x7f7f40158a90 2023-09-10T00:12:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.667+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7f380053e0 con 0x7f7f40158a90 2023-09-10T00:12:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.671+0000 7f7f277fe640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 0x7f7f2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.671+0000 7f7f3effd640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 0x7f7f2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.671+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f38083d80 con 0x7f7f40158a90 2023-09-10T00:12:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.671+0000 7f7f3effd640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 0x7f7f2c067fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f300af000 tx=0x7f7f3001b0b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.675+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7f38051470 con 0x7f7f40158a90 2023-09-10T00:12:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.847+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f40073400 con 0x7f7f40158a90 2023-09-10T00:12:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.847+0000 7f7f277fe640 1 -- 172.21.15.84:0/163839317 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f7f3801d020 con 0x7f7f40158a90 2023-09-10T00:12:48.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:48.850 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:12:46.913962+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-09-10T00:12:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 7 2023-09-10T00:12:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 msgr2=0x7f7f2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 0x7f7f2c067fe0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f300af000 tx=0x7f7f3001b0b0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 msgr2=0x7f7f400c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800ca60 tx=0x7f7f3800cf20 comp rx=0 tx=0).stop 2023-09-10T00:12:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 shutdown_connections 2023-09-10T00:12:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f2c065b20 0x7f7f2c067fe0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f40158a90 0x7f7f400c4600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f400c0700 0x7f7f400c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 --2- 172.21.15.84:0/163839317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f400b1cd0 0x7f7f4014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 >> 172.21.15.84:0/163839317 conn(0x7f7f400cca70 msgr2=0x7f7f400cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 shutdown_connections 2023-09-10T00:12:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.851+0000 7f7f456a0640 1 -- 172.21.15.84:0/163839317 wait complete. 2023-09-10T00:12:48.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:48.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- 172.21.15.84:0/1985269433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c440039d0 msgr2=0x7f8c44003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 --2- 172.21.15.84:0/1985269433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c440039d0 0x7f8c44003df0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00ac70 tx=0x7f8c4c01e070 comp rx=0 tx=0).stop 2023-09-10T00:12:48.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- 172.21.15.84:0/1985269433 shutdown_connections 2023-09-10T00:12:48.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 --2- 172.21.15.84:0/1985269433 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c440039d0 0x7f8c44003df0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- 172.21.15.84:0/1985269433 >> 172.21.15.84:0/1985269433 conn(0x7f8c5c0cca70 msgr2=0x7f8c5c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:48.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- 172.21.15.84:0/1985269433 shutdown_connections 2023-09-10T00:12:48.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- 172.21.15.84:0/1985269433 wait complete. 2023-09-10T00:12:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 Processor -- start 2023-09-10T00:12:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.975+0000 7f8c621e6640 1 -- start start 2023-09-10T00:12:48.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c440039d0 0x7f8c5c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 0x7f8c5c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c151310 con 0x7f8c5c158f50 2023-09-10T00:12:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0cbc30 con 0x7f8c5c0cb270 2023-09-10T00:12:48.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0c0510 con 0x7f8c440039d0 2023-09-10T00:12:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33336/0 (socket says 172.21.15.84:33336) 2023-09-10T00:12:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 -- 172.21.15.84:0/546013581 learned_addr learned my addr 172.21.15.84:0/546013581 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5b7fe640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c440039d0 0x7f8c5c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5bfff640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 0x7f8c5c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 -- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c440039d0 msgr2=0x7f8c5c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c440039d0 0x7f8c5c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 -- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 msgr2=0x7f8c5c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 0x7f8c5c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 -- 172.21.15.84:0/546013581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0c07f0 con 0x7f8c5c158f50 2023-09-10T00:12:48.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5bfff640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 0x7f8c5c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5affd640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000fc0 tx=0x7f8c5000fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50004220 con 0x7f8c5c158f50 2023-09-10T00:12:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c50004470 con 0x7f8c5c158f50 2023-09-10T00:12:48.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c0c0ad0 con 0x7f8c5c158f50 2023-09-10T00:12:48.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50011900 con 0x7f8c5c158f50 2023-09-10T00:12:48.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c0c1090 con 0x7f8c5c158f50 2023-09-10T00:12:48.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c0c4500 con 0x7f8c5c158f50 2023-09-10T00:12:48.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8c50011a60 con 0x7f8c5c158f50 2023-09-10T00:12:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 0x7f8c48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c50086930 con 0x7f8c5c158f50 2023-09-10T00:12:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5b7fe640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 0x7f8c48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:48.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.979+0000 7f8c5b7fe640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 0x7f8c48067fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0af000 tx=0x7f8c4c01ae10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:48.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:48.983+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8c5c0c4500 con 0x7f8c5c158f50 2023-09-10T00:12:49.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.127+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c5c0c44e0 con 0x7f8c5c158f50 2023-09-10T00:12:49.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.127+0000 7f8c43fff640 1 -- 172.21.15.84:0/546013581 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f8c50020090 con 0x7f8c5c158f50 2023-09-10T00:12:49.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:49.130 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 msgr2=0x7f8c48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 0x7f8c48067fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0af000 tx=0x7f8c4c01ae10 comp rx=0 tx=0).stop 2023-09-10T00:12:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 msgr2=0x7f8c5c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000fc0 tx=0x7f8c5000fa10 comp rx=0 tx=0).stop 2023-09-10T00:12:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 shutdown_connections 2023-09-10T00:12:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c48065b20 0x7f8c48067fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c5c0cb270 0x7f8c5c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c5c158f50 0x7f8c5c1593d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 --2- 172.21.15.84:0/546013581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c440039d0 0x7f8c5c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 >> 172.21.15.84:0/546013581 conn(0x7f8c5c0cca70 msgr2=0x7f8c5c0695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 shutdown_connections 2023-09-10T00:12:49.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.131+0000 7f8c621e6640 1 -- 172.21.15.84:0/546013581 wait complete. 2023-09-10T00:12:49.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-10T00:12:41.835038+0000', 'modified': '2023-09-10T00:12:46.913962+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4374': {'gid': 4374, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/1785947719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1785947719}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1785947719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-09-10T00:12:49.549 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-10T00:12:49.550 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-10T00:12:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/299510266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 msgr2=0x7f0fa00b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- 172.21.15.84:0/299510266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa00b0b40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00c8fd0 tx=0x7f0f9801caa0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/299510266 shutdown_connections 2023-09-10T00:12:49.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- 172.21.15.84:0/299510266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa00b0b40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- 172.21.15.84:0/299510266 >> v2:172.21.15.100:3300/0 conn(0x7f0fa0158bd0 0x7f0fa006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/299510266 >> 172.21.15.84:0/299510266 conn(0x7f0fa00c9500 msgr2=0x7f0fa00c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/299510266 shutdown_connections 2023-09-10T00:12:49.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/299510266 wait complete. 2023-09-10T00:12:49.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 Processor -- start 2023-09-10T00:12:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- start start 2023-09-10T00:12:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa00afe90 0x7f0fa00c0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 0x7f0fa0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c53d0 con 0x7f0fa00b06f0 2023-09-10T00:12:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c4a30 con 0x7f0fa00afe90 2023-09-10T00:12:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa00c4d10 con 0x7f0fa0158bd0 2023-09-10T00:12:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33350/0 (socket says 172.21.15.84:33350) 2023-09-10T00:12:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/1429647688 learned_addr learned my addr 172.21.15.84:0/1429647688 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9effd640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa00afe90 0x7f0fa00c0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 0x7f0fa0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 msgr2=0x7f0fa0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 0x7f0fa0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa00afe90 msgr2=0x7f0fa00c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa00afe90 0x7f0fa00c0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/1429647688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98009820 con 0x7f0fa00b06f0 2023-09-10T00:12:49.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 0x7f0fa0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:49.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c480 tx=0x7f0f8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f97fff640 1 -- 172.21.15.84:0/1429647688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88012830 con 0x7f0fa00b06f0 2023-09-10T00:12:49.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f97fff640 1 -- 172.21.15.84:0/1429647688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f88012a80 con 0x7f0fa00b06f0 2023-09-10T00:12:49.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa00c4ff0 con 0x7f0fa00b06f0 2023-09-10T00:12:49.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0f97fff640 1 -- 172.21.15.84:0/1429647688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88011380 con 0x7f0fa00b06f0 2023-09-10T00:12:49.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.687+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa0158020 con 0x7f0fa00b06f0 2023-09-10T00:12:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f97fff640 1 -- 172.21.15.84:0/1429647688 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0f880114e0 con 0x7f0fa00b06f0 2023-09-10T00:12:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f97fff640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 0x7f0f80067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f97fff640 1 -- 172.21.15.84:0/1429647688 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f88083570 con 0x7f0fa00b06f0 2023-09-10T00:12:49.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 0x7f0f80067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 0x7f0f80067fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f900058d0 tx=0x7f0f90005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 Processor -- start 2023-09-10T00:12:49.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 -- start start 2023-09-10T00:12:49.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db5065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5065b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb8510 con 0x562db50af120 2023-09-10T00:12:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb5a40 con 0x562db50afa40 2023-09-10T00:12:49.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb1330 con 0x562db5065740 2023-09-10T00:12:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33364/0 (socket says 172.21.15.84:33364) 2023-09-10T00:12:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 -- 172.21.15.84:0/4249367939 learned_addr learned my addr 172.21.15.84:0/4249367939 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db5065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 -- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 msgr2=0x562db5065b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5065b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 -- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 msgr2=0x562db5065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db5065200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 -- 172.21.15.84:0/4249367939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562db4bab890 con 0x562db50af120 2023-09-10T00:12:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f9effd640 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000fdf0 tx=0x7f0f90012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887dec716466c4dc server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f957fa640 1 -- 172.21.15.84:0/4249367939 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9001e450 con 0x562db50af120 2023-09-10T00:12:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f957fa640 1 -- 172.21.15.84:0/4249367939 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f9001e6a0 con 0x562db50af120 2023-09-10T00:12:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.691+0000 7f0f957fa640 1 -- 172.21.15.84:0/4249367939 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9001ea10 con 0x562db50af120 2023-09-10T00:12:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/4249367939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 msgr2=0x562db50af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000fdf0 tx=0x7f0f90012000 comp rx=0 tx=0).stop 2023-09-10T00:12:49.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/4249367939 shutdown_connections 2023-09-10T00:12:49.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5065b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db5065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/4249367939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db50af500 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/4249367939 >> 172.21.15.84:0/4249367939 conn(0x562db5067490 msgr2=0x562db505f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/4249367939 shutdown_connections 2023-09-10T00:12:49.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/4249367939 wait complete. 2023-09-10T00:12:49.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- start start 2023-09-10T00:12:49.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 Processor -- start 2023-09-10T00:12:49.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50af120 0x562db509c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db509ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4e6bed0 con 0x562db5065740 2023-09-10T00:12:49.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4e6bb70 con 0x562db50afa40 2023-09-10T00:12:49.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db4b6c940 con 0x562db50af120 2023-09-10T00:12:49.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 10 client.0 _ll_register_callbacks cb 0x562db4f7f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33378/0 (socket says 172.21.15.84:33378) 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 -- 172.21.15.84:0/2924187165 learned_addr learned my addr 172.21.15.84:0/2924187165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 -- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50af120 msgr2=0x562db509c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50af120 0x562db509c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 -- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 msgr2=0x562db509ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db509ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 -- 172.21.15.84:0/2924187165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9000fad0 con 0x562db5065740 2023-09-10T00:12:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9effd640 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000b810 tx=0x7f0f90028690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25d384e02c598d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:12:49.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9002d070 con 0x562db5065740 2023-09-10T00:12:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562db4e68880 con 0x562db5065740 2023-09-10T00:12:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f90028a10 con 0x562db5065740 2023-09-10T00:12:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f90028bd0 con 0x562db5065740 2023-09-10T00:12:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 10 client.4515 fetch_fsmap learned FSMap version 7 2023-09-10T00:12:49.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562db4e74290 con 0x562db5065740 2023-09-10T00:12:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x562db4e68880 con 0x562db5065740 2023-09-10T00:12:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0f90032470 con 0x562db5065740 2023-09-10T00:12:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 10 client.4515 fetch_fsmap finished waiting for FSMap version 7 2023-09-10T00:12:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 10 client.4515 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-10T00:12:49.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 20 client.4515 populate_metadata read hostname 'smithi084' 2023-09-10T00:12:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db509d8e0 0x562db50c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 4 client.4515 mds_command: new command op to 4374 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-10T00:12:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 --> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562db4e71700 con 0x562db509d8e0 2023-09-10T00:12:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db509d8e0 0x562db50c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f7e7fc640 10 client.4515 ms_handle_connect on v2:172.21.15.84:6836/1785947719 2023-09-10T00:12:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.695+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db509d8e0 0x562db50c03d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c6acf383eff257 server_cookie=5e241cb0312003af in_seq=0 out_seq=0 2023-09-10T00:12:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/2924187165 <== mds.0 v2:172.21.15.84:6836/1785947719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562db4e71700 con 0x562db509d8e0 2023-09-10T00:12:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0f7e7fc640 10 client.4515 handle_command_reply: tid=0 2023-09-10T00:12:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 client.4515 shutdown 2023-09-10T00:12:49.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 msgr2=0x562db509c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000b810 tx=0x7f0f90028690 comp rx=0 tx=0).stop 2023-09-10T00:12:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 shutdown_connections 2023-09-10T00:12:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db509d8e0 0x562db50c03d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50afa40 0x562db509ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50af120 0x562db509c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0f7e7fc640 0 client.4515 ms_handle_reset on v2:172.21.15.84:6836/1785947719 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2924187165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db5065740 0x562db509c450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 >> 172.21.15.84:0/2924187165 conn(0x562db5067490 msgr2=0x562db5066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 shutdown_connections 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2924187165 wait complete. 2023-09-10T00:12:49.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.699+0000 7f0fa8a65000 20 client.4515 trim_cache size 0 max 16384 2023-09-10T00:12:49.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.711+0000 7f0fa8a65000 1 Processor -- start 2023-09-10T00:12:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.711+0000 7f0fa8a65000 1 -- start start 2023-09-10T00:12:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5060270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50af120 0x562db509ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb6be0 con 0x562db50afa40 2023-09-10T00:12:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4eaeb40 con 0x562db50af120 2023-09-10T00:12:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb3e90 con 0x562db5065740 2023-09-10T00:12:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33386/0 (socket says 172.21.15.84:33386) 2023-09-10T00:12:49.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/2815426549 learned_addr learned my addr 172.21.15.84:0/2815426549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9effd640 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5060270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 msgr2=0x562db5060270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5060270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50af120 msgr2=0x562db509ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50af120 0x562db509ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 -- 172.21.15.84:0/2815426549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562db4e5a500 con 0x562db50afa40 2023-09-10T00:12:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b0040 tx=0x7f0f980a5880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767806c22a293d7d server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f95ffb640 1 -- 172.21.15.84:0/2815426549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980a5b70 con 0x562db50afa40 2023-09-10T00:12:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f95ffb640 1 -- 172.21.15.84:0/2815426549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f98004b40 con 0x562db50afa40 2023-09-10T00:12:49.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f95ffb640 1 -- 172.21.15.84:0/2815426549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98003980 con 0x562db50afa40 2023-09-10T00:12:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2815426549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 msgr2=0x562db509b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f980b0040 tx=0x7f0f980a5880 comp rx=0 tx=0).stop 2023-09-10T00:12:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2815426549 shutdown_connections 2023-09-10T00:12:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50afa40 0x562db509b1b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db50af120 0x562db509ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/2815426549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db5065740 0x562db5060270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2815426549 >> 172.21.15.84:0/2815426549 conn(0x562db5067490 msgr2=0x562db509a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2815426549 shutdown_connections 2023-09-10T00:12:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- 172.21.15.84:0/2815426549 wait complete. 2023-09-10T00:12:49.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- start start 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 Processor -- start 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db5065740 0x562db50c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50afa40 0x562db510db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4ef2c80 con 0x562db50af120 2023-09-10T00:12:49.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb5330 con 0x562db5065740 2023-09-10T00:12:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x562db4eb01c0 con 0x562db50afa40 2023-09-10T00:12:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0fa8a65000 10 client.0 _ll_register_callbacks cb 0x562db4e73d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:12:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33396/0 (socket says 172.21.15.84:33396) 2023-09-10T00:12:49.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/3021036062 learned_addr learned my addr 172.21.15.84:0/3021036062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9effd640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db5065740 0x562db50c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9f7fe640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50afa40 0x562db510db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50afa40 msgr2=0x562db510db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50afa40 0x562db510db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db5065740 msgr2=0x562db50c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:12:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db5065740 0x562db50c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 -- 172.21.15.84:0/3021036062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa00696e0 con 0x562db50af120 2023-09-10T00:12:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f9e7fc640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800ce40 tx=0x7f0f880012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0f801f290fc46 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.715+0000 7f0f7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:12:49.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8805c900 con 0x562db50af120 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f88051030 con 0x562db50af120 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562db506d700 con 0x562db50af120 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f880511f0 con 0x562db50af120 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 10 client.4521 fetch_fsmap learned FSMap version 7 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562db4babcc0 con 0x562db50af120 2023-09-10T00:12:49.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x562db506d700 con 0x562db50af120 2023-09-10T00:12:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f0f88022020 con 0x562db50af120 2023-09-10T00:12:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 10 client.4521 fetch_fsmap finished waiting for FSMap version 7 2023-09-10T00:12:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 10 client.4521 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-10T00:12:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 20 client.4521 populate_metadata read hostname 'smithi084' 2023-09-10T00:12:49.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db50c9790 0x562db50c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 4 client.4521 mds_command: new command op to 4374 tid=0[{"prefix": "status"}] 2023-09-10T00:12:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 --> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562db4eb7310 con 0x562db50c9790 2023-09-10T00:12:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f9effd640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db50c9790 0x562db50c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 10 client.4521 ms_handle_connect on v2:172.21.15.84:6836/1785947719 2023-09-10T00:12:49.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f9effd640 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db50c9790 0x562db50c9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352549f1719eae1f server_cookie=a9fed9568ce7a44 in_seq=0 out_seq=0 2023-09-10T00:12:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 1 -- 172.21.15.84:0/3021036062 <== mds.0 v2:172.21.15.84:6836/1785947719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562db4eb7310 con 0x562db50c9790 2023-09-10T00:12:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 10 client.4521 handle_command_reply: tid=0 2023-09-10T00:12:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 client.4521 shutdown 2023-09-10T00:12:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 msgr2=0x562db510d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800ce40 tx=0x7f0f880012e0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 shutdown_connections 2023-09-10T00:12:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x562db50c9790 0x562db50c9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x562db50afa40 0x562db510db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0f7e7fc640 0 client.4521 ms_handle_reset on v2:172.21.15.84:6836/1785947719 2023-09-10T00:12:49.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562db50af120 0x562db510d5c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 --2- 172.21.15.84:0/3021036062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562db5065740 0x562db50c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 >> 172.21.15.84:0/3021036062 conn(0x562db5067490 msgr2=0x562db505f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 shutdown_connections 2023-09-10T00:12:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 1 -- 172.21.15.84:0/3021036062 wait complete. 2023-09-10T00:12:49.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa8a65000 20 client.4521 trim_cache size 0 max 16384 2023-09-10T00:12:49.742 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:12:49.742 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "af9d6115-2022-4a0a-92c0-a49edd021b51", 2023-09-10T00:12:49.742 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4374, 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 7.2467812289999998, 2023-09-10T00:12:49.743 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 7, 2023-09-10T00:12:49.744 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-09-10T00:12:49.744 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 24, 2023-09-10T00:12:49.744 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 14.322547891999999 2023-09-10T00:12:49.744 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:12:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 msgr2=0x7f0f80067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 0x7f0f80067fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0f900058d0 tx=0x7f0f90005860 comp rx=0 tx=0).stop 2023-09-10T00:12:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 msgr2=0x7f0fa0159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c480 tx=0x7f0f8800c940 comp rx=0 tx=0).stop 2023-09-10T00:12:49.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 shutdown_connections 2023-09-10T00:12:49.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f80065b20 0x7f0f80067fe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0fa0158bd0 0x7f0fa0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fa00b06f0 0x7f0fa0159080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 --2- 172.21.15.84:0/1429647688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa00afe90 0x7f0fa00c0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 >> 172.21.15.84:0/1429647688 conn(0x7f0fa00c9500 msgr2=0x7f0fa0155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 shutdown_connections 2023-09-10T00:12:49.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.719+0000 7f0fa5938640 1 -- 172.21.15.84:0/1429647688 wait complete. 2023-09-10T00:12:49.748 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-10T00:12:49.749 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:49.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:12:49.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/3752087229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 msgr2=0x7f4bdc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/3752087229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bdc00b990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40c12c0 tx=0x7f4bec01cfc0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf3fff640 1 -- 172.21.15.84:0/3752087229 reap_dead start 2023-09-10T00:12:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/3752087229 shutdown_connections 2023-09-10T00:12:49.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/3752087229 >> 172.21.15.84:0/3752087229 conn(0x7f4bf40ca240 msgr2=0x7f4bf40ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/3752087229 shutdown_connections 2023-09-10T00:12:49.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/3752087229 wait complete. 2023-09-10T00:12:49.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 Processor -- start 2023-09-10T00:12:49.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- start start 2023-09-10T00:12:49.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bf40c7590 0x7f4bf40c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf40c3d30 0x7f4bf40ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40c33d0 con 0x7f4bdc005190 2023-09-10T00:12:49.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40ccfb0 con 0x7f4bf40c3d30 2023-09-10T00:12:49.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf41e3e60 con 0x7f4bf40c7590 2023-09-10T00:12:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33428/0 (socket says 172.21.15.84:33428) 2023-09-10T00:12:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 -- 172.21.15.84:0/2659303283 learned_addr learned my addr 172.21.15.84:0/2659303283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf2ffd640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bf40c7590 0x7f4bf40c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf3fff640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf40c3d30 0x7f4bf40ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 -- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bf40c7590 msgr2=0x7f4bf40c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bf40c7590 0x7f4bf40c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 -- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf40c3d30 msgr2=0x7f4bf40ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf40c3d30 0x7f4bf40ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:49.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 -- 172.21.15.84:0/2659303283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf41e4140 con 0x7f4bdc005190 2023-09-10T00:12:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf37fe640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4be400e590 tx=0x7f4be4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4010890 con 0x7f4bdc005190 2023-09-10T00:12:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4be4010b00 con 0x7f4bdc005190 2023-09-10T00:12:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4011460 con 0x7f4bdc005190 2023-09-10T00:12:49.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf41e4420 con 0x7f4bdc005190 2023-09-10T00:12:49.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.867+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf41e3b10 con 0x7f4bdc005190 2023-09-10T00:12:49.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4be40115c0 con 0x7f4bdc005190 2023-09-10T00:12:49.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf40caf90 con 0x7f4bdc005190 2023-09-10T00:12:49.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bdbfff640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 0x7f4be0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:49.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4be4083e00 con 0x7f4bdc005190 2023-09-10T00:12:49.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bf2ffd640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 0x7f4be0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:49.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.871+0000 7f4bf2ffd640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 0x7f4be0067fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40b33d0 tx=0x7f4be800d610 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:49.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:49.875+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4be4051440 con 0x7f4bdc005190 2023-09-10T00:12:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.047+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4bf40ad4f0 con 0x7f4bdc005190 2023-09-10T00:12:50.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.047+0000 7f4bdbfff640 1 -- 172.21.15.84:0/2659303283 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4be401f070 con 0x7f4bdc005190 2023-09-10T00:12:50.050 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-10T00:12:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 msgr2=0x7f4be0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 0x7f4be0067fe0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40b33d0 tx=0x7f4be800d610 comp rx=0 tx=0).stop 2023-09-10T00:12:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 msgr2=0x7f4bf40c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:50.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4be400e590 tx=0x7f4be4004f90 comp rx=0 tx=0).stop 2023-09-10T00:12:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 shutdown_connections 2023-09-10T00:12:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4be0065b20 0x7f4be0067fe0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bf40c3d30 0x7f4bf40ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bf40c7590 0x7f4bf40c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:50.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 --2- 172.21.15.84:0/2659303283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bdc005190 0x7f4bf40c7050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 >> 172.21.15.84:0/2659303283 conn(0x7f4bf40ca240 msgr2=0x7f4bf40c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 shutdown_connections 2023-09-10T00:12:50.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:50.051+0000 7f4bf9d27640 1 -- 172.21.15.84:0/2659303283 wait complete. 2023-09-10T00:12:50.067 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-09-10T00:12:50.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:12:50.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-10T00:12:50.068 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-09-10T00:12:50.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:50.069 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-09-10T00:12:50.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:12:50.069 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:12:50.070 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-09-10T00:12:50.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.070 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-10T00:12:50.076 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:12:50.076 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:12:50.076 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:12:50.077 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-09-10T00:12:50.078 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:12:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:12:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-09-10T00:12:50.078 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:12:50.078 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:12:50.079 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:12:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:12:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:12:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42506sec preferred_lft 42506sec 2023-09-10T00:12:50.079 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-09-10T00:12:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:12:50.080 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:12:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:d2:3e:84:82 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:12:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:12:50.080 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:12:50.081 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-10T00:12:50.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.082 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:12:50.082 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:12:50.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-09-10T00:12:50.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-09-10T00:12:50.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-09-10T00:12:50.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-10T00:12:50.084 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:12:50.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.152 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:12:50.206 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-10T00:12:50.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.208 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-10T00:12:50.284 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-10T00:12:50.284 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:12:50.284 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:12:50.284 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:12:50.285 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:12:50.285 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:12:50.285 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:12:50.285 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:12:50.285 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:12:50.286 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:12:50.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.287 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:12:50.287 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:12:50.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:12:50.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:12:50.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:12:50.288 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:12:50.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.353 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T00:12:50.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.399 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-10T00:12:50.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.447 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:12:50.447 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:12:50.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-10T00:12:50.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-09-10T00:12:50.448 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:12:50.510 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-09-10T00:12:50.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.511 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:12:50.512 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:12:50.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-09-10T00:12:50.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-10T00:12:50.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-09-10T00:12:50.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-09-10T00:12:50.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-09-10T00:12:50.513 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:12:50.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.608 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:12:50.608 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:12:50.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-10T00:12:50.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-09-10T00:12:50.609 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:12:50.626 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-09-10T00:12:50.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:12:50.627 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:50.674 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-09-10T00:12:50.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:12:50.675 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:50.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:12:50.773 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:12:50.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:12:50.825 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:12:50.826 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:12:50.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.827 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:12:50.874 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-10T00:12:50.875 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-09-10T00:12:50.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:12:50.933 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:12:50.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:12:50.983 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:12:50.984 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:12:50.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:50.985 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:12:51.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:2023-09-10T00:12:51.007+0000 7f554027b580 -1 init, newargv = 0x55df4bb03ed0 newargc=15 2023-09-10T00:12:51.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[44281]: starting ceph client 2023-09-10T00:12:51.014 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[44281]: starting fuse 2023-09-10T00:12:52.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:12:52.129 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:12:52.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:12:52.183 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:12:52.184 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:12:52.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:52.185 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:12:52.231 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:12:52.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-10T00:12:52.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:12:52.232 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-09-10T00:12:52.232 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-09-10T00:12:52.233 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-09-10T00:12:52.233 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-09-10T00:12:52.233 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:12:52.234 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-09-10T00:12:52.234 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-09-10T00:12:52.235 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-09-10T00:12:52.235 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-09-10T00:12:52.235 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:12:52.235 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-09-10T00:12:52.236 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-09-10T00:12:52.236 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-09-10T00:12:52.237 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-09-10T00:12:52.237 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:12:52.237 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-09-10T00:12:52.238 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:12:52.238 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:12:52.238 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:12:52.239 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-09-10T00:12:52.239 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-09-10T00:12:52.239 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-09-10T00:12:52.240 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:12:52.240 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:12:52.240 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.admin")) 2023-09-10T00:12:52.241 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-09-10T00:12:52.353 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.admin.44281.asok 2023-09-10T00:12:52.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:12:52.366 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44281.asok 2023-09-10T00:12:52.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:52.367 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44281.asok status 2023-09-10T00:12:52.512 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:12:52.512 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-09-10T00:12:52.512 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:12:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:12:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "admin", 2023-09-10T00:12:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-09-10T00:12:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-09-10T00:12:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "44281", 2023-09-10T00:12:52.514 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-09-10T00:12:52.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:12:52.514 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-09-10T00:12:52.514 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-09-10T00:12:52.514 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4533, 2023-09-10T00:12:52.515 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-09-10T00:12:52.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-09-10T00:12:52.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-09-10T00:12:52.515 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4533 2023-09-10T00:12:52.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:12:52.516 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:12:52.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:12:52.516 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:12:52.516 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 853727835 2023-09-10T00:12:52.516 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 853727835 2023-09-10T00:12:52.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:12:52.518 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4533 192.168.0.1:0/853727835", 2023-09-10T00:12:52.518 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/853727835", 2023-09-10T00:12:52.518 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-09-10T00:12:52.518 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 7, 2023-09-10T00:12:52.518 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-09-10T00:12:52.519 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:12:52.519 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-09-10T00:12:52.519 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-09-10T00:12:52.519 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:12:52.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:52.526 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-09-10T00:12:52.526 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:52.532 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-09-10T00:12:52.533 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:52.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:52.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:52.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:52.585 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-09-10T00:12:52.649 INFO:teuthology.orchestra.run.smithi084.stdout:# file: . 2023-09-10T00:12:52.649 INFO:teuthology.orchestra.run.smithi084.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-09-10T00:12:52.650 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:52.650 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:52.650 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:12:52.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/127606842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 msgr2=0x7f3e880b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/127606842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e880b1540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009900 tx=0x7f3e7c01c880 comp rx=0 tx=0).stop 2023-09-10T00:12:52.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/127606842 shutdown_connections 2023-09-10T00:12:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/127606842 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e880b1540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/127606842 >> 172.21.15.84:0/127606842 conn(0x7f3e880cca70 msgr2=0x7f3e880cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/127606842 shutdown_connections 2023-09-10T00:12:52.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/127606842 wait complete. 2023-09-10T00:12:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 Processor -- start 2023-09-10T00:12:52.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- start start 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 0x7f3e8814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e8815b5f0 0x7f3e880c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8814f6a0 con 0x7f3e880701e0 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8814f8d0 con 0x7f3e88157980 2023-09-10T00:12:52.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8814fbb0 con 0x7f3e8815b5f0 2023-09-10T00:12:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48664/0 (socket says 172.21.15.84:48664) 2023-09-10T00:12:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 -- 172.21.15.84:0/2638161863 learned_addr learned my addr 172.21.15.84:0/2638161863 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:52.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e86d9d640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e8815b5f0 0x7f3e880c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e85d9b640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 0x7f3e8814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 -- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e8815b5f0 msgr2=0x7f3e880c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e8815b5f0 0x7f3e880c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 -- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 msgr2=0x7f3e8814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 0x7f3e8814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:52.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 -- 172.21.15.84:0/2638161863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009560 con 0x7f3e880701e0 2023-09-10T00:12:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e85d9b640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 0x7f3e8814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8659c640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800c450 tx=0x7f3e7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78012830 con 0x7f3e880701e0 2023-09-10T00:12:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e78012aa0 con 0x7f3e880701e0 2023-09-10T00:12:52.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78011380 con 0x7f3e880701e0 2023-09-10T00:12:52.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8814fe90 con 0x7f3e880701e0 2023-09-10T00:12:52.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e88150450 con 0x7f3e880701e0 2023-09-10T00:12:52.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.867+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e88150640 con 0x7f3e880701e0 2023-09-10T00:12:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.871+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e780114e0 con 0x7f3e880701e0 2023-09-10T00:12:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.871+0000 7f3e76ffd640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 0x7f3e68067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:52.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.871+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3e78083780 con 0x7f3e880701e0 2023-09-10T00:12:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.871+0000 7f3e85d9b640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 0x7f3e68067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.871+0000 7f3e85d9b640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 0x7f3e68067fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0af000 tx=0x7f3e7c01b0c0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:52.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:52.875+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e78050d40 con 0x7f3e880701e0 2023-09-10T00:12:53.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.027+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e880c79a0 con 0x7f3e880701e0 2023-09-10T00:12:53.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.027+0000 7f3e76ffd640 1 -- 172.21.15.84:0/2638161863 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f3e78054360 con 0x7f3e880701e0 2023-09-10T00:12:53.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:53.031 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:53.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 msgr2=0x7f3e68067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 0x7f3e68067fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0af000 tx=0x7f3e7c01b0c0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 msgr2=0x7f3e88150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800c450 tx=0x7f3e7800c910 comp rx=0 tx=0).stop 2023-09-10T00:12:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 shutdown_connections 2023-09-10T00:12:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e68065b20 0x7f3e68067fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e8815b5f0 0x7f3e880c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e88157980 0x7f3e8814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 --2- 172.21.15.84:0/2638161863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e880701e0 0x7f3e88150970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 >> 172.21.15.84:0/2638161863 conn(0x7f3e880cca70 msgr2=0x7f3e88158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 shutdown_connections 2023-09-10T00:12:53.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.031+0000 7f3e8ce5f640 1 -- 172.21.15.84:0/2638161863 wait complete. 2023-09-10T00:12:53.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:12:53.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:12:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- 172.21.15.84:0/1641759399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 msgr2=0x7fe89c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/1641759399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c0ccbd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009900 tx=0x7fe88c01c890 comp rx=0 tx=0).stop 2023-09-10T00:12:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- 172.21.15.84:0/1641759399 shutdown_connections 2023-09-10T00:12:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/1641759399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c0ccbd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/1641759399 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- 172.21.15.84:0/1641759399 >> 172.21.15.84:0/1641759399 conn(0x7fe89c0af230 msgr2=0x7fe89c0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- 172.21.15.84:0/1641759399 shutdown_connections 2023-09-10T00:12:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- 172.21.15.84:0/1641759399 wait complete. 2023-09-10T00:12:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 Processor -- start 2023-09-10T00:12:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- start start 2023-09-10T00:12:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c0ac9d0 0x7fe89c1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15c120 con 0x7fe89c0b0db0 2023-09-10T00:12:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0c40e0 con 0x7fe89c0ac9d0 2023-09-10T00:12:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a41e6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c14a940 con 0x7fe89c158c60 2023-09-10T00:12:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.175+0000 7fe8a1781640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48684/0 (socket says 172.21.15.84:48684) 2023-09-10T00:12:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 -- 172.21.15.84:0/245859350 learned_addr learned my addr 172.21.15.84:0/245859350 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1f82640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c0ac9d0 0x7fe89c1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a2783640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 -- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 msgr2=0x7fe89c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 -- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c0ac9d0 msgr2=0x7fe89c1487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c0ac9d0 0x7fe89c1487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 -- 172.21.15.84:0/245859350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009560 con 0x7fe89c0b0db0 2023-09-10T00:12:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a2783640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1781640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0b0040 tx=0x7fe88c0a5750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c005230 con 0x7fe89c0b0db0 2023-09-10T00:12:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe88c005480 con 0x7fe89c0b0db0 2023-09-10T00:12:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0c3c50 con 0x7fe89c0b0db0 2023-09-10T00:12:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c004930 con 0x7fe89c0b0db0 2023-09-10T00:12:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c15be40 con 0x7fe89c0b0db0 2023-09-10T00:12:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c0c3a20 con 0x7fe89c0b0db0 2023-09-10T00:12:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe88c0b4070 con 0x7fe89c0b0db0 2023-09-10T00:12:53.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 0x7fe880068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe88c11d790 con 0x7fe89c0b0db0 2023-09-10T00:12:53.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1f82640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 0x7fe880068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.179+0000 7fe8a1f82640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 0x7fe880068010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe894009e70 tx=0x7fe894009850 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.183+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe89c0c3a20 con 0x7fe89c0b0db0 2023-09-10T00:12:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.335+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe89c0c3a20 con 0x7fe89c0b0db0 2023-09-10T00:12:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8927fc640 1 -- 172.21.15.84:0/245859350 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe88c0eae80 con 0x7fe89c0b0db0 2023-09-10T00:12:53.340 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:12:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 msgr2=0x7fe880068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 0x7fe880068010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe894009e70 tx=0x7fe894009850 comp rx=0 tx=0).stop 2023-09-10T00:12:53.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 msgr2=0x7fe89c159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0b0040 tx=0x7fe88c0a5750 comp rx=0 tx=0).stop 2023-09-10T00:12:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 shutdown_connections 2023-09-10T00:12:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe880065b50 0x7fe880068010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe89c158c60 0x7fe89c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe89c0b0db0 0x7fe89c159280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 --2- 172.21.15.84:0/245859350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c0ac9d0 0x7fe89c1487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 >> 172.21.15.84:0/245859350 conn(0x7fe89c0af230 msgr2=0x7fe89c0ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 shutdown_connections 2023-09-10T00:12:53.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.339+0000 7fe8a41e6640 1 -- 172.21.15.84:0/245859350 wait complete. 2023-09-10T00:12:53.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:12:53.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- 172.21.15.84:0/292495109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 msgr2=0x7fa86415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- 172.21.15.84:0/292495109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa86415b540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa854009930 tx=0x7fa85401c790 comp rx=0 tx=0).stop 2023-09-10T00:12:53.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- 172.21.15.84:0/292495109 shutdown_connections 2023-09-10T00:12:53.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- 172.21.15.84:0/292495109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa86415b540 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- 172.21.15.84:0/292495109 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 0x7fa8640ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- 172.21.15.84:0/292495109 >> 172.21.15.84:0/292495109 conn(0x7fa8640aec00 msgr2=0x7fa8640cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- 172.21.15.84:0/292495109 shutdown_connections 2023-09-10T00:12:53.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- 172.21.15.84:0/292495109 wait complete. 2023-09-10T00:12:53.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 Processor -- start 2023-09-10T00:12:53.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- start start 2023-09-10T00:12:53.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa86414eb10 0x7fa864145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 0x7fa8640cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864145850 con 0x7fa86406ccb0 2023-09-10T00:12:53.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86414f450 con 0x7fa86414eb10 2023-09-10T00:12:53.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa869e32640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86414f730 con 0x7fa864157f00 2023-09-10T00:12:53.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48694/0 (socket says 172.21.15.84:48694) 2023-09-10T00:12:53.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 -- 172.21.15.84:0/4005597301 learned_addr learned my addr 172.21.15.84:0/4005597301 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:53.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa863fff640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 0x7fa8640cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa862ffd640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa86414eb10 0x7fa864145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 -- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 msgr2=0x7fa8640cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 0x7fa8640cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 -- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa86414eb10 msgr2=0x7fa864145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.487+0000 7fa8637fe640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa86414eb10 0x7fa864145a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa8637fe640 1 -- 172.21.15.84:0/4005597301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854009560 con 0x7fa86406ccb0 2023-09-10T00:12:53.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa8637fe640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00e760 tx=0x7fa84c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c004260 con 0x7fa86406ccb0 2023-09-10T00:12:53.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa84c00ee70 con 0x7fa86406ccb0 2023-09-10T00:12:53.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86414fa10 con 0x7fa86406ccb0 2023-09-10T00:12:53.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0044d0 con 0x7fa86406ccb0 2023-09-10T00:12:53.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86414ffd0 con 0x7fa86406ccb0 2023-09-10T00:12:53.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8640713a0 con 0x7fa86406ccb0 2023-09-10T00:12:53.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa84c011710 con 0x7fa86406ccb0 2023-09-10T00:12:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 0x7fa844067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa84c085ee0 con 0x7fa86406ccb0 2023-09-10T00:12:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa862ffd640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 0x7fa844067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.491+0000 7fa862ffd640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 0x7fa844067fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8540af000 tx=0x7fa85401afd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.495+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa84c053600 con 0x7fa86406ccb0 2023-09-10T00:12:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.647+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8641636c0 con 0x7fa86406ccb0 2023-09-10T00:12:53.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.647+0000 7fa85bfff640 1 -- 172.21.15.84:0/4005597301 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa84c01f020 con 0x7fa86406ccb0 2023-09-10T00:12:53.651 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:12:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 msgr2=0x7fa844067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 0x7fa844067fe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8540af000 tx=0x7fa85401afd0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 msgr2=0x7fa864145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00e760 tx=0x7fa84c00ec20 comp rx=0 tx=0).stop 2023-09-10T00:12:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 shutdown_connections 2023-09-10T00:12:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa844065b20 0x7fa844067fe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa864157f00 0x7fa8640cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa86414eb10 0x7fa864145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 --2- 172.21.15.84:0/4005597301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa86406ccb0 0x7fa864145310 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 >> 172.21.15.84:0/4005597301 conn(0x7fa8640aec00 msgr2=0x7fa8640cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 shutdown_connections 2023-09-10T00:12:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.651+0000 7fa869e32640 1 -- 172.21.15.84:0/4005597301 wait complete. 2023-09-10T00:12:53.670 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:12:53.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 -- 172.21.15.84:0/2349157672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 msgr2=0x7f11c015b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 --2- 172.21.15.84:0/2349157672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c015b980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11c00704f0 tx=0x7f11b801ccd0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 -- 172.21.15.84:0/2349157672 shutdown_connections 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 --2- 172.21.15.84:0/2349157672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c015b980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 --2- 172.21.15.84:0/2349157672 >> v2:172.21.15.100:3300/0 conn(0x7f11c006cdc0 0x7f11c006d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 --2- 172.21.15.84:0/2349157672 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c01579d0 0x7f11c006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 -- 172.21.15.84:0/2349157672 >> 172.21.15.84:0/2349157672 conn(0x7f11c00af230 msgr2=0x7f11c00af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 -- 172.21.15.84:0/2349157672 shutdown_connections 2023-09-10T00:12:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.783+0000 7f11c783f640 1 -- 172.21.15.84:0/2349157672 wait complete. 2023-09-10T00:12:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 Processor -- start 2023-09-10T00:12:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- start start 2023-09-10T00:12:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c006cdc0 0x7f11c0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11c01579d0 0x7f11c0156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c015aa00 con 0x7f11c015b4f0 2023-09-10T00:12:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0159b70 con 0x7f11c01579d0 2023-09-10T00:12:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c00c7690 con 0x7f11c006cdc0 2023-09-10T00:12:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48712/0 (socket says 172.21.15.84:48712) 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 -- 172.21.15.84:0/2420822973 learned_addr learned my addr 172.21.15.84:0/2420822973 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c55db640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c006cdc0 0x7f11c0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 -- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c006cdc0 msgr2=0x7f11c0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c006cdc0 0x7f11c0151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 -- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11c01579d0 msgr2=0x7f11c0156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11c01579d0 0x7f11c0156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 -- 172.21.15.84:0/2420822973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80098e0 con 0x7f11c015b4f0 2023-09-10T00:12:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c5ddc640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009bd0 tx=0x7f11b80a5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003b90 con 0x7f11c015b4f0 2023-09-10T00:12:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f11b8003cf0 con 0x7f11c015b4f0 2023-09-10T00:12:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c015ae20 con 0x7f11c015b4f0 2023-09-10T00:12:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003ea0 con 0x7f11c015b4f0 2023-09-10T00:12:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c015a060 con 0x7f11c015b4f0 2023-09-10T00:12:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c015ab40 con 0x7f11c015b4f0 2023-09-10T00:12:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11b80b4040 con 0x7f11c015b4f0 2023-09-10T00:12:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 0x7f11a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11c55db640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 0x7f11a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.787+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11b811e250 con 0x7f11c015b4f0 2023-09-10T00:12:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.791+0000 7f11c55db640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 0x7f11a4067fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005d90 tx=0x7f11bc005ca0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.795+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11c015ab40 con 0x7f11c015b4f0 2023-09-10T00:12:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.935+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11c015ab40 con 0x7f11c015b4f0 2023-09-10T00:12:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11b5ffb640 1 -- 172.21.15.84:0/2420822973 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11c015ab40 con 0x7f11c015b4f0 2023-09-10T00:12:53.940 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:12:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 msgr2=0x7f11a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 0x7f11a4067fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005d90 tx=0x7f11bc005ca0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 msgr2=0x7f11c00c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009bd0 tx=0x7f11b80a5ad0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 shutdown_connections 2023-09-10T00:12:53.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f11a4065b20 0x7f11a4067fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11c015b4f0 0x7f11c00c30e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11c01579d0 0x7f11c0156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 --2- 172.21.15.84:0/2420822973 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11c006cdc0 0x7f11c0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 >> 172.21.15.84:0/2420822973 conn(0x7f11c00af230 msgr2=0x7f11c00ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:53.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 shutdown_connections 2023-09-10T00:12:53.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:53.939+0000 7f11c783f640 1 -- 172.21.15.84:0/2420822973 wait complete. 2023-09-10T00:12:53.956 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:12:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 -- 172.21.15.84:0/2066591768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 msgr2=0x7fccd415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 --2- 172.21.15.84:0/2066591768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd415b540 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fccd4070cb0 tx=0x7fccc401c7e0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 -- 172.21.15.84:0/2066591768 shutdown_connections 2023-09-10T00:12:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 --2- 172.21.15.84:0/2066591768 >> v2:172.21.15.100:3300/0 conn(0x7fccd4157f00 0x7fccd406c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 --2- 172.21.15.84:0/2066591768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd415b540 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 -- 172.21.15.84:0/2066591768 >> 172.21.15.84:0/2066591768 conn(0x7fccd40aec00 msgr2=0x7fccd40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 -- 172.21.15.84:0/2066591768 shutdown_connections 2023-09-10T00:12:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.067+0000 7fccda671640 1 -- 172.21.15.84:0/2066591768 wait complete. 2023-09-10T00:12:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 Processor -- start 2023-09-10T00:12:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- start start 2023-09-10T00:12:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd406cae0 0x7fccd4147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd4157f00 0x7fccd41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd412ab50 con 0x7fccd414eb10 2023-09-10T00:12:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd413efd0 con 0x7fccd406cae0 2023-09-10T00:12:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd4146a20 con 0x7fccd4157f00 2023-09-10T00:12:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48736/0 (socket says 172.21.15.84:48736) 2023-09-10T00:12:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 -- 172.21.15.84:0/2419717688 learned_addr learned my addr 172.21.15.84:0/2419717688 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccd8c0e640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd4157f00 0x7fccd41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 -- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd4157f00 msgr2=0x7fccd41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd4157f00 0x7fccd41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 -- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd406cae0 msgr2=0x7fccd4147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd406cae0 0x7fccd4147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 -- 172.21.15.84:0/2419717688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40094a0 con 0x7fccd414eb10 2023-09-10T00:12:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fcccb7fe640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c940 tx=0x7fccbc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc004220 con 0x7fccd414eb10 2023-09-10T00:12:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fccbc004470 con 0x7fccd414eb10 2023-09-10T00:12:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007bf0 con 0x7fccd414eb10 2023-09-10T00:12:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd406d3e0 con 0x7fccd414eb10 2023-09-10T00:12:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd4146fa0 con 0x7fccd414eb10 2023-09-10T00:12:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd40713a0 con 0x7fccd414eb10 2023-09-10T00:12:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.071+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fccbc007d50 con 0x7fccd414eb10 2023-09-10T00:12:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.075+0000 7fccd17fa640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 0x7fccb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.075+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccbc0839d0 con 0x7fccd414eb10 2023-09-10T00:12:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.075+0000 7fccd3fff640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 0x7fccb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.075+0000 7fccd3fff640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 0x7fccb4067fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccc40af000 tx=0x7fccc4019580 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.079+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fccbc0510c0 con 0x7fccd414eb10 2023-09-10T00:12:54.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.219+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fccd40ca800 con 0x7fccd414eb10 2023-09-10T00:12:54.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccd17fa640 1 -- 172.21.15.84:0/2419717688 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fccbc01d020 con 0x7fccd414eb10 2023-09-10T00:12:54.223 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:12:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 msgr2=0x7fccb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 0x7fccb4067fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fccc40af000 tx=0x7fccc4019580 comp rx=0 tx=0).stop 2023-09-10T00:12:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 msgr2=0x7fccd413ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00c940 tx=0x7fccbc00ce00 comp rx=0 tx=0).stop 2023-09-10T00:12:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 shutdown_connections 2023-09-10T00:12:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccb4065b20 0x7fccb4067fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd4157f00 0x7fccd41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccd414eb10 0x7fccd413ea90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 --2- 172.21.15.84:0/2419717688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd406cae0 0x7fccd4147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 >> 172.21.15.84:0/2419717688 conn(0x7fccd40aec00 msgr2=0x7fccd406bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 shutdown_connections 2023-09-10T00:12:54.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.223+0000 7fccda671640 1 -- 172.21.15.84:0/2419717688 wait complete. 2023-09-10T00:12:54.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:12:54.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- 172.21.15.84:0/789892404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6d4004d10 msgr2=0x7fe6d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/789892404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6d4004d10 0x7fe6d4005190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4001da0 tx=0x7fe6e401cb20 comp rx=0 tx=0).stop 2023-09-10T00:12:54.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 -- 172.21.15.84:0/789892404 reap_dead start 2023-09-10T00:12:54.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- 172.21.15.84:0/789892404 shutdown_connections 2023-09-10T00:12:54.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- 172.21.15.84:0/789892404 >> 172.21.15.84:0/789892404 conn(0x7fe6ec0c9500 msgr2=0x7fe6ec0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- 172.21.15.84:0/789892404 shutdown_connections 2023-09-10T00:12:54.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- 172.21.15.84:0/789892404 wait complete. 2023-09-10T00:12:54.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 Processor -- start 2023-09-10T00:12:54.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- start start 2023-09-10T00:12:54.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe6ec150b50 0x7fe6ec0c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec1dfd30 0x7fe6ec158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec159220 con 0x7fe6ec158d70 2023-09-10T00:12:54.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec150f30 con 0x7fe6ec1dfd30 2023-09-10T00:12:54.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f25aa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0c1fb0 con 0x7fe6ec150b50 2023-09-10T00:12:54.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48752/0 (socket says 172.21.15.84:48752) 2023-09-10T00:12:54.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 -- 172.21.15.84:0/3582483839 learned_addr learned my addr 172.21.15.84:0/3582483839 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:54.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6ebfff640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe6ec150b50 0x7fe6ec0c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 -- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe6ec150b50 msgr2=0x7fe6ec0c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6eb7fe640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec1dfd30 0x7fe6ec158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe6ec150b50 0x7fe6ec0c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 -- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec1dfd30 msgr2=0x7fe6ec158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec1dfd30 0x7fe6ec158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.355+0000 7fe6f0b47640 1 -- 172.21.15.84:0/3582483839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec0c2290 con 0x7fe6ec158d70 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6f0b47640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40aa040 tx=0x7fe6e40a7ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4006c70 con 0x7fe6ec158d70 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe6e40a5930 con 0x7fe6ec158d70 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec0c2570 con 0x7fe6ec158d70 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40a5d00 con 0x7fe6ec158d70 2023-09-10T00:12:54.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec0c2b30 con 0x7fe6ec158d70 2023-09-10T00:12:54.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec0c2d20 con 0x7fe6ec158d70 2023-09-10T00:12:54.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe6e40b5070 con 0x7fe6ec158d70 2023-09-10T00:12:54.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 0x7fe6d8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe6e40aa070 con 0x7fe6ec158d70 2023-09-10T00:12:54.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6ebfff640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 0x7fe6d8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.359+0000 7fe6ebfff640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 0x7fe6d8068010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc004780 tx=0x7fe6dc0095a0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.363+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe6e40eb0c0 con 0x7fe6ec158d70 2023-09-10T00:12:54.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.527+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6ec073390 con 0x7fe6ec158d70 2023-09-10T00:12:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.527+0000 7fe6e8ff9640 1 -- 172.21.15.84:0/3582483839 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe6e40a5e60 con 0x7fe6ec158d70 2023-09-10T00:12:54.530 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:12:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 msgr2=0x7fe6d8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 0x7fe6d8068010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc004780 tx=0x7fe6dc0095a0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 msgr2=0x7fe6ec0bffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40aa040 tx=0x7fe6e40a7ee0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 shutdown_connections 2023-09-10T00:12:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe6d8065b50 0x7fe6d8068010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe6ec158d70 0x7fe6ec0bffe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6ec1dfd30 0x7fe6ec158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 --2- 172.21.15.84:0/3582483839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe6ec150b50 0x7fe6ec0c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 >> 172.21.15.84:0/3582483839 conn(0x7fe6ec0c9500 msgr2=0x7fe6ec154770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 shutdown_connections 2023-09-10T00:12:54.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.531+0000 7fe6f25aa640 1 -- 172.21.15.84:0/3582483839 wait complete. 2023-09-10T00:12:54.548 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:12:54.548 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:12:54.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:12:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1246278473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc15ab80 msgr2=0x7fd1dc0cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1246278473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc15ab80 0x7fd1dc0cbb20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc01eff0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1246278473 shutdown_connections 2023-09-10T00:12:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1246278473 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc0afba0 0x7fd1dc0cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1246278473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc15ab80 0x7fd1dc0cbb20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1246278473 >> 172.21.15.84:0/1246278473 conn(0x7fd1dc0b25b0 msgr2=0x7fd1dc0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1246278473 shutdown_connections 2023-09-10T00:12:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1246278473 wait complete. 2023-09-10T00:12:54.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 Processor -- start 2023-09-10T00:12:54.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- start start 2023-09-10T00:12:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 0x7fd1dc0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 0x7fd1dc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c83c0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c86a0 con 0x7fd1dc15af60 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c8980 con 0x7fd1dc15ab80 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48766/0 (socket says 172.21.15.84:48766) 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 -- 172.21.15.84:0/1672448142 learned_addr learned my addr 172.21.15.84:0/1672448142 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1db7fe640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 0x7fd1dc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 -- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 msgr2=0x7fd1dc0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1d27fc640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 0x7fd1dc0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 0x7fd1dc0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 -- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 msgr2=0x7fd1dc0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 0x7fd1dc0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 -- 172.21.15.84:0/1672448142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0094a0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1d27fc640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 0x7fd1dc0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1db7fe640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 0x7fd1dc0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1daffd640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01cc20 tx=0x7fd1cc0b1890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0bd070 con 0x7fd1dc0afba0 2023-09-10T00:12:54.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd1cc0b1c30 con 0x7fd1dc0afba0 2023-09-10T00:12:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0c8c60 con 0x7fd1dc0afba0 2023-09-10T00:12:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc005030 con 0x7fd1dc0afba0 2023-09-10T00:12:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.715+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc0c80d0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc073400 con 0x7fd1dc0afba0 2023-09-10T00:12:54.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd1cc0b7040 con 0x7fd1dc0afba0 2023-09-10T00:12:54.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1d3fff640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 0x7fd1bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:54.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1cc1211b0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1d27fc640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 0x7fd1bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:54.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.719+0000 7fd1d27fc640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 0x7fd1bc067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc15dad0 tx=0x7fd1c4009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:54.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.723+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd1cc0ee7f0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.863+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1dc15a3d0 con 0x7fd1dc0afba0 2023-09-10T00:12:54.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.867+0000 7fd1d3fff640 1 -- 172.21.15.84:0/1672448142 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fd1cc0f1e10 con 0x7fd1dc0afba0 2023-09-10T00:12:54.869 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:12:54.870 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:12:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 msgr2=0x7fd1bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 0x7fd1bc067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc15dad0 tx=0x7fd1c4009040 comp rx=0 tx=0).stop 2023-09-10T00:12:54.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 msgr2=0x7fd1dc1f3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc01cc20 tx=0x7fd1cc0b1890 comp rx=0 tx=0).stop 2023-09-10T00:12:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 shutdown_connections 2023-09-10T00:12:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd1bc065b20 0x7fd1bc067fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1dc15af60 0x7fd1dc0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd1dc15ab80 0x7fd1dc0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 --2- 172.21.15.84:0/1672448142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd1dc0afba0 0x7fd1dc1f3d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 >> 172.21.15.84:0/1672448142 conn(0x7fd1dc0b25b0 msgr2=0x7fd1dc0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 shutdown_connections 2023-09-10T00:12:54.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:54.871+0000 7fd1e153b640 1 -- 172.21.15.84:0/1672448142 wait complete. 2023-09-10T00:12:54.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:12:54.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:12:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- 172.21.15.84:0/38222581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0b2570 msgr2=0x7fa2ec0b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- 172.21.15.84:0/38222581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0b2570 0x7fa2ec0b2950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009900 tx=0x7fa2e801f0b0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- 172.21.15.84:0/38222581 shutdown_connections 2023-09-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- 172.21.15.84:0/38222581 >> v2:172.21.15.100:3300/0 conn(0x7fa2ec0cefd0 0x7fa2ec069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- 172.21.15.84:0/38222581 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0b2570 0x7fa2ec0b2950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- 172.21.15.84:0/38222581 >> 172.21.15.84:0/38222581 conn(0x7fa2ec0cd570 msgr2=0x7fa2ec0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- 172.21.15.84:0/38222581 shutdown_connections 2023-09-10T00:12:55.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- 172.21.15.84:0/38222581 wait complete. 2023-09-10T00:12:55.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 Processor -- start 2023-09-10T00:12:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- start start 2023-09-10T00:12:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2ec0b2570 0x7fa2ec1e2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0ceb70 0x7fa2ec1e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1514a0 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1e40c0 con 0x7fa2ec0b2570 2023-09-10T00:12:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f343d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1e43a0 con 0x7fa2ec0ceb70 2023-09-10T00:12:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48782/0 (socket says 172.21.15.84:48782) 2023-09-10T00:12:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 -- 172.21.15.84:0/210450874 learned_addr learned my addr 172.21.15.84:0/210450874 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f11d9640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2ec0b2570 0x7fa2ec1e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f09d8640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0ceb70 0x7fa2ec1e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 -- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0ceb70 msgr2=0x7fa2ec1e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0ceb70 0x7fa2ec1e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 -- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2ec0b2570 msgr2=0x7fa2ec1e2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2ec0b2570 0x7fa2ec1e2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.003+0000 7fa2f19da640 1 -- 172.21.15.84:0/210450874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8009560 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f19da640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400eb20 tx=0x7fa2e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4004b30 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2e4004cb0 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec1e4680 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4005280 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec1e4c40 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec1e4e60 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa2e40053e0 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 0x7fa2d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2e4014070 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f11d9640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 0x7fa2d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.007+0000 7fa2f11d9640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 0x7fa2d0067fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80b2000 tx=0x7fa2e801d8f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.011+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa2e40519a0 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.151+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2ec073400 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.151+0000 7fa2e1ffb640 1 -- 172.21.15.84:0/210450874 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2e4054fc0 con 0x7fa2ec0cefd0 2023-09-10T00:12:55.156 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:12:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 msgr2=0x7fa2d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 0x7fa2d0067fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80b2000 tx=0x7fa2e801d8f0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 msgr2=0x7fa2ec1e3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400eb20 tx=0x7fa2e400c2d0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 shutdown_connections 2023-09-10T00:12:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa2d0065b20 0x7fa2d0067fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa2ec0cefd0 0x7fa2ec1e3a40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2ec0ceb70 0x7fa2ec1e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 --2- 172.21.15.84:0/210450874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2ec0b2570 0x7fa2ec1e2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 >> 172.21.15.84:0/210450874 conn(0x7fa2ec0cd570 msgr2=0x7fa2ec0c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 shutdown_connections 2023-09-10T00:12:55.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.155+0000 7fa2f343d640 1 -- 172.21.15.84:0/210450874 wait complete. 2023-09-10T00:12:55.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:12:55.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 -- 172.21.15.84:0/797002493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ab80 msgr2=0x7f221415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 --2- 172.21.15.84:0/797002493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ab80 0x7f221415b540 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f220c009bc0 tx=0x7f220c01cb40 comp rx=0 tx=0).stop 2023-09-10T00:12:55.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 -- 172.21.15.84:0/797002493 shutdown_connections 2023-09-10T00:12:55.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 --2- 172.21.15.84:0/797002493 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ab80 0x7f221415b540 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 -- 172.21.15.84:0/797002493 >> 172.21.15.84:0/797002493 conn(0x7f22140aec00 msgr2=0x7f22140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 -- 172.21.15.84:0/797002493 shutdown_connections 2023-09-10T00:12:55.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.287+0000 7f2218fcb640 1 -- 172.21.15.84:0/797002493 wait complete. 2023-09-10T00:12:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 Processor -- start 2023-09-10T00:12:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- start start 2023-09-10T00:12:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f221406ab80 0x7f2214144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 0x7f2214151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22141465a0 con 0x7f221406ccb0 2023-09-10T00:12:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214145990 con 0x7f221414eb10 2023-09-10T00:12:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2214145c70 con 0x7f221406ab80 2023-09-10T00:12:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48794/0 (socket says 172.21.15.84:48794) 2023-09-10T00:12:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 -- 172.21.15.84:0/2152420865 learned_addr learned my addr 172.21.15.84:0/2152420865 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f221259c640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f221406ab80 0x7f2214144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2212d9d640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 0x7f2214151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 -- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f221406ab80 msgr2=0x7f2214144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f221406ab80 0x7f2214144c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 -- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 msgr2=0x7f2214151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 0x7f2214151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 -- 172.21.15.84:0/2152420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c009820 con 0x7f221406ccb0 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2212d9d640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 0x7f2214151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2209d9b640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00c490 tx=0x7f21fc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc003600 con 0x7f221406ccb0 2023-09-10T00:12:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21fc003780 con 0x7f221406ccb0 2023-09-10T00:12:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2214145f50 con 0x7f221406ccb0 2023-09-10T00:12:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc003bd0 con 0x7f221406ccb0 2023-09-10T00:12:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2214145150 con 0x7f221406ccb0 2023-09-10T00:12:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2214146750 con 0x7f221406ccb0 2023-09-10T00:12:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f21fc003d30 con 0x7f221406ccb0 2023-09-10T00:12:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 0x7f21f4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21fc082d50 con 0x7f221406ccb0 2023-09-10T00:12:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.291+0000 7f221259c640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 0x7f21f4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.295+0000 7f221259c640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 0x7f21f4068010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2204000f70 tx=0x7f2204009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.295+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2214146750 con 0x7f221406ccb0 2023-09-10T00:12:55.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.451+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22140713a0 con 0x7f221406ccb0 2023-09-10T00:12:55.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.451+0000 7f220b7fe640 1 -- 172.21.15.84:0/2152420865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21fc017020 con 0x7f221406ccb0 2023-09-10T00:12:55.453 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:12:55.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 msgr2=0x7f21f4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 0x7f21f4068010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2204000f70 tx=0x7f2204009040 comp rx=0 tx=0).stop 2023-09-10T00:12:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 msgr2=0x7f2214147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00c490 tx=0x7f21fc001e80 comp rx=0 tx=0).stop 2023-09-10T00:12:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 shutdown_connections 2023-09-10T00:12:55.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21f4065b50 0x7f21f4068010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f221414eb10 0x7f2214151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f221406ccb0 0x7f2214147f70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 --2- 172.21.15.84:0/2152420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f221406ab80 0x7f2214144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 >> 172.21.15.84:0/2152420865 conn(0x7f22140aec00 msgr2=0x7f22140c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 shutdown_connections 2023-09-10T00:12:55.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.455+0000 7f2218fcb640 1 -- 172.21.15.84:0/2152420865 wait complete. 2023-09-10T00:12:55.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:12:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 -- 172.21.15.84:0/1700974993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d80cbd60 msgr2=0x7f21d81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 --2- 172.21.15.84:0/1700974993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d80cbd60 0x7f21d81591a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009bf0 tx=0x7f21d001cb50 comp rx=0 tx=0).stop 2023-09-10T00:12:55.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 -- 172.21.15.84:0/1700974993 shutdown_connections 2023-09-10T00:12:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 --2- 172.21.15.84:0/1700974993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d80cbd60 0x7f21d81591a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 --2- 172.21.15.84:0/1700974993 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d806fa60 0x7f21d80ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 -- 172.21.15.84:0/1700974993 >> 172.21.15.84:0/1700974993 conn(0x7f21d80aec00 msgr2=0x7f21d80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 -- 172.21.15.84:0/1700974993 shutdown_connections 2023-09-10T00:12:55.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.583+0000 7f21e0273640 1 -- 172.21.15.84:0/1700974993 wait complete. 2023-09-10T00:12:55.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 Processor -- start 2023-09-10T00:12:55.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- start start 2023-09-10T00:12:55.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 0x7f21d80ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80cbd60 0x7f21d8135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d81584d0 con 0x7f21d806fa60 2023-09-10T00:12:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80c9970 con 0x7f21d80af770 2023-09-10T00:12:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d8157f50 con 0x7f21d80cbd60 2023-09-10T00:12:55.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48814/0 (socket says 172.21.15.84:48814) 2023-09-10T00:12:55.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 -- 172.21.15.84:0/161933515 learned_addr learned my addr 172.21.15.84:0/161933515 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:55.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21dd80e640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 0x7f21d80ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 -- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80cbd60 msgr2=0x7f21d8135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de810640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80cbd60 0x7f21d8135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80cbd60 0x7f21d8135e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 -- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 msgr2=0x7f21d80ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 0x7f21d80ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 -- 172.21.15.84:0/161933515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009820 con 0x7f21d806fa60 2023-09-10T00:12:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21dd80e640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 0x7f21d80ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21de00f640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21c800d980 tx=0x7f21c800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8009c30 con 0x7f21d806fa60 2023-09-10T00:12:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21c8009e80 con 0x7f21d806fa60 2023-09-10T00:12:55.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80c9690 con 0x7f21d806fa60 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80106a0 con 0x7f21d806fa60 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d80c92f0 con 0x7f21d806fa60 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d8157db0 con 0x7f21d806fa60 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.587+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f21c8010800 con 0x7f21d806fa60 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.591+0000 7f21d6ffd640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 0x7f21c4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.591+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21c8083a80 con 0x7f21d806fa60 2023-09-10T00:12:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.591+0000 7f21dd80e640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 0x7f21c4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.591+0000 7f21dd80e640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 0x7f21c4067fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21d81f5640 tx=0x7f21cc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.595+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f21d8157db0 con 0x7f21d806fa60 2023-09-10T00:12:55.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.743+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21d8157db0 con 0x7f21d806fa60 2023-09-10T00:12:55.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21d6ffd640 1 -- 172.21.15.84:0/161933515 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21d8157db0 con 0x7f21d806fa60 2023-09-10T00:12:55.747 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:12:55.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 msgr2=0x7f21c4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 0x7f21c4067fe0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f21d81f5640 tx=0x7f21cc009040 comp rx=0 tx=0).stop 2023-09-10T00:12:55.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 msgr2=0x7f21d8156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f21c800d980 tx=0x7f21c800de40 comp rx=0 tx=0).stop 2023-09-10T00:12:55.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 shutdown_connections 2023-09-10T00:12:55.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c4065b20 0x7f21c4067fe0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21d80cbd60 0x7f21d8135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21d80af770 0x7f21d80ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 --2- 172.21.15.84:0/161933515 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21d806fa60 0x7f21d8156670 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 >> 172.21.15.84:0/161933515 conn(0x7f21d80aec00 msgr2=0x7f21d815a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 shutdown_connections 2023-09-10T00:12:55.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.747+0000 7f21e0273640 1 -- 172.21.15.84:0/161933515 wait complete. 2023-09-10T00:12:55.766 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:12:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2052530370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00cbd60 msgr2=0x7facd01591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- 172.21.15.84:0/2052530370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00cbd60 0x7facd01591a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facd006de30 tx=0x7facc801cd20 comp rx=0 tx=0).stop 2023-09-10T00:12:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2052530370 shutdown_connections 2023-09-10T00:12:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- 172.21.15.84:0/2052530370 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00cbd60 0x7facd01591a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- 172.21.15.84:0/2052530370 >> v2:172.21.15.100:3300/0 conn(0x7facd00ca550 0x7facd00af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2052530370 >> 172.21.15.84:0/2052530370 conn(0x7facd00aec00 msgr2=0x7facd00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2052530370 shutdown_connections 2023-09-10T00:12:55.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2052530370 wait complete. 2023-09-10T00:12:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 Processor -- start 2023-09-10T00:12:55.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- start start 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facd006fa60 0x7facd01545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00cbd60 0x7facd0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ad260 con 0x7facd00ca550 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ad540 con 0x7facd00cbd60 2023-09-10T00:12:55.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd00ad820 con 0x7facd006fa60 2023-09-10T00:12:55.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48822/0 (socket says 172.21.15.84:48822) 2023-09-10T00:12:55.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 -- 172.21.15.84:0/2635568501 learned_addr learned my addr 172.21.15.84:0/2635568501 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:55.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facceffd640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facd006fa60 0x7facd01545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 -- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facd006fa60 msgr2=0x7facd01545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facd006fa60 0x7facd01545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 -- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00cbd60 msgr2=0x7facd0157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00cbd60 0x7facd0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 -- 172.21.15.84:0/2635568501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80098e0 con 0x7facd00ca550 2023-09-10T00:12:55.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facce7fc640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc000d980 tx=0x7facc000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0009c30 con 0x7facd00ca550 2023-09-10T00:12:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facc0005020 con 0x7facd00ca550 2023-09-10T00:12:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0005430 con 0x7facd00ca550 2023-09-10T00:12:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd00adb00 con 0x7facd00ca550 2023-09-10T00:12:55.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.891+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd0154b00 con 0x7facd00ca550 2023-09-10T00:12:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd01409e0 con 0x7facd00ca550 2023-09-10T00:12:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7facc00047b0 con 0x7facd00ca550 2023-09-10T00:12:55.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facc7fff640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 0x7facb0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facc0083830 con 0x7facd00ca550 2023-09-10T00:12:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facceffd640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 0x7facb0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.895+0000 7facceffd640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 0x7facb0067fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facb8007fd0 tx=0x7facb8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:55.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:55.899+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7facd01409e0 con 0x7facd00ca550 2023-09-10T00:12:56.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7facd01409e0 con 0x7facd00ca550 2023-09-10T00:12:56.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facc7fff640 1 -- 172.21.15.84:0/2635568501 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7facd01409e0 con 0x7facd00ca550 2023-09-10T00:12:56.041 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:12:56.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 msgr2=0x7facb0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 0x7facb0067fe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7facb8007fd0 tx=0x7facb8009040 comp rx=0 tx=0).stop 2023-09-10T00:12:56.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 msgr2=0x7facd0155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc000d980 tx=0x7facc000de40 comp rx=0 tx=0).stop 2023-09-10T00:12:56.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 shutdown_connections 2023-09-10T00:12:56.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7facb0065b20 0x7facb0067fe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00cbd60 0x7facd0157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facd00ca550 0x7facd0155fc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 --2- 172.21.15.84:0/2635568501 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7facd006fa60 0x7facd01545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 >> 172.21.15.84:0/2635568501 conn(0x7facd00aec00 msgr2=0x7facd00cb500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:56.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 shutdown_connections 2023-09-10T00:12:56.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.039+0000 7facd599d640 1 -- 172.21.15.84:0/2635568501 wait complete. 2023-09-10T00:12:56.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:12:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 -- 172.21.15.84:0/3435136874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 msgr2=0x7f0ea806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3435136874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea806cc00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009900 tx=0x7f0e9801f070 comp rx=0 tx=0).stop 2023-09-10T00:12:56.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 -- 172.21.15.84:0/3435136874 shutdown_connections 2023-09-10T00:12:56.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3435136874 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea806cc00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3435136874 >> v2:172.21.15.100:3300/0 conn(0x7f0ea8157980 0x7f0ea815be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 -- 172.21.15.84:0/3435136874 >> 172.21.15.84:0/3435136874 conn(0x7f0ea80cd0e0 msgr2=0x7f0ea80cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:56.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 -- 172.21.15.84:0/3435136874 shutdown_connections 2023-09-10T00:12:56.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.183+0000 7f0eaff90640 1 -- 172.21.15.84:0/3435136874 wait complete. 2023-09-10T00:12:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 Processor -- start 2023-09-10T00:12:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- start start 2023-09-10T00:12:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ea806a110 0x7f0ea80c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 0x7f0ea81537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8153d10 con 0x7f0ea806e620 2023-09-10T00:12:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8159ec0 con 0x7f0ea8157980 2023-09-10T00:12:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8159be0 con 0x7f0ea806a110 2023-09-10T00:12:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48832/0 (socket says 172.21.15.84:48832) 2023-09-10T00:12:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 -- 172.21.15.84:0/3045060262 learned_addr learned my addr 172.21.15.84:0/3045060262 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:12:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eae52d640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 0x7f0ea81537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eadd2c640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ea806a110 0x7f0ea80c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 -- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ea806a110 msgr2=0x7f0ea80c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ea806a110 0x7f0ea80c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 -- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 msgr2=0x7f0ea81537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 0x7f0ea81537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 -- 172.21.15.84:0/3045060262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009560 con 0x7f0ea806e620 2023-09-10T00:12:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eae52d640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 0x7f0ea81537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:12:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0ead52b640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0e9801bc80 tx=0x7f0e980b07b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b0ba0 con 0x7f0ea806e620 2023-09-10T00:12:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e980b0df0 con 0x7f0ea806e620 2023-09-10T00:12:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea8155420 con 0x7f0ea806e620 2023-09-10T00:12:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98005280 con 0x7f0ea806e620 2023-09-10T00:12:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81598f0 con 0x7f0ea806e620 2023-09-10T00:12:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea8155280 con 0x7f0ea806e620 2023-09-10T00:12:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0e980b7070 con 0x7f0ea806e620 2023-09-10T00:12:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 0x7f0e8c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:12:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e981208b0 con 0x7f0ea806e620 2023-09-10T00:12:56.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.187+0000 7f0eadd2c640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 0x7f0e8c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:12:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.191+0000 7f0eadd2c640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 0x7f0e8c067fe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400a790 tx=0x7f0ea4008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:12:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.191+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0ea8155280 con 0x7f0ea806e620 2023-09-10T00:12:56.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0ea8155280 con 0x7f0ea806e620 2023-09-10T00:12:56.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0e9e7fc640 1 -- 172.21.15.84:0/3045060262 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0ea8155280 con 0x7f0ea806e620 2023-09-10T00:12:56.360 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:12:56.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 msgr2=0x7f0e8c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 0x7f0e8c067fe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400a790 tx=0x7f0ea4008040 comp rx=0 tx=0).stop 2023-09-10T00:12:56.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 msgr2=0x7f0ea815aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:12:56.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0e9801bc80 tx=0x7f0e980b07b0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 shutdown_connections 2023-09-10T00:12:56.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0e8c065b20 0x7f0e8c067fe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ea8157980 0x7f0ea81537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ea806e620 0x7f0ea815aac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 --2- 172.21.15.84:0/3045060262 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ea806a110 0x7f0ea80c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:12:56.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 >> 172.21.15.84:0/3045060262 conn(0x7f0ea80cd0e0 msgr2=0x7f0ea80cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:12:56.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 shutdown_connections 2023-09-10T00:12:56.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:12:56.359+0000 7f0eaff90640 1 -- 172.21.15.84:0/3045060262 wait complete. 2023-09-10T00:12:56.378 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-09-10T00:12:56.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:12:56.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-09-10T00:12:56.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi084.stderr:ceph-fuse[44281]: fuse finished with error 0 and tester_r 0 2023-09-10T00:12:56.405 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:02.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:13:02.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:02.509 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-09-10T00:13:02.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:02.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- 172.21.15.84:0/843085533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d10 msgr2=0x7f7914005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:02.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 --2- 172.21.15.84:0/843085533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7914004d10 0x7f7914005190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7924001680 tx=0x7f792401c780 comp rx=0 tx=0).stop 2023-09-10T00:13:02.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 -- 172.21.15.84:0/843085533 reap_dead start 2023-09-10T00:13:02.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- 172.21.15.84:0/843085533 shutdown_connections 2023-09-10T00:13:02.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- 172.21.15.84:0/843085533 >> 172.21.15.84:0/843085533 conn(0x7f79280cca70 msgr2=0x7f79280cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:02.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- 172.21.15.84:0/843085533 shutdown_connections 2023-09-10T00:13:02.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- 172.21.15.84:0/843085533 wait complete. 2023-09-10T00:13:02.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 Processor -- start 2023-09-10T00:13:02.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- start start 2023-09-10T00:13:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7914004d10 0x7f7928153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 0x7f79280a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c60a0 con 0x7f79281f18d0 2023-09-10T00:13:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280a68a0 con 0x7f79281f1490 2023-09-10T00:13:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792fc4d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280a6b80 con 0x7f7914004d10 2023-09-10T00:13:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43622/0 (socket says 172.21.15.84:43622) 2023-09-10T00:13:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 -- 172.21.15.84:0/524808709 learned_addr learned my addr 172.21.15.84:0/524808709 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792d9e9640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7914004d10 0x7f7928153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792d1e8640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 0x7f79280a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 -- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7914004d10 msgr2=0x7f7928153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7914004d10 0x7f7928153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 -- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 msgr2=0x7f79280a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 0x7f79280a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792e1ea640 1 -- 172.21.15.84:0/524808709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79280a6e60 con 0x7f79281f18d0 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.702+0000 7f792d1e8640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 0x7f79280a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792e1ea640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7924001680 tx=0x7f7924003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240a9040 con 0x7f79281f18d0 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7924000e50 con 0x7f79281f18d0 2023-09-10T00:13:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79280c4830 con 0x7f79281f18d0 2023-09-10T00:13:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79240a5580 con 0x7f79281f18d0 2023-09-10T00:13:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7928154120 con 0x7f79281f18d0 2023-09-10T00:13:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79280712c0 con 0x7f79281f18d0 2023-09-10T00:13:02.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f79240b5020 con 0x7f79281f18d0 2023-09-10T00:13:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 0x7f790c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79240aa070 con 0x7f79281f18d0 2023-09-10T00:13:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792d9e9640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 0x7f790c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:02.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.706+0000 7f792d9e9640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 0x7f790c068010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79180057d0 tx=0x7f791800a6b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:02.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.710+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f79240eacb0 con 0x7f79281f18d0 2023-09-10T00:13:02.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.866+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7928073400 con 0x7f79281f18d0 2023-09-10T00:13:02.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.866+0000 7f791e7fc640 1 -- 172.21.15.84:0/524808709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f79240bd090 con 0x7f79281f18d0 2023-09-10T00:13:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:02.870 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 msgr2=0x7f790c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 0x7f790c068010 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79180057d0 tx=0x7f791800a6b0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 msgr2=0x7f79280a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7924001680 tx=0x7f7924003b70 comp rx=0 tx=0).stop 2023-09-10T00:13:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 shutdown_connections 2023-09-10T00:13:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f790c065b50 0x7f790c068010 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79281f18d0 0x7f79280a6260 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79281f1490 0x7f79280a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 --2- 172.21.15.84:0/524808709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7914004d10 0x7f7928153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 >> 172.21.15.84:0/524808709 conn(0x7f79280cca70 msgr2=0x7f7928154bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 shutdown_connections 2023-09-10T00:13:02.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.870+0000 7f792fc4d640 1 -- 172.21.15.84:0/524808709 wait complete. 2023-09-10T00:13:02.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:03.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 -- 172.21.15.84:0/3137791418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415af60 msgr2=0x7f19140cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 --2- 172.21.15.84:0/3137791418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415af60 0x7f19140cbb20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1904009bc0 tx=0x7f190401f350 comp rx=0 tx=0).stop 2023-09-10T00:13:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 -- 172.21.15.84:0/3137791418 shutdown_connections 2023-09-10T00:13:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 --2- 172.21.15.84:0/3137791418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415af60 0x7f19140cbb20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 -- 172.21.15.84:0/3137791418 >> 172.21.15.84:0/3137791418 conn(0x7f19140b25b0 msgr2=0x7f19140b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 -- 172.21.15.84:0/3137791418 shutdown_connections 2023-09-10T00:13:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:02.998+0000 7f19195b7640 1 -- 172.21.15.84:0/3137791418 wait complete. 2023-09-10T00:13:03.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 Processor -- start 2023-09-10T00:13:03.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- start start 2023-09-10T00:13:03.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 0x7f191415d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191415af60 0x7f191414a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191406afb0 con 0x7f191415ab80 2023-09-10T00:13:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191414bbe0 con 0x7f191415af60 2023-09-10T00:13:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1914148cc0 con 0x7f19140afba0 2023-09-10T00:13:03.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43646/0 (socket says 172.21.15.84:43646) 2023-09-10T00:13:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 -- 172.21.15.84:0/3466258614 learned_addr learned my addr 172.21.15.84:0/3466258614 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19137fe640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191415af60 0x7f191414a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f1912ffd640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 0x7f191415d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 -- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 msgr2=0x7f191415d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 0x7f191415d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 -- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191415af60 msgr2=0x7f191414a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191415af60 0x7f191414a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 -- 172.21.15.84:0/3466258614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904009820 con 0x7f191415ab80 2023-09-10T00:13:03.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f1912ffd640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 0x7f191415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19127fc640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f190401bf60 tx=0x7f19040af4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19040afa50 con 0x7f191415ab80 2023-09-10T00:13:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f19040afca0 con 0x7f191415ab80 2023-09-10T00:13:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1904004260 con 0x7f191415ab80 2023-09-10T00:13:03.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914148fa0 con 0x7f191415ab80 2023-09-10T00:13:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914149560 con 0x7f191415ab80 2023-09-10T00:13:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1914073400 con 0x7f191415ab80 2023-09-10T00:13:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f19040043c0 con 0x7f191415ab80 2023-09-10T00:13:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.002+0000 7f190b7fe640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 0x7f18f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.006+0000 7f1912ffd640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 0x7f18f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.006+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19041221e0 con 0x7f191415ab80 2023-09-10T00:13:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.006+0000 7f1912ffd640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 0x7f18f4067fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003e40 tx=0x7f18fc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:03.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.010+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f19040ef7c0 con 0x7f191415ab80 2023-09-10T00:13:03.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.150+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19140d0810 con 0x7f191415ab80 2023-09-10T00:13:03.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.150+0000 7f190b7fe640 1 -- 172.21.15.84:0/3466258614 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f19040f2de0 con 0x7f191415ab80 2023-09-10T00:13:03.155 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:03.155 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:03.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 msgr2=0x7f18f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 0x7f18f4067fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18fc003e40 tx=0x7f18fc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:03.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 msgr2=0x7f19140b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f190401bf60 tx=0x7f19040af4a0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 shutdown_connections 2023-09-10T00:13:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f18f4065b20 0x7f18f4067fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f191415af60 0x7f191414a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f191415ab80 0x7f19140b0960 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 --2- 172.21.15.84:0/3466258614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f19140afba0 0x7f191415d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 >> 172.21.15.84:0/3466258614 conn(0x7f19140b25b0 msgr2=0x7f19140c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 shutdown_connections 2023-09-10T00:13:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.154+0000 7f19195b7640 1 -- 172.21.15.84:0/3466258614 wait complete. 2023-09-10T00:13:03.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-10T00:13:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- 172.21.15.84:0/1624583741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 msgr2=0x7f84e0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1624583741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84e0005190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f84ec001d70 tx=0x7f84ec01cae0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f2d9d640 1 -- 172.21.15.84:0/1624583741 reap_dead start 2023-09-10T00:13:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- 172.21.15.84:0/1624583741 shutdown_connections 2023-09-10T00:13:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- 172.21.15.84:0/1624583741 >> 172.21.15.84:0/1624583741 conn(0x7f84f40aec00 msgr2=0x7f84f40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- 172.21.15.84:0/1624583741 shutdown_connections 2023-09-10T00:13:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- 172.21.15.84:0/1624583741 wait complete. 2023-09-10T00:13:03.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 Processor -- start 2023-09-10T00:13:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.298+0000 7f84f88cb640 1 -- start start 2023-09-10T00:13:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84f40c2140 0x7f84f40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84f41569f0 0x7f84f4156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41573b0 con 0x7f84e0004d10 2023-09-10T00:13:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f40c9710 con 0x7f84f41569f0 2023-09-10T00:13:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f41ef370 con 0x7f84f40c2140 2023-09-10T00:13:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43668/0 (socket says 172.21.15.84:43668) 2023-09-10T00:13:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 -- 172.21.15.84:0/1636125188 learned_addr learned my addr 172.21.15.84:0/1636125188 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 -- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84f40c2140 msgr2=0x7f84f40c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84f40c2140 0x7f84f40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 -- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84f41569f0 msgr2=0x7f84f4156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f2d9d640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84f41569f0 0x7f84f4156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84f41569f0 0x7f84f4156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 -- 172.21.15.84:0/1636125188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40c9f00 con 0x7f84e0004d10 2023-09-10T00:13:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f259c640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84e4010a10 tx=0x7f84e4010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40095f0 con 0x7f84e0004d10 2023-09-10T00:13:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84e400ece0 con 0x7f84e0004d10 2023-09-10T00:13:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f40c2f10 con 0x7f84e0004d10 2023-09-10T00:13:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4005280 con 0x7f84e0004d10 2023-09-10T00:13:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f40c2950 con 0x7f84e0004d10 2023-09-10T00:13:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f40713a0 con 0x7f84e0004d10 2023-09-10T00:13:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f84e40053e0 con 0x7f84e0004d10 2023-09-10T00:13:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 0x7f84d4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84e4016070 con 0x7f84e0004d10 2023-09-10T00:13:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84ebfff640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 0x7f84d4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:03.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.302+0000 7f84ebfff640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 0x7f84d4067fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84f4070ad0 tx=0x7f84dc001da0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:03.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.306+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f84e4051a80 con 0x7f84e0004d10 2023-09-10T00:13:03.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:03.498+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f84f406d360 con 0x7f84e0004d10 2023-09-10T00:13:04.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84eaffd640 1 -- 172.21.15.84:0/1636125188 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84e40550a0 con 0x7f84e0004d10 2023-09-10T00:13:04.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 msgr2=0x7f84d4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 0x7f84d4067fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f84f4070ad0 tx=0x7f84dc001da0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 msgr2=0x7f84f414d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f84e4010a10 tx=0x7f84e4010ed0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 shutdown_connections 2023-09-10T00:13:04.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84d4065b20 0x7f84d4067fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84f41569f0 0x7f84f4156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84f40c2140 0x7f84f40c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 --2- 172.21.15.84:0/1636125188 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0004d10 0x7f84f414d590 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 >> 172.21.15.84:0/1636125188 conn(0x7f84f40aec00 msgr2=0x7f84f4159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:04.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 shutdown_connections 2023-09-10T00:13:04.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.214+0000 7f84f88cb640 1 -- 172.21.15.84:0/1636125188 wait complete. 2023-09-10T00:13:04.237 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-09-10T00:13:04.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-10T00:13:04.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- 172.21.15.84:0/4102346390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1800cbd60 msgr2=0x7fe1801591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:04.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 --2- 172.21.15.84:0/4102346390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1800cbd60 0x7fe1801591a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe178009c80 tx=0x7fe17801cd40 comp rx=0 tx=0).stop 2023-09-10T00:13:04.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- 172.21.15.84:0/4102346390 shutdown_connections 2023-09-10T00:13:04.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 --2- 172.21.15.84:0/4102346390 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1800cbd60 0x7fe1801591a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 --2- 172.21.15.84:0/4102346390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800ca550 0x7fe1800af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- 172.21.15.84:0/4102346390 >> 172.21.15.84:0/4102346390 conn(0x7fe1800aec00 msgr2=0x7fe1800cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:04.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- 172.21.15.84:0/4102346390 shutdown_connections 2023-09-10T00:13:04.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- 172.21.15.84:0/4102346390 wait complete. 2023-09-10T00:13:04.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 Processor -- start 2023-09-10T00:13:04.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.366+0000 7fe187a1d640 1 -- start start 2023-09-10T00:13:04.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:04.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1800ca550 0x7fe180139b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:04.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 0x7fe180154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:04.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe180155900 con 0x7fe18006fa60 2023-09-10T00:13:04.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18013a070 con 0x7fe1800ca550 2023-09-10T00:13:04.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180155b50 con 0x7fe1800cbd60 2023-09-10T00:13:04.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43686/0 (socket says 172.21.15.84:43686) 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 -- 172.21.15.84:0/987676894 learned_addr learned my addr 172.21.15.84:0/987676894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe185fba640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 0x7fe180154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 -- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 msgr2=0x7fe180154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 0x7fe180154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 -- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1800ca550 msgr2=0x7fe180139b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:04.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1800ca550 0x7fe180139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:04.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 -- 172.21.15.84:0/987676894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780098e0 con 0x7fe18006fa60 2023-09-10T00:13:04.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe185fba640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 0x7fe180154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:04.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe1857b9640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00c4c0 tx=0x7fe17c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:04.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c005480 con 0x7fe18006fa60 2023-09-10T00:13:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe17c003600 con 0x7fe18006fa60 2023-09-10T00:13:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe180155e30 con 0x7fe18006fa60 2023-09-10T00:13:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c003a30 con 0x7fe18006fa60 2023-09-10T00:13:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180140a70 con 0x7fe18006fa60 2023-09-10T00:13:04.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800713a0 con 0x7fe18006fa60 2023-09-10T00:13:04.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe17c003b90 con 0x7fe18006fa60 2023-09-10T00:13:04.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 0x7fe164067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:04.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe17c082d40 con 0x7fe18006fa60 2023-09-10T00:13:04.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe184fb8640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 0x7fe164067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:04.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.370+0000 7fe184fb8640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 0x7fe164067fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1700058d0 tx=0x7fe170005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:04.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.374+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe17c050430 con 0x7fe18006fa60 2023-09-10T00:13:04.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:04.562+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe18013b180 con 0x7fe18006fa60 2023-09-10T00:13:05.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.226+0000 7fe175ffb640 1 -- 172.21.15.84:0/987676894 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe17c017020 con 0x7fe18006fa60 2023-09-10T00:13:05.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 msgr2=0x7fe164067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 0x7fe164067fe0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe1700058d0 tx=0x7fe170005860 comp rx=0 tx=0).stop 2023-09-10T00:13:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 msgr2=0x7fe18013a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe17c00c4c0 tx=0x7fe17c001e80 comp rx=0 tx=0).stop 2023-09-10T00:13:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 shutdown_connections 2023-09-10T00:13:05.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe164065b20 0x7fe164067fe0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1800cbd60 0x7fe180154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1800ca550 0x7fe180139b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 --2- 172.21.15.84:0/987676894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe18006fa60 0x7fe18013a4c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 >> 172.21.15.84:0/987676894 conn(0x7fe1800aec00 msgr2=0x7fe1800c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:05.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 shutdown_connections 2023-09-10T00:13:05.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.230+0000 7fe187a1d640 1 -- 172.21.15.84:0/987676894 wait complete. 2023-09-10T00:13:05.251 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-10T00:13:05.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/3486157258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f3c0047d0 msgr2=0x7f7f3c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/3486157258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f3c0047d0 0x7f7f3c004c50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7f540c0ae0 tx=0x7f7f4401f700 comp rx=0 tx=0).stop 2023-09-10T00:13:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f593de640 1 -- 172.21.15.84:0/3486157258 reap_dead start 2023-09-10T00:13:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/3486157258 shutdown_connections 2023-09-10T00:13:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/3486157258 >> 172.21.15.84:0/3486157258 conn(0x7f7f540cca70 msgr2=0x7f7f540cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/3486157258 shutdown_connections 2023-09-10T00:13:05.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/3486157258 wait complete. 2023-09-10T00:13:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 Processor -- start 2023-09-10T00:13:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- start start 2023-09-10T00:13:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 0x7f7f540c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f540aca80 0x7f7f5415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540c3950 con 0x7f7f541f12f0 2023-09-10T00:13:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541f58a0 con 0x7f7f540aca80 2023-09-10T00:13:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541f22c0 con 0x7f7f3c0047d0 2023-09-10T00:13:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43698/0 (socket says 172.21.15.84:43698) 2023-09-10T00:13:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 -- 172.21.15.84:0/137349666 learned_addr learned my addr 172.21.15.84:0/137349666 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f593de640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f540aca80 0x7f7f5415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f58bdd640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 0x7f7f540c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 -- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 msgr2=0x7f7f540c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 0x7f7f540c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 -- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f540aca80 msgr2=0x7f7f5415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f540aca80 0x7f7f5415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 -- 172.21.15.84:0/137349666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f541f1770 con 0x7f7f541f12f0 2023-09-10T00:13:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f58bdd640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 0x7f7f540c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:05.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f53fff640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f4401f530 tx=0x7f7f44001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44003600 con 0x7f7f541f12f0 2023-09-10T00:13:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f44003850 con 0x7f7f541f12f0 2023-09-10T00:13:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f541f1a20 con 0x7f7f541f12f0 2023-09-10T00:13:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f44003c20 con 0x7f7f541f12f0 2023-09-10T00:13:05.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.374+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f541f1fe0 con 0x7f7f541f12f0 2023-09-10T00:13:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f540c3a90 con 0x7f7f541f12f0 2023-09-10T00:13:05.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7f440bb480 con 0x7f7f541f12f0 2023-09-10T00:13:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f517fa640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 0x7f7f40068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f440ab070 con 0x7f7f541f12f0 2023-09-10T00:13:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f58bdd640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 0x7f7f40068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.378+0000 7f7f58bdd640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 0x7f7f40068010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005fd0 tx=0x7f7f4800b4d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:05.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.382+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7f540c3a90 con 0x7f7f541f12f0 2023-09-10T00:13:05.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f540c3a90 con 0x7f7f541f12f0 2023-09-10T00:13:05.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f517fa640 1 -- 172.21.15.84:0/137349666 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f7f540c3a90 con 0x7f7f541f12f0 2023-09-10T00:13:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:05.573 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:05.574 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:05.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 msgr2=0x7f7f40068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 0x7f7f40068010 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7f48005fd0 tx=0x7f7f4800b4d0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 msgr2=0x7f7f541f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f4401f530 tx=0x7f7f44001020 comp rx=0 tx=0).stop 2023-09-10T00:13:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 shutdown_connections 2023-09-10T00:13:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f40065b50 0x7f7f40068010 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f540aca80 0x7f7f5415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f541f12f0 0x7f7f541f5360 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 --2- 172.21.15.84:0/137349666 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f3c0047d0 0x7f7f540c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.570+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 >> 172.21.15.84:0/137349666 conn(0x7f7f540cca70 msgr2=0x7f7f541598d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:05.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.574+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 shutdown_connections 2023-09-10T00:13:05.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.574+0000 7f7f5ae41640 1 -- 172.21.15.84:0/137349666 wait complete. 2023-09-10T00:13:05.592 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:05.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 -- 172.21.15.84:0/1241433603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 msgr2=0x7f7f8815b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1241433603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815b400 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f88070030 tx=0x7f7f8001cd30 comp rx=0 tx=0).stop 2023-09-10T00:13:05.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 -- 172.21.15.84:0/1241433603 shutdown_connections 2023-09-10T00:13:05.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1241433603 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815b400 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1241433603 >> v2:172.21.15.100:3300/0 conn(0x7f7f8806cec0 0x7f7f8806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.714+0000 7f7f903ca640 1 -- 172.21.15.84:0/1241433603 >> 172.21.15.84:0/1241433603 conn(0x7f7f880ca240 msgr2=0x7f7f880ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- 172.21.15.84:0/1241433603 shutdown_connections 2023-09-10T00:13:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- 172.21.15.84:0/1241433603 wait complete. 2023-09-10T00:13:05.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 Processor -- start 2023-09-10T00:13:05.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- start start 2023-09-10T00:13:05.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f8806cec0 0x7f7f880b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f880cc460 0x7f7f8815d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b1600 con 0x7f7f8815f310 2023-09-10T00:13:05.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b0a80 con 0x7f7f880cc460 2023-09-10T00:13:05.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880b0d60 con 0x7f7f8806cec0 2023-09-10T00:13:05.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43722/0 (socket says 172.21.15.84:43722) 2023-09-10T00:13:05.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 -- 172.21.15.84:0/1670974366 learned_addr learned my addr 172.21.15.84:0/1670974366 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:05.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e166640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f8806cec0 0x7f7f880b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 -- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f8806cec0 msgr2=0x7f7f880b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f8806cec0 0x7f7f880b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 -- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f880cc460 msgr2=0x7f7f8815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f880cc460 0x7f7f8815d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 -- 172.21.15.84:0/1670974366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f800098e0 con 0x7f7f8815f310 2023-09-10T00:13:05.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f8e967640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f80019940 tx=0x7f7f800a5bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:05.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800092e0 con 0x7f7f8815f310 2023-09-10T00:13:05.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7f80004500 con 0x7f7f8815f310 2023-09-10T00:13:05.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f880b1040 con 0x7f7f8815f310 2023-09-10T00:13:05.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800ad5b0 con 0x7f7f8815f310 2023-09-10T00:13:05.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f880b25d0 con 0x7f7f8815f310 2023-09-10T00:13:05.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.718+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f880c1340 con 0x7f7f8815f310 2023-09-10T00:13:05.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.722+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7f800b4040 con 0x7f7f8815f310 2023-09-10T00:13:05.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.722+0000 7f7f7effd640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 0x7f7f6c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:05.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.722+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f8011e6e0 con 0x7f7f8815f310 2023-09-10T00:13:05.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.722+0000 7f7f8e166640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 0x7f7f6c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:05.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.722+0000 7f7f8e166640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 0x7f7f6c067fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400ba40 tx=0x7f7f84005cd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:05.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.726+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7f880c1340 con 0x7f7f8815f310 2023-09-10T00:13:05.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.882+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f880c1340 con 0x7f7f8815f310 2023-09-10T00:13:05.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.882+0000 7f7f7effd640 1 -- 172.21.15.84:0/1670974366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f7f880c1340 con 0x7f7f8815f310 2023-09-10T00:13:05.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:05.886 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:05.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 msgr2=0x7f7f6c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 0x7f7f6c067fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400ba40 tx=0x7f7f84005cd0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 msgr2=0x7f7f8815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7f80019940 tx=0x7f7f800a5bc0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 shutdown_connections 2023-09-10T00:13:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7f6c065b20 0x7f7f6c067fe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f8815f310 0x7f7f8815dc90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f880cc460 0x7f7f8815d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 --2- 172.21.15.84:0/1670974366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f8806cec0 0x7f7f880b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:05.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 >> 172.21.15.84:0/1670974366 conn(0x7f7f880ca240 msgr2=0x7f7f88154700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:05.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 shutdown_connections 2023-09-10T00:13:05.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:05.886+0000 7f7f903ca640 1 -- 172.21.15.84:0/1670974366 wait complete. 2023-09-10T00:13:05.904 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-10T00:13:05.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:13:06.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- 172.21.15.84:0/228017110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7128159020 msgr2=0x7f712815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- 172.21.15.84:0/228017110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7128159020 0x7f712815a1e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7118009840 tx=0x7f711801c800 comp rx=0 tx=0).stop 2023-09-10T00:13:06.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- 172.21.15.84:0/228017110 shutdown_connections 2023-09-10T00:13:06.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- 172.21.15.84:0/228017110 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280b0790 0x7f71280b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- 172.21.15.84:0/228017110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7128159020 0x7f712815a1e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- 172.21.15.84:0/228017110 >> 172.21.15.84:0/228017110 conn(0x7f71280cb7c0 msgr2=0x7f71280cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- 172.21.15.84:0/228017110 shutdown_connections 2023-09-10T00:13:06.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- 172.21.15.84:0/228017110 wait complete. 2023-09-10T00:13:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 Processor -- start 2023-09-10T00:13:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- start start 2023-09-10T00:13:06.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280c9b60 0x7f71280a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7128159020 0x7f7128142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128153d00 con 0x7f71280b0790 2023-09-10T00:13:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712806d060 con 0x7f7128159020 2023-09-10T00:13:06.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f7130476640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712806c450 con 0x7f71280c9b60 2023-09-10T00:13:06.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43744/0 (socket says 172.21.15.84:43744) 2023-09-10T00:13:06.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 -- 172.21.15.84:0/765190713 learned_addr learned my addr 172.21.15.84:0/765190713 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:06.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712da11640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280c9b60 0x7f71280a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712ea13640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7128159020 0x7f7128142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 -- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280c9b60 msgr2=0x7f71280a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280c9b60 0x7f71280a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 -- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7128159020 msgr2=0x7f7128142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7128159020 0x7f7128142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 -- 172.21.15.84:0/765190713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180094a0 con 0x7f71280b0790 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.022+0000 7f712e212640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f712000cc70 tx=0x7f712000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000a9f0 con 0x7f71280b0790 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f712000ac40 con 0x7f71280b0790 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712806c730 con 0x7f71280b0790 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120012420 con 0x7f71280b0790 2023-09-10T00:13:06.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712806ccf0 con 0x7f71280b0790 2023-09-10T00:13:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712806f3a0 con 0x7f71280b0790 2023-09-10T00:13:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f712001a3b0 con 0x7f71280b0790 2023-09-10T00:13:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 0x7f7114067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7120083a00 con 0x7f71280b0790 2023-09-10T00:13:06.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f712da11640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 0x7f7114067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.026+0000 7f712da11640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 0x7f7114067fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71180af000 tx=0x7f711801b040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.030+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7120054a60 con 0x7f71280b0790 2023-09-10T00:13:06.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.182+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71280ad4b0 con 0x7f7114065b20 2023-09-10T00:13:06.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.194+0000 7f7126ffd640 1 -- 172.21.15.84:0/765190713 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345172 (secure 0 0 0) 0x7f71180a57c0 con 0x7f7114065b20 2023-09-10T00:13:06.198 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:06.200 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:13:06.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 msgr2=0x7f7114067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 0x7f7114067fe0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71180af000 tx=0x7f711801b040 comp rx=0 tx=0).stop 2023-09-10T00:13:06.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 msgr2=0x7f712806bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f712000cc70 tx=0x7f712000cd60 comp rx=0 tx=0).stop 2023-09-10T00:13:06.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 shutdown_connections 2023-09-10T00:13:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7114065b20 0x7f7114067fe0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7128159020 0x7f7128142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71280c9b60 0x7f71280a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 --2- 172.21.15.84:0/765190713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71280b0790 0x7f712806bc00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 >> 172.21.15.84:0/765190713 conn(0x7f71280cb7c0 msgr2=0x7f71280b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 shutdown_connections 2023-09-10T00:13:06.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.198+0000 7f7130476640 1 -- 172.21.15.84:0/765190713 wait complete. 2023-09-10T00:13:06.218 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-10T00:13:05.817487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3416064,"data_stored":2057454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004463"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782159+0000","last_change":"2023-09-10T00:12:41.509675+0000","last_active":"2023-09-10T00:12:47.782159+0000","last_peered":"2023-09-10T00:12:47.782159+0000","last_clean":"2023-09-10T00:12:47.782159+0000","last_became_active":"2023-09-10T00:12:41.509279+0000","last_became_peered":"2023-09-10T00:12:41.509279+0000","last_unstale":"2023-09-10T00:12:47.782159+0000","last_undegraded":"2023-09-10T00:12:47.782159+0000","last_fullsized":"2023-09-10T00:12:47.782159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783838+0000","last_change":"2023-09-10T00:12:42.539901+0000","last_active":"2023-09-10T00:12:47.783838+0000","last_peered":"2023-09-10T00:12:47.783838+0000","last_clean":"2023-09-10T00:12:47.783838+0000","last_became_active":"2023-09-10T00:12:42.539648+0000","last_became_peered":"2023-09-10T00:12:42.539648+0000","last_unstale":"2023-09-10T00:12:47.783838+0000","last_undegraded":"2023-09-10T00:12:47.783838+0000","last_fullsized":"2023-09-10T00:12:47.783838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577941+0000","last_change":"2023-09-10T00:12:47.443681+0000","last_active":"2023-09-10T00:12:48.577941+0000","last_peered":"2023-09-10T00:12:48.577941+0000","last_clean":"2023-09-10T00:12:48.577941+0000","last_became_active":"2023-09-10T00:12:47.442588+0000","last_became_peered":"2023-09-10T00:12:47.442588+0000","last_unstale":"2023-09-10T00:12:48.577941+0000","last_undegraded":"2023-09-10T00:12:48.577941+0000","last_fullsized":"2023-09-10T00:12:48.577941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:30:17.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784136+0000","last_change":"2023-09-10T00:12:41.502405+0000","last_active":"2023-09-10T00:12:47.784136+0000","last_peered":"2023-09-10T00:12:47.784136+0000","last_clean":"2023-09-10T00:12:47.784136+0000","last_became_active":"2023-09-10T00:12:41.502081+0000","last_became_peered":"2023-09-10T00:12:41.502081+0000","last_unstale":"2023-09-10T00:12:47.784136+0000","last_undegraded":"2023-09-10T00:12:47.784136+0000","last_fullsized":"2023-09-10T00:12:47.784136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781838+0000","last_change":"2023-09-10T00:12:42.550279+0000","last_active":"2023-09-10T00:12:47.781838+0000","last_peered":"2023-09-10T00:12:47.781838+0000","last_clean":"2023-09-10T00:12:47.781838+0000","last_became_active":"2023-09-10T00:12:42.549968+0000","last_became_peered":"2023-09-10T00:12:42.549968+0000","last_unstale":"2023-09-10T00:12:47.781838+0000","last_undegraded":"2023-09-10T00:12:47.781838+0000","last_fullsized":"2023-09-10T00:12:47.781838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581814+0000","last_change":"2023-09-10T00:12:46.587407+0000","last_active":"2023-09-10T00:12:48.581814+0000","last_peered":"2023-09-10T00:12:48.581814+0000","last_clean":"2023-09-10T00:12:48.581814+0000","last_became_active":"2023-09-10T00:12:46.585950+0000","last_became_peered":"2023-09-10T00:12:46.585950+0000","last_unstale":"2023-09-10T00:12:48.581814+0000","last_undegraded":"2023-09-10T00:12:48.581814+0000","last_fullsized":"2023-09-10T00:12:48.581814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:31.560504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783664+0000","last_change":"2023-09-10T00:12:41.527986+0000","last_active":"2023-09-10T00:12:47.783664+0000","last_peered":"2023-09-10T00:12:47.783664+0000","last_clean":"2023-09-10T00:12:47.783664+0000","last_became_active":"2023-09-10T00:12:41.527417+0000","last_became_peered":"2023-09-10T00:12:41.527417+0000","last_unstale":"2023-09-10T00:12:47.783664+0000","last_undegraded":"2023-09-10T00:12:47.783664+0000","last_fullsized":"2023-09-10T00:12:47.783664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781841+0000","last_change":"2023-09-10T00:12:42.549603+0000","last_active":"2023-09-10T00:12:47.781841+0000","last_peered":"2023-09-10T00:12:47.781841+0000","last_clean":"2023-09-10T00:12:47.781841+0000","last_became_active":"2023-09-10T00:12:42.549082+0000","last_became_peered":"2023-09-10T00:12:42.549082+0000","last_unstale":"2023-09-10T00:12:47.781841+0000","last_undegraded":"2023-09-10T00:12:47.781841+0000","last_fullsized":"2023-09-10T00:12:47.781841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583016+0000","last_change":"2023-09-10T00:12:46.598936+0000","last_active":"2023-09-10T00:12:48.583016+0000","last_peered":"2023-09-10T00:12:48.583016+0000","last_clean":"2023-09-10T00:12:48.583016+0000","last_became_active":"2023-09-10T00:12:46.595513+0000","last_became_peered":"2023-09-10T00:12:46.595513+0000","last_unstale":"2023-09-10T00:12:48.583016+0000","last_undegraded":"2023-09-10T00:12:48.583016+0000","last_fullsized":"2023-09-10T00:12:48.583016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783420+0000","last_change":"2023-09-10T00:12:41.528161+0000","last_active":"2023-09-10T00:12:47.783420+0000","last_peered":"2023-09-10T00:12:47.783420+0000","last_clean":"2023-09-10T00:12:47.783420+0000","last_became_active":"2023-09-10T00:12:41.527502+0000","last_became_peered":"2023-09-10T00:12:41.527502+0000","last_unstale":"2023-09-10T00:12:47.783420+0000","last_undegraded":"2023-09-10T00:12:47.783420+0000","last_fullsized":"2023-09-10T00:12:47.783420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782651+0000","last_change":"2023-09-10T00:12:42.540628+0000","last_active":"2023-09-10T00:12:47.782651+0000","last_peered":"2023-09-10T00:12:47.782651+0000","last_clean":"2023-09-10T00:12:47.782651+0000","last_became_active":"2023-09-10T00:12:42.539869+0000","last_became_peered":"2023-09-10T00:12:42.539869+0000","last_unstale":"2023-09-10T00:12:47.782651+0000","last_undegraded":"2023-09-10T00:12:47.782651+0000","last_fullsized":"2023-09-10T00:12:47.782651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582233+0000","last_change":"2023-09-10T00:12:46.591413+0000","last_active":"2023-09-10T00:12:48.582233+0000","last_peered":"2023-09-10T00:12:48.582233+0000","last_clean":"2023-09-10T00:12:48.582233+0000","last_became_active":"2023-09-10T00:12:46.590270+0000","last_became_peered":"2023-09-10T00:12:46.590270+0000","last_unstale":"2023-09-10T00:12:48.582233+0000","last_undegraded":"2023-09-10T00:12:48.582233+0000","last_fullsized":"2023-09-10T00:12:48.582233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:43:11.882300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581794+0000","last_change":"2023-09-10T00:12:42.507279+0000","last_active":"2023-09-10T00:12:47.581794+0000","last_peered":"2023-09-10T00:12:47.581794+0000","last_clean":"2023-09-10T00:12:47.581794+0000","last_became_active":"2023-09-10T00:12:42.506014+0000","last_became_peered":"2023-09-10T00:12:42.506014+0000","last_unstale":"2023-09-10T00:12:47.581794+0000","last_undegraded":"2023-09-10T00:12:47.581794+0000","last_fullsized":"2023-09-10T00:12:47.581794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783530+0000","last_change":"2023-09-10T00:12:41.530493+0000","last_active":"2023-09-10T00:12:47.783530+0000","last_peered":"2023-09-10T00:12:47.783530+0000","last_clean":"2023-09-10T00:12:47.783530+0000","last_became_active":"2023-09-10T00:12:41.529930+0000","last_became_peered":"2023-09-10T00:12:41.529930+0000","last_unstale":"2023-09-10T00:12:47.783530+0000","last_undegraded":"2023-09-10T00:12:47.783530+0000","last_fullsized":"2023-09-10T00:12:47.783530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584979+0000","last_change":"2023-09-10T00:12:46.585841+0000","last_active":"2023-09-10T00:12:48.584979+0000","last_peered":"2023-09-10T00:12:48.584979+0000","last_clean":"2023-09-10T00:12:48.584979+0000","last_became_active":"2023-09-10T00:12:46.584664+0000","last_became_peered":"2023-09-10T00:12:46.584664+0000","last_unstale":"2023-09-10T00:12:48.584979+0000","last_undegraded":"2023-09-10T00:12:48.584979+0000","last_fullsized":"2023-09-10T00:12:48.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783202+0000","last_change":"2023-09-10T00:12:42.503145+0000","last_active":"2023-09-10T00:12:47.783202+0000","last_peered":"2023-09-10T00:12:47.783202+0000","last_clean":"2023-09-10T00:12:47.783202+0000","last_became_active":"2023-09-10T00:12:42.502860+0000","last_became_peered":"2023-09-10T00:12:42.502860+0000","last_unstale":"2023-09-10T00:12:47.783202+0000","last_undegraded":"2023-09-10T00:12:47.783202+0000","last_fullsized":"2023-09-10T00:12:47.783202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615505+0000","last_change":"2023-09-10T00:12:41.495145+0000","last_active":"2023-09-10T00:12:47.615505+0000","last_peered":"2023-09-10T00:12:47.615505+0000","last_clean":"2023-09-10T00:12:47.615505+0000","last_became_active":"2023-09-10T00:12:41.494723+0000","last_became_peered":"2023-09-10T00:12:41.494723+0000","last_unstale":"2023-09-10T00:12:47.615505+0000","last_undegraded":"2023-09-10T00:12:47.615505+0000","last_fullsized":"2023-09-10T00:12:47.615505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:28:44.771070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584304+0000","last_change":"2023-09-10T00:12:46.598895+0000","last_active":"2023-09-10T00:12:48.584304+0000","last_peered":"2023-09-10T00:12:48.584304+0000","last_clean":"2023-09-10T00:12:48.584304+0000","last_became_active":"2023-09-10T00:12:46.597512+0000","last_became_peered":"2023-09-10T00:12:46.597512+0000","last_unstale":"2023-09-10T00:12:48.584304+0000","last_undegraded":"2023-09-10T00:12:48.584304+0000","last_fullsized":"2023-09-10T00:12:48.584304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782945+0000","last_change":"2023-09-10T00:12:42.506592+0000","last_active":"2023-09-10T00:12:47.782945+0000","last_peered":"2023-09-10T00:12:47.782945+0000","last_clean":"2023-09-10T00:12:47.782945+0000","last_became_active":"2023-09-10T00:12:42.498699+0000","last_became_peered":"2023-09-10T00:12:42.498699+0000","last_unstale":"2023-09-10T00:12:47.782945+0000","last_undegraded":"2023-09-10T00:12:47.782945+0000","last_fullsized":"2023-09-10T00:12:47.782945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614899+0000","last_change":"2023-09-10T00:12:41.511349+0000","last_active":"2023-09-10T00:12:47.614899+0000","last_peered":"2023-09-10T00:12:47.614899+0000","last_clean":"2023-09-10T00:12:47.614899+0000","last_became_active":"2023-09-10T00:12:41.511068+0000","last_became_peered":"2023-09-10T00:12:41.511068+0000","last_unstale":"2023-09-10T00:12:47.614899+0000","last_undegraded":"2023-09-10T00:12:47.614899+0000","last_fullsized":"2023-09-10T00:12:47.614899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:15.836419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224891+0000","last_change":"2023-09-10T00:12:47.444639+0000","last_active":"2023-09-10T00:12:49.224891+0000","last_peered":"2023-09-10T00:12:49.224891+0000","last_clean":"2023-09-10T00:12:49.224891+0000","last_became_active":"2023-09-10T00:12:47.443285+0000","last_became_peered":"2023-09-10T00:12:47.443285+0000","last_unstale":"2023-09-10T00:12:49.224891+0000","last_undegraded":"2023-09-10T00:12:49.224891+0000","last_fullsized":"2023-09-10T00:12:49.224891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:23.785184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580956+0000","last_change":"2023-09-10T00:12:42.502827+0000","last_active":"2023-09-10T00:12:47.580956+0000","last_peered":"2023-09-10T00:12:47.580956+0000","last_clean":"2023-09-10T00:12:47.580956+0000","last_became_active":"2023-09-10T00:12:42.498059+0000","last_became_peered":"2023-09-10T00:12:42.498059+0000","last_unstale":"2023-09-10T00:12:47.580956+0000","last_undegraded":"2023-09-10T00:12:47.580956+0000","last_fullsized":"2023-09-10T00:12:47.580956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:30.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782172+0000","last_change":"2023-09-10T00:12:41.522787+0000","last_active":"2023-09-10T00:12:47.782172+0000","last_peered":"2023-09-10T00:12:47.782172+0000","last_clean":"2023-09-10T00:12:47.782172+0000","last_became_active":"2023-09-10T00:12:41.521261+0000","last_became_peered":"2023-09-10T00:12:41.521261+0000","last_unstale":"2023-09-10T00:12:47.782172+0000","last_undegraded":"2023-09-10T00:12:47.782172+0000","last_fullsized":"2023-09-10T00:12:47.782172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:04:32.449308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584798+0000","last_change":"2023-09-10T00:12:46.594098+0000","last_active":"2023-09-10T00:12:48.584798+0000","last_peered":"2023-09-10T00:12:48.584798+0000","last_clean":"2023-09-10T00:12:48.584798+0000","last_became_active":"2023-09-10T00:12:46.592902+0000","last_became_peered":"2023-09-10T00:12:46.592902+0000","last_unstale":"2023-09-10T00:12:48.584798+0000","last_undegraded":"2023-09-10T00:12:48.584798+0000","last_fullsized":"2023-09-10T00:12:48.584798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781833+0000","last_change":"2023-09-10T00:12:42.494258+0000","last_active":"2023-09-10T00:12:47.781833+0000","last_peered":"2023-09-10T00:12:47.781833+0000","last_clean":"2023-09-10T00:12:47.781833+0000","last_became_active":"2023-09-10T00:12:42.493975+0000","last_became_peered":"2023-09-10T00:12:42.493975+0000","last_unstale":"2023-09-10T00:12:47.781833+0000","last_undegraded":"2023-09-10T00:12:47.781833+0000","last_fullsized":"2023-09-10T00:12:47.781833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583823+0000","last_change":"2023-09-10T00:12:41.507450+0000","last_active":"2023-09-10T00:12:47.583823+0000","last_peered":"2023-09-10T00:12:47.583823+0000","last_clean":"2023-09-10T00:12:47.583823+0000","last_became_active":"2023-09-10T00:12:41.506687+0000","last_became_peered":"2023-09-10T00:12:41.506687+0000","last_unstale":"2023-09-10T00:12:47.583823+0000","last_undegraded":"2023-09-10T00:12:47.583823+0000","last_fullsized":"2023-09-10T00:12:47.583823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582305+0000","last_change":"2023-09-10T00:12:47.439167+0000","last_active":"2023-09-10T00:12:48.582305+0000","last_peered":"2023-09-10T00:12:48.582305+0000","last_clean":"2023-09-10T00:12:48.582305+0000","last_became_active":"2023-09-10T00:12:47.438136+0000","last_became_peered":"2023-09-10T00:12:47.438136+0000","last_unstale":"2023-09-10T00:12:48.582305+0000","last_undegraded":"2023-09-10T00:12:48.582305+0000","last_fullsized":"2023-09-10T00:12:48.582305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:39:24.652596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784017+0000","last_change":"2023-09-10T00:12:42.505311+0000","last_active":"2023-09-10T00:12:47.784017+0000","last_peered":"2023-09-10T00:12:47.784017+0000","last_clean":"2023-09-10T00:12:47.784017+0000","last_became_active":"2023-09-10T00:12:42.504994+0000","last_became_peered":"2023-09-10T00:12:42.504994+0000","last_unstale":"2023-09-10T00:12:47.784017+0000","last_undegraded":"2023-09-10T00:12:47.784017+0000","last_fullsized":"2023-09-10T00:12:47.784017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615569+0000","last_change":"2023-09-10T00:12:41.511281+0000","last_active":"2023-09-10T00:12:47.615569+0000","last_peered":"2023-09-10T00:12:47.615569+0000","last_clean":"2023-09-10T00:12:47.615569+0000","last_became_active":"2023-09-10T00:12:41.510955+0000","last_became_peered":"2023-09-10T00:12:41.510955+0000","last_unstale":"2023-09-10T00:12:47.615569+0000","last_undegraded":"2023-09-10T00:12:47.615569+0000","last_fullsized":"2023-09-10T00:12:47.615569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:04:20.102763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577831+0000","last_change":"2023-09-10T00:12:47.439819+0000","last_active":"2023-09-10T00:12:48.577831+0000","last_peered":"2023-09-10T00:12:48.577831+0000","last_clean":"2023-09-10T00:12:48.577831+0000","last_became_active":"2023-09-10T00:12:47.438387+0000","last_became_peered":"2023-09-10T00:12:47.438387+0000","last_unstale":"2023-09-10T00:12:48.577831+0000","last_undegraded":"2023-09-10T00:12:48.577831+0000","last_fullsized":"2023-09-10T00:12:48.577831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:19:55.443215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615124+0000","last_change":"2023-09-10T00:12:42.505051+0000","last_active":"2023-09-10T00:12:47.615124+0000","last_peered":"2023-09-10T00:12:47.615124+0000","last_clean":"2023-09-10T00:12:47.615124+0000","last_became_active":"2023-09-10T00:12:42.503680+0000","last_became_peered":"2023-09-10T00:12:42.503680+0000","last_unstale":"2023-09-10T00:12:47.615124+0000","last_undegraded":"2023-09-10T00:12:47.615124+0000","last_fullsized":"2023-09-10T00:12:47.615124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:32.318944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:41.530921+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:41.529005+0000","last_became_peered":"2023-09-10T00:12:41.529005+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:39.114481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222557+0000","last_change":"2023-09-10T00:12:47.432879+0000","last_active":"2023-09-10T00:12:49.222557+0000","last_peered":"2023-09-10T00:12:49.222557+0000","last_clean":"2023-09-10T00:12:49.222557+0000","last_became_active":"2023-09-10T00:12:47.431809+0000","last_became_peered":"2023-09-10T00:12:47.431809+0000","last_unstale":"2023-09-10T00:12:49.222557+0000","last_undegraded":"2023-09-10T00:12:49.222557+0000","last_fullsized":"2023-09-10T00:12:49.222557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782710+0000","last_change":"2023-09-10T00:12:42.539827+0000","last_active":"2023-09-10T00:12:47.782710+0000","last_peered":"2023-09-10T00:12:47.782710+0000","last_clean":"2023-09-10T00:12:47.782710+0000","last_became_active":"2023-09-10T00:12:42.537005+0000","last_became_peered":"2023-09-10T00:12:42.537005+0000","last_unstale":"2023-09-10T00:12:47.782710+0000","last_undegraded":"2023-09-10T00:12:47.782710+0000","last_fullsized":"2023-09-10T00:12:47.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615250+0000","last_change":"2023-09-10T00:12:41.502711+0000","last_active":"2023-09-10T00:12:47.615250+0000","last_peered":"2023-09-10T00:12:47.615250+0000","last_clean":"2023-09-10T00:12:47.615250+0000","last_became_active":"2023-09-10T00:12:41.501978+0000","last_became_peered":"2023-09-10T00:12:41.501978+0000","last_unstale":"2023-09-10T00:12:47.615250+0000","last_undegraded":"2023-09-10T00:12:47.615250+0000","last_fullsized":"2023-09-10T00:12:47.615250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:02:42.904824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223956+0000","last_change":"2023-09-10T00:12:46.590131+0000","last_active":"2023-09-10T00:12:49.223956+0000","last_peered":"2023-09-10T00:12:49.223956+0000","last_clean":"2023-09-10T00:12:49.223956+0000","last_became_active":"2023-09-10T00:12:46.589585+0000","last_became_peered":"2023-09-10T00:12:46.589585+0000","last_unstale":"2023-09-10T00:12:49.223956+0000","last_undegraded":"2023-09-10T00:12:49.223956+0000","last_fullsized":"2023-09-10T00:12:49.223956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:27:21.324259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581586+0000","last_change":"2023-09-10T00:12:42.487629+0000","last_active":"2023-09-10T00:12:47.581586+0000","last_peered":"2023-09-10T00:12:47.581586+0000","last_clean":"2023-09-10T00:12:47.581586+0000","last_became_active":"2023-09-10T00:12:42.486705+0000","last_became_peered":"2023-09-10T00:12:42.486705+0000","last_unstale":"2023-09-10T00:12:47.581586+0000","last_undegraded":"2023-09-10T00:12:47.581586+0000","last_fullsized":"2023-09-10T00:12:47.581586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:34:10.530303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782116+0000","last_change":"2023-09-10T00:12:41.524050+0000","last_active":"2023-09-10T00:12:47.782116+0000","last_peered":"2023-09-10T00:12:47.782116+0000","last_clean":"2023-09-10T00:12:47.782116+0000","last_became_active":"2023-09-10T00:12:41.523285+0000","last_became_peered":"2023-09-10T00:12:41.523285+0000","last_unstale":"2023-09-10T00:12:47.782116+0000","last_undegraded":"2023-09-10T00:12:47.782116+0000","last_fullsized":"2023-09-10T00:12:47.782116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224831+0000","last_change":"2023-09-10T00:12:46.591434+0000","last_active":"2023-09-10T00:12:49.224831+0000","last_peered":"2023-09-10T00:12:49.224831+0000","last_clean":"2023-09-10T00:12:49.224831+0000","last_became_active":"2023-09-10T00:12:46.590715+0000","last_became_peered":"2023-09-10T00:12:46.590715+0000","last_unstale":"2023-09-10T00:12:49.224831+0000","last_undegraded":"2023-09-10T00:12:49.224831+0000","last_fullsized":"2023-09-10T00:12:49.224831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:01:46.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615490+0000","last_change":"2023-09-10T00:12:42.497905+0000","last_active":"2023-09-10T00:12:47.615490+0000","last_peered":"2023-09-10T00:12:47.615490+0000","last_clean":"2023-09-10T00:12:47.615490+0000","last_became_active":"2023-09-10T00:12:42.497598+0000","last_became_peered":"2023-09-10T00:12:42.497598+0000","last_unstale":"2023-09-10T00:12:47.615490+0000","last_undegraded":"2023-09-10T00:12:47.615490+0000","last_fullsized":"2023-09-10T00:12:47.615490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:39:55.974777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577625+0000","last_change":"2023-09-10T00:12:41.498033+0000","last_active":"2023-09-10T00:12:47.577625+0000","last_peered":"2023-09-10T00:12:47.577625+0000","last_clean":"2023-09-10T00:12:47.577625+0000","last_became_active":"2023-09-10T00:12:41.497632+0000","last_became_peered":"2023-09-10T00:12:41.497632+0000","last_unstale":"2023-09-10T00:12:47.577625+0000","last_undegraded":"2023-09-10T00:12:47.577625+0000","last_fullsized":"2023-09-10T00:12:47.577625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:53:47.827726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224987+0000","last_change":"2023-09-10T00:12:46.589989+0000","last_active":"2023-09-10T00:12:49.224987+0000","last_peered":"2023-09-10T00:12:49.224987+0000","last_clean":"2023-09-10T00:12:49.224987+0000","last_became_active":"2023-09-10T00:12:46.589560+0000","last_became_peered":"2023-09-10T00:12:46.589560+0000","last_unstale":"2023-09-10T00:12:49.224987+0000","last_undegraded":"2023-09-10T00:12:49.224987+0000","last_fullsized":"2023-09-10T00:12:49.224987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:23:04.922319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780468+0000","last_change":"2023-09-10T00:12:42.492499+0000","last_active":"2023-09-10T00:12:47.780468+0000","last_peered":"2023-09-10T00:12:47.780468+0000","last_clean":"2023-09-10T00:12:47.780468+0000","last_became_active":"2023-09-10T00:12:42.492155+0000","last_became_peered":"2023-09-10T00:12:42.492155+0000","last_unstale":"2023-09-10T00:12:47.780468+0000","last_undegraded":"2023-09-10T00:12:47.780468+0000","last_fullsized":"2023-09-10T00:12:47.780468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:01.022446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782334+0000","last_change":"2023-09-10T00:12:41.523334+0000","last_active":"2023-09-10T00:12:47.782334+0000","last_peered":"2023-09-10T00:12:47.782334+0000","last_clean":"2023-09-10T00:12:47.782334+0000","last_became_active":"2023-09-10T00:12:41.522077+0000","last_became_peered":"2023-09-10T00:12:41.522077+0000","last_unstale":"2023-09-10T00:12:47.782334+0000","last_undegraded":"2023-09-10T00:12:47.782334+0000","last_fullsized":"2023-09-10T00:12:47.782334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:45:56.684537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223676+0000","last_change":"2023-09-10T00:12:47.432900+0000","last_active":"2023-09-10T00:12:49.223676+0000","last_peered":"2023-09-10T00:12:49.223676+0000","last_clean":"2023-09-10T00:12:49.223676+0000","last_became_active":"2023-09-10T00:12:47.431680+0000","last_became_peered":"2023-09-10T00:12:47.431680+0000","last_unstale":"2023-09-10T00:12:49.223676+0000","last_undegraded":"2023-09-10T00:12:49.223676+0000","last_fullsized":"2023-09-10T00:12:49.223676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782928+0000","last_change":"2023-09-10T00:12:42.550864+0000","last_active":"2023-09-10T00:12:47.782928+0000","last_peered":"2023-09-10T00:12:47.782928+0000","last_clean":"2023-09-10T00:12:47.782928+0000","last_became_active":"2023-09-10T00:12:42.550585+0000","last_became_peered":"2023-09-10T00:12:42.550585+0000","last_unstale":"2023-09-10T00:12:47.782928+0000","last_undegraded":"2023-09-10T00:12:47.782928+0000","last_fullsized":"2023-09-10T00:12:47.782928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781180+0000","last_change":"2023-09-10T00:12:41.519797+0000","last_active":"2023-09-10T00:12:47.781180+0000","last_peered":"2023-09-10T00:12:47.781180+0000","last_clean":"2023-09-10T00:12:47.781180+0000","last_became_active":"2023-09-10T00:12:41.519164+0000","last_became_peered":"2023-09-10T00:12:41.519164+0000","last_unstale":"2023-09-10T00:12:47.781180+0000","last_undegraded":"2023-09-10T00:12:47.781180+0000","last_fullsized":"2023-09-10T00:12:47.781180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782450+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:12:47.782450+0000","last_peered":"2023-09-10T00:12:47.782450+0000","last_clean":"2023-09-10T00:12:47.782450+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:12:47.782450+0000","last_undegraded":"2023-09-10T00:12:47.782450+0000","last_fullsized":"2023-09-10T00:12:47.782450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584664+0000","last_change":"2023-09-10T00:12:47.439252+0000","last_active":"2023-09-10T00:12:48.584664+0000","last_peered":"2023-09-10T00:12:48.584664+0000","last_clean":"2023-09-10T00:12:48.584664+0000","last_became_active":"2023-09-10T00:12:47.438174+0000","last_became_peered":"2023-09-10T00:12:47.438174+0000","last_unstale":"2023-09-10T00:12:48.584664+0000","last_undegraded":"2023-09-10T00:12:48.584664+0000","last_fullsized":"2023-09-10T00:12:48.584664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:57.581942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783443+0000","last_change":"2023-09-10T00:12:42.551864+0000","last_active":"2023-09-10T00:12:47.783443+0000","last_peered":"2023-09-10T00:12:47.783443+0000","last_clean":"2023-09-10T00:12:47.783443+0000","last_became_active":"2023-09-10T00:12:42.551345+0000","last_became_peered":"2023-09-10T00:12:42.551345+0000","last_unstale":"2023-09-10T00:12:47.783443+0000","last_undegraded":"2023-09-10T00:12:47.783443+0000","last_fullsized":"2023-09-10T00:12:47.783443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578183+0000","last_change":"2023-09-10T00:12:41.516689+0000","last_active":"2023-09-10T00:12:47.578183+0000","last_peered":"2023-09-10T00:12:47.578183+0000","last_clean":"2023-09-10T00:12:47.578183+0000","last_became_active":"2023-09-10T00:12:41.516069+0000","last_became_peered":"2023-09-10T00:12:41.516069+0000","last_unstale":"2023-09-10T00:12:47.578183+0000","last_undegraded":"2023-09-10T00:12:47.578183+0000","last_fullsized":"2023-09-10T00:12:47.578183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:22:16.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582898+0000","last_change":"2023-09-10T00:12:47.431597+0000","last_active":"2023-09-10T00:12:48.582898+0000","last_peered":"2023-09-10T00:12:48.582898+0000","last_clean":"2023-09-10T00:12:48.582898+0000","last_became_active":"2023-09-10T00:12:47.430655+0000","last_became_peered":"2023-09-10T00:12:47.430655+0000","last_unstale":"2023-09-10T00:12:48.582898+0000","last_undegraded":"2023-09-10T00:12:48.582898+0000","last_fullsized":"2023-09-10T00:12:48.582898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:33:42.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782062+0000","last_change":"2023-09-10T00:12:42.541778+0000","last_active":"2023-09-10T00:12:47.782062+0000","last_peered":"2023-09-10T00:12:47.782062+0000","last_clean":"2023-09-10T00:12:47.782062+0000","last_became_active":"2023-09-10T00:12:42.541049+0000","last_became_peered":"2023-09-10T00:12:42.541049+0000","last_unstale":"2023-09-10T00:12:47.782062+0000","last_undegraded":"2023-09-10T00:12:47.782062+0000","last_fullsized":"2023-09-10T00:12:47.782062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615672+0000","last_change":"2023-09-10T00:12:41.509830+0000","last_active":"2023-09-10T00:12:47.615672+0000","last_peered":"2023-09-10T00:12:47.615672+0000","last_clean":"2023-09-10T00:12:47.615672+0000","last_became_active":"2023-09-10T00:12:41.509495+0000","last_became_peered":"2023-09-10T00:12:41.509495+0000","last_unstale":"2023-09-10T00:12:47.615672+0000","last_undegraded":"2023-09-10T00:12:47.615672+0000","last_fullsized":"2023-09-10T00:12:47.615672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:44:59.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223136+0000","last_change":"2023-09-10T00:12:46.595012+0000","last_active":"2023-09-10T00:12:49.223136+0000","last_peered":"2023-09-10T00:12:49.223136+0000","last_clean":"2023-09-10T00:12:49.223136+0000","last_became_active":"2023-09-10T00:12:46.594222+0000","last_became_peered":"2023-09-10T00:12:46.594222+0000","last_unstale":"2023-09-10T00:12:49.223136+0000","last_undegraded":"2023-09-10T00:12:49.223136+0000","last_fullsized":"2023-09-10T00:12:49.223136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784267+0000","last_change":"2023-09-10T00:12:42.546647+0000","last_active":"2023-09-10T00:12:47.784267+0000","last_peered":"2023-09-10T00:12:47.784267+0000","last_clean":"2023-09-10T00:12:47.784267+0000","last_became_active":"2023-09-10T00:12:42.546180+0000","last_became_peered":"2023-09-10T00:12:42.546180+0000","last_unstale":"2023-09-10T00:12:47.784267+0000","last_undegraded":"2023-09-10T00:12:47.784267+0000","last_fullsized":"2023-09-10T00:12:47.784267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578028+0000","last_change":"2023-09-10T00:12:41.498190+0000","last_active":"2023-09-10T00:12:47.578028+0000","last_peered":"2023-09-10T00:12:47.578028+0000","last_clean":"2023-09-10T00:12:47.578028+0000","last_became_active":"2023-09-10T00:12:41.497767+0000","last_became_peered":"2023-09-10T00:12:41.497767+0000","last_unstale":"2023-09-10T00:12:47.578028+0000","last_undegraded":"2023-09-10T00:12:47.578028+0000","last_fullsized":"2023-09-10T00:12:47.578028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:26:08.442308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222434+0000","last_change":"2023-09-10T00:12:47.432026+0000","last_active":"2023-09-10T00:12:49.222434+0000","last_peered":"2023-09-10T00:12:49.222434+0000","last_clean":"2023-09-10T00:12:49.222434+0000","last_became_active":"2023-09-10T00:12:47.430924+0000","last_became_peered":"2023-09-10T00:12:47.430924+0000","last_unstale":"2023-09-10T00:12:49.222434+0000","last_undegraded":"2023-09-10T00:12:49.222434+0000","last_fullsized":"2023-09-10T00:12:49.222434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783979+0000","last_change":"2023-09-10T00:12:42.541280+0000","last_active":"2023-09-10T00:12:47.783979+0000","last_peered":"2023-09-10T00:12:47.783979+0000","last_clean":"2023-09-10T00:12:47.783979+0000","last_became_active":"2023-09-10T00:12:42.533762+0000","last_became_peered":"2023-09-10T00:12:42.533762+0000","last_unstale":"2023-09-10T00:12:47.783979+0000","last_undegraded":"2023-09-10T00:12:47.783979+0000","last_fullsized":"2023-09-10T00:12:47.783979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581569+0000","last_change":"2023-09-10T00:12:41.503433+0000","last_active":"2023-09-10T00:12:47.581569+0000","last_peered":"2023-09-10T00:12:47.581569+0000","last_clean":"2023-09-10T00:12:47.581569+0000","last_became_active":"2023-09-10T00:12:41.502639+0000","last_became_peered":"2023-09-10T00:12:41.502639+0000","last_unstale":"2023-09-10T00:12:47.581569+0000","last_undegraded":"2023-09-10T00:12:47.581569+0000","last_fullsized":"2023-09-10T00:12:47.581569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:28:54.792772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581399+0000","last_change":"2023-09-10T00:12:46.602461+0000","last_active":"2023-09-10T00:12:48.581399+0000","last_peered":"2023-09-10T00:12:48.581399+0000","last_clean":"2023-09-10T00:12:48.581399+0000","last_became_active":"2023-09-10T00:12:46.601011+0000","last_became_peered":"2023-09-10T00:12:46.601011+0000","last_unstale":"2023-09-10T00:12:48.581399+0000","last_undegraded":"2023-09-10T00:12:48.581399+0000","last_fullsized":"2023-09-10T00:12:48.581399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782746+0000","last_change":"2023-09-10T00:12:42.518701+0000","last_active":"2023-09-10T00:12:47.782746+0000","last_peered":"2023-09-10T00:12:47.782746+0000","last_clean":"2023-09-10T00:12:47.782746+0000","last_became_active":"2023-09-10T00:12:42.517943+0000","last_became_peered":"2023-09-10T00:12:42.517943+0000","last_unstale":"2023-09-10T00:12:47.782746+0000","last_undegraded":"2023-09-10T00:12:47.782746+0000","last_fullsized":"2023-09-10T00:12:47.782746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577561+0000","last_change":"2023-09-10T00:12:41.496219+0000","last_active":"2023-09-10T00:12:47.577561+0000","last_peered":"2023-09-10T00:12:47.577561+0000","last_clean":"2023-09-10T00:12:47.577561+0000","last_became_active":"2023-09-10T00:12:41.495862+0000","last_became_peered":"2023-09-10T00:12:41.495862+0000","last_unstale":"2023-09-10T00:12:47.577561+0000","last_undegraded":"2023-09-10T00:12:47.577561+0000","last_fullsized":"2023-09-10T00:12:47.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:56:10.667850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223317+0000","last_change":"2023-09-10T00:12:46.592307+0000","last_active":"2023-09-10T00:12:49.223317+0000","last_peered":"2023-09-10T00:12:49.223317+0000","last_clean":"2023-09-10T00:12:49.223317+0000","last_became_active":"2023-09-10T00:12:46.591133+0000","last_became_peered":"2023-09-10T00:12:46.591133+0000","last_unstale":"2023-09-10T00:12:49.223317+0000","last_undegraded":"2023-09-10T00:12:49.223317+0000","last_fullsized":"2023-09-10T00:12:49.223317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580013+0000","last_change":"2023-09-10T00:12:42.524709+0000","last_active":"2023-09-10T00:12:47.580013+0000","last_peered":"2023-09-10T00:12:47.580013+0000","last_clean":"2023-09-10T00:12:47.580013+0000","last_became_active":"2023-09-10T00:12:42.505826+0000","last_became_peered":"2023-09-10T00:12:42.505826+0000","last_unstale":"2023-09-10T00:12:47.580013+0000","last_undegraded":"2023-09-10T00:12:47.580013+0000","last_fullsized":"2023-09-10T00:12:47.580013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579962+0000","last_change":"2023-09-10T00:12:41.495448+0000","last_active":"2023-09-10T00:12:47.579962+0000","last_peered":"2023-09-10T00:12:47.579962+0000","last_clean":"2023-09-10T00:12:47.579962+0000","last_became_active":"2023-09-10T00:12:41.494697+0000","last_became_peered":"2023-09-10T00:12:41.494697+0000","last_unstale":"2023-09-10T00:12:47.579962+0000","last_undegraded":"2023-09-10T00:12:47.579962+0000","last_fullsized":"2023-09-10T00:12:47.579962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:21:19.631538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579415+0000","last_change":"2023-09-10T00:12:47.439992+0000","last_active":"2023-09-10T00:12:48.579415+0000","last_peered":"2023-09-10T00:12:48.579415+0000","last_clean":"2023-09-10T00:12:48.579415+0000","last_became_active":"2023-09-10T00:12:47.438590+0000","last_became_peered":"2023-09-10T00:12:47.438590+0000","last_unstale":"2023-09-10T00:12:48.579415+0000","last_undegraded":"2023-09-10T00:12:48.579415+0000","last_fullsized":"2023-09-10T00:12:48.579415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:09:09.398224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783239+0000","last_change":"2023-09-10T00:12:42.541600+0000","last_active":"2023-09-10T00:12:47.783239+0000","last_peered":"2023-09-10T00:12:47.783239+0000","last_clean":"2023-09-10T00:12:47.783239+0000","last_became_active":"2023-09-10T00:12:42.533858+0000","last_became_peered":"2023-09-10T00:12:42.533858+0000","last_unstale":"2023-09-10T00:12:47.783239+0000","last_undegraded":"2023-09-10T00:12:47.783239+0000","last_fullsized":"2023-09-10T00:12:47.783239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781900+0000","last_change":"2023-09-10T00:12:41.523860+0000","last_active":"2023-09-10T00:12:47.781900+0000","last_peered":"2023-09-10T00:12:47.781900+0000","last_clean":"2023-09-10T00:12:47.781900+0000","last_became_active":"2023-09-10T00:12:41.522192+0000","last_became_peered":"2023-09-10T00:12:41.522192+0000","last_unstale":"2023-09-10T00:12:47.781900+0000","last_undegraded":"2023-09-10T00:12:47.781900+0000","last_fullsized":"2023-09-10T00:12:47.781900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:29.890350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578583+0000","last_change":"2023-09-10T00:12:47.432628+0000","last_active":"2023-09-10T00:12:48.578583+0000","last_peered":"2023-09-10T00:12:48.578583+0000","last_clean":"2023-09-10T00:12:48.578583+0000","last_became_active":"2023-09-10T00:12:47.431415+0000","last_became_peered":"2023-09-10T00:12:47.431415+0000","last_unstale":"2023-09-10T00:12:48.578583+0000","last_undegraded":"2023-09-10T00:12:48.578583+0000","last_fullsized":"2023-09-10T00:12:48.578583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:30:23.542385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780877+0000","last_change":"2023-09-10T00:12:42.514023+0000","last_active":"2023-09-10T00:12:47.780877+0000","last_peered":"2023-09-10T00:12:47.780877+0000","last_clean":"2023-09-10T00:12:47.780877+0000","last_became_active":"2023-09-10T00:12:42.513715+0000","last_became_peered":"2023-09-10T00:12:42.513715+0000","last_unstale":"2023-09-10T00:12:47.780877+0000","last_undegraded":"2023-09-10T00:12:47.780877+0000","last_fullsized":"2023-09-10T00:12:47.780877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781349+0000","last_change":"2023-09-10T00:12:41.501329+0000","last_active":"2023-09-10T00:12:47.781349+0000","last_peered":"2023-09-10T00:12:47.781349+0000","last_clean":"2023-09-10T00:12:47.781349+0000","last_became_active":"2023-09-10T00:12:41.500908+0000","last_became_peered":"2023-09-10T00:12:41.500908+0000","last_unstale":"2023-09-10T00:12:47.781349+0000","last_undegraded":"2023-09-10T00:12:47.781349+0000","last_fullsized":"2023-09-10T00:12:47.781349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:42.290409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223679+0000","last_change":"2023-09-10T00:12:47.439596+0000","last_active":"2023-09-10T00:12:49.223679+0000","last_peered":"2023-09-10T00:12:49.223679+0000","last_clean":"2023-09-10T00:12:49.223679+0000","last_became_active":"2023-09-10T00:12:47.438423+0000","last_became_peered":"2023-09-10T00:12:47.438423+0000","last_unstale":"2023-09-10T00:12:49.223679+0000","last_undegraded":"2023-09-10T00:12:49.223679+0000","last_fullsized":"2023-09-10T00:12:49.223679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783453+0000","last_change":"2023-09-10T00:12:42.518431+0000","last_active":"2023-09-10T00:12:47.783453+0000","last_peered":"2023-09-10T00:12:47.783453+0000","last_clean":"2023-09-10T00:12:47.783453+0000","last_became_active":"2023-09-10T00:12:42.515011+0000","last_became_peered":"2023-09-10T00:12:42.515011+0000","last_unstale":"2023-09-10T00:12:47.783453+0000","last_undegraded":"2023-09-10T00:12:47.783453+0000","last_fullsized":"2023-09-10T00:12:47.783453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:52.647101+0000","last_change":"2023-09-10T00:12:41.501247+0000","last_active":"2023-09-10T00:12:52.647101+0000","last_peered":"2023-09-10T00:12:52.647101+0000","last_clean":"2023-09-10T00:12:52.647101+0000","last_became_active":"2023-09-10T00:12:41.500391+0000","last_became_peered":"2023-09-10T00:12:41.500391+0000","last_unstale":"2023-09-10T00:12:52.647101+0000","last_undegraded":"2023-09-10T00:12:52.647101+0000","last_fullsized":"2023-09-10T00:12:52.647101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224306+0000","last_change":"2023-09-10T00:12:46.591484+0000","last_active":"2023-09-10T00:12:49.224306+0000","last_peered":"2023-09-10T00:12:49.224306+0000","last_clean":"2023-09-10T00:12:49.224306+0000","last_became_active":"2023-09-10T00:12:46.590895+0000","last_became_peered":"2023-09-10T00:12:46.590895+0000","last_unstale":"2023-09-10T00:12:49.224306+0000","last_undegraded":"2023-09-10T00:12:49.224306+0000","last_fullsized":"2023-09-10T00:12:49.224306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:50:45.730271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581291+0000","last_change":"2023-09-10T00:12:42.521690+0000","last_active":"2023-09-10T00:12:47.581291+0000","last_peered":"2023-09-10T00:12:47.581291+0000","last_clean":"2023-09-10T00:12:47.581291+0000","last_became_active":"2023-09-10T00:12:42.520931+0000","last_became_peered":"2023-09-10T00:12:42.520931+0000","last_unstale":"2023-09-10T00:12:47.581291+0000","last_undegraded":"2023-09-10T00:12:47.581291+0000","last_fullsized":"2023-09-10T00:12:47.581291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:03.905490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615500+0000","last_change":"2023-09-10T00:12:41.527727+0000","last_active":"2023-09-10T00:12:47.615500+0000","last_peered":"2023-09-10T00:12:47.615500+0000","last_clean":"2023-09-10T00:12:47.615500+0000","last_became_active":"2023-09-10T00:12:41.527495+0000","last_became_peered":"2023-09-10T00:12:41.527495+0000","last_unstale":"2023-09-10T00:12:47.615500+0000","last_undegraded":"2023-09-10T00:12:47.615500+0000","last_fullsized":"2023-09-10T00:12:47.615500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:41.673766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583605+0000","last_change":"2023-09-10T00:12:46.593774+0000","last_active":"2023-09-10T00:12:48.583605+0000","last_peered":"2023-09-10T00:12:48.583605+0000","last_clean":"2023-09-10T00:12:48.583605+0000","last_became_active":"2023-09-10T00:12:46.592641+0000","last_became_peered":"2023-09-10T00:12:46.592641+0000","last_unstale":"2023-09-10T00:12:48.583605+0000","last_undegraded":"2023-09-10T00:12:48.583605+0000","last_fullsized":"2023-09-10T00:12:48.583605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781921+0000","last_change":"2023-09-10T00:12:42.541125+0000","last_active":"2023-09-10T00:12:47.781921+0000","last_peered":"2023-09-10T00:12:47.781921+0000","last_clean":"2023-09-10T00:12:47.781921+0000","last_became_active":"2023-09-10T00:12:42.540816+0000","last_became_peered":"2023-09-10T00:12:42.540816+0000","last_unstale":"2023-09-10T00:12:47.781921+0000","last_undegraded":"2023-09-10T00:12:47.781921+0000","last_fullsized":"2023-09-10T00:12:47.781921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781459+0000","last_change":"2023-09-10T00:12:41.525602+0000","last_active":"2023-09-10T00:12:47.781459+0000","last_peered":"2023-09-10T00:12:47.781459+0000","last_clean":"2023-09-10T00:12:47.781459+0000","last_became_active":"2023-09-10T00:12:41.524971+0000","last_became_peered":"2023-09-10T00:12:41.524971+0000","last_unstale":"2023-09-10T00:12:47.781459+0000","last_undegraded":"2023-09-10T00:12:47.781459+0000","last_fullsized":"2023-09-10T00:12:47.781459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578028+0000","last_change":"2023-09-10T00:12:46.590880+0000","last_active":"2023-09-10T00:12:48.578028+0000","last_peered":"2023-09-10T00:12:48.578028+0000","last_clean":"2023-09-10T00:12:48.578028+0000","last_became_active":"2023-09-10T00:12:46.590393+0000","last_became_peered":"2023-09-10T00:12:46.590393+0000","last_unstale":"2023-09-10T00:12:48.578028+0000","last_undegraded":"2023-09-10T00:12:48.578028+0000","last_fullsized":"2023-09-10T00:12:48.578028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:26.815586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781335+0000","last_change":"2023-09-10T00:12:42.546455+0000","last_active":"2023-09-10T00:12:47.781335+0000","last_peered":"2023-09-10T00:12:47.781335+0000","last_clean":"2023-09-10T00:12:47.781335+0000","last_became_active":"2023-09-10T00:12:42.545882+0000","last_became_peered":"2023-09-10T00:12:42.545882+0000","last_unstale":"2023-09-10T00:12:47.781335+0000","last_undegraded":"2023-09-10T00:12:47.781335+0000","last_fullsized":"2023-09-10T00:12:47.781335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583657+0000","last_change":"2023-09-10T00:12:41.526211+0000","last_active":"2023-09-10T00:12:47.583657+0000","last_peered":"2023-09-10T00:12:47.583657+0000","last_clean":"2023-09-10T00:12:47.583657+0000","last_became_active":"2023-09-10T00:12:41.525658+0000","last_became_peered":"2023-09-10T00:12:41.525658+0000","last_unstale":"2023-09-10T00:12:47.583657+0000","last_undegraded":"2023-09-10T00:12:47.583657+0000","last_fullsized":"2023-09-10T00:12:47.583657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578029+0000","last_change":"2023-09-10T00:12:47.440422+0000","last_active":"2023-09-10T00:12:48.578029+0000","last_peered":"2023-09-10T00:12:48.578029+0000","last_clean":"2023-09-10T00:12:48.578029+0000","last_became_active":"2023-09-10T00:12:47.438490+0000","last_became_peered":"2023-09-10T00:12:47.438490+0000","last_unstale":"2023-09-10T00:12:48.578029+0000","last_undegraded":"2023-09-10T00:12:48.578029+0000","last_fullsized":"2023-09-10T00:12:48.578029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:42:20.520101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222944+0000","last_change":"2023-09-10T00:12:47.440252+0000","last_active":"2023-09-10T00:12:49.222944+0000","last_peered":"2023-09-10T00:12:49.222944+0000","last_clean":"2023-09-10T00:12:49.222944+0000","last_became_active":"2023-09-10T00:12:47.438785+0000","last_became_peered":"2023-09-10T00:12:47.438785+0000","last_unstale":"2023-09-10T00:12:49.222944+0000","last_undegraded":"2023-09-10T00:12:49.222944+0000","last_fullsized":"2023-09-10T00:12:49.222944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614683+0000","last_change":"2023-09-10T00:12:42.503107+0000","last_active":"2023-09-10T00:12:47.614683+0000","last_peered":"2023-09-10T00:12:47.614683+0000","last_clean":"2023-09-10T00:12:47.614683+0000","last_became_active":"2023-09-10T00:12:42.502824+0000","last_became_peered":"2023-09-10T00:12:42.502824+0000","last_unstale":"2023-09-10T00:12:47.614683+0000","last_undegraded":"2023-09-10T00:12:47.614683+0000","last_fullsized":"2023-09-10T00:12:47.614683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:12:53.862661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781222+0000","last_change":"2023-09-10T00:12:41.530180+0000","last_active":"2023-09-10T00:12:47.781222+0000","last_peered":"2023-09-10T00:12:47.781222+0000","last_clean":"2023-09-10T00:12:47.781222+0000","last_became_active":"2023-09-10T00:12:41.529649+0000","last_became_peered":"2023-09-10T00:12:41.529649+0000","last_unstale":"2023-09-10T00:12:47.781222+0000","last_undegraded":"2023-09-10T00:12:47.781222+0000","last_fullsized":"2023-09-10T00:12:47.781222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:46.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.586697+0000","last_change":"2023-09-10T00:12:46.606697+0000","last_active":"2023-09-10T00:12:48.586697+0000","last_peered":"2023-09-10T00:12:48.586697+0000","last_clean":"2023-09-10T00:12:48.586697+0000","last_became_active":"2023-09-10T00:12:46.605416+0000","last_became_peered":"2023-09-10T00:12:46.605416+0000","last_unstale":"2023-09-10T00:12:48.586697+0000","last_undegraded":"2023-09-10T00:12:48.586697+0000","last_fullsized":"2023-09-10T00:12:48.586697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782768+0000","last_change":"2023-09-10T00:12:42.504040+0000","last_active":"2023-09-10T00:12:47.782768+0000","last_peered":"2023-09-10T00:12:47.782768+0000","last_clean":"2023-09-10T00:12:47.782768+0000","last_became_active":"2023-09-10T00:12:42.497706+0000","last_became_peered":"2023-09-10T00:12:42.497706+0000","last_unstale":"2023-09-10T00:12:47.782768+0000","last_undegraded":"2023-09-10T00:12:47.782768+0000","last_fullsized":"2023-09-10T00:12:47.782768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782782+0000","last_change":"2023-09-10T00:12:41.507432+0000","last_active":"2023-09-10T00:12:47.782782+0000","last_peered":"2023-09-10T00:12:47.782782+0000","last_clean":"2023-09-10T00:12:47.782782+0000","last_became_active":"2023-09-10T00:12:41.507133+0000","last_became_peered":"2023-09-10T00:12:41.507133+0000","last_unstale":"2023-09-10T00:12:47.782782+0000","last_undegraded":"2023-09-10T00:12:47.782782+0000","last_fullsized":"2023-09-10T00:12:47.782782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582295+0000","last_change":"2023-09-10T00:12:41.503643+0000","last_active":"2023-09-10T00:12:47.582295+0000","last_peered":"2023-09-10T00:12:47.582295+0000","last_clean":"2023-09-10T00:12:47.582295+0000","last_became_active":"2023-09-10T00:12:41.502542+0000","last_became_peered":"2023-09-10T00:12:41.502542+0000","last_unstale":"2023-09-10T00:12:47.582295+0000","last_undegraded":"2023-09-10T00:12:47.582295+0000","last_fullsized":"2023-09-10T00:12:47.582295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781211+0000","last_change":"2023-09-10T00:12:42.496774+0000","last_active":"2023-09-10T00:12:47.781211+0000","last_peered":"2023-09-10T00:12:47.781211+0000","last_clean":"2023-09-10T00:12:47.781211+0000","last_became_active":"2023-09-10T00:12:42.496456+0000","last_became_peered":"2023-09-10T00:12:42.496456+0000","last_unstale":"2023-09-10T00:12:47.781211+0000","last_undegraded":"2023-09-10T00:12:47.781211+0000","last_fullsized":"2023-09-10T00:12:47.781211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.221683+0000","last_change":"2023-09-10T00:12:46.594913+0000","last_active":"2023-09-10T00:12:49.221683+0000","last_peered":"2023-09-10T00:12:49.221683+0000","last_clean":"2023-09-10T00:12:49.221683+0000","last_became_active":"2023-09-10T00:12:46.594488+0000","last_became_peered":"2023-09-10T00:12:46.594488+0000","last_unstale":"2023-09-10T00:12:49.221683+0000","last_undegraded":"2023-09-10T00:12:49.221683+0000","last_fullsized":"2023-09-10T00:12:49.221683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:35.215018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783437+0000","last_change":"2023-09-10T00:12:41.507753+0000","last_active":"2023-09-10T00:12:47.783437+0000","last_peered":"2023-09-10T00:12:47.783437+0000","last_clean":"2023-09-10T00:12:47.783437+0000","last_became_active":"2023-09-10T00:12:41.507335+0000","last_became_peered":"2023-09-10T00:12:41.507335+0000","last_unstale":"2023-09-10T00:12:47.783437+0000","last_undegraded":"2023-09-10T00:12:47.783437+0000","last_fullsized":"2023-09-10T00:12:47.783437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580684+0000","last_change":"2023-09-10T00:12:42.501100+0000","last_active":"2023-09-10T00:12:47.580684+0000","last_peered":"2023-09-10T00:12:47.580684+0000","last_clean":"2023-09-10T00:12:47.580684+0000","last_became_active":"2023-09-10T00:12:42.500331+0000","last_became_peered":"2023-09-10T00:12:42.500331+0000","last_unstale":"2023-09-10T00:12:47.580684+0000","last_undegraded":"2023-09-10T00:12:47.580684+0000","last_fullsized":"2023-09-10T00:12:47.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:55.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579211+0000","last_change":"2023-09-10T00:12:46.577981+0000","last_active":"2023-09-10T00:12:48.579211+0000","last_peered":"2023-09-10T00:12:48.579211+0000","last_clean":"2023-09-10T00:12:48.579211+0000","last_became_active":"2023-09-10T00:12:46.577624+0000","last_became_peered":"2023-09-10T00:12:46.577624+0000","last_unstale":"2023-09-10T00:12:48.579211+0000","last_undegraded":"2023-09-10T00:12:48.579211+0000","last_fullsized":"2023-09-10T00:12:48.579211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:03:59.306486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579555+0000","last_change":"2023-09-10T00:12:42.523920+0000","last_active":"2023-09-10T00:12:47.579555+0000","last_peered":"2023-09-10T00:12:47.579555+0000","last_clean":"2023-09-10T00:12:47.579555+0000","last_became_active":"2023-09-10T00:12:42.523139+0000","last_became_peered":"2023-09-10T00:12:42.523139+0000","last_unstale":"2023-09-10T00:12:47.579555+0000","last_undegraded":"2023-09-10T00:12:47.579555+0000","last_fullsized":"2023-09-10T00:12:47.579555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577535+0000","last_change":"2023-09-10T00:12:42.541910+0000","last_active":"2023-09-10T00:12:47.577535+0000","last_peered":"2023-09-10T00:12:47.577535+0000","last_clean":"2023-09-10T00:12:47.577535+0000","last_became_active":"2023-09-10T00:12:42.541606+0000","last_became_peered":"2023-09-10T00:12:42.541606+0000","last_unstale":"2023-09-10T00:12:47.577535+0000","last_undegraded":"2023-09-10T00:12:47.577535+0000","last_fullsized":"2023-09-10T00:12:47.577535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:50.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781888+0000","last_change":"2023-09-10T00:12:42.520562+0000","last_active":"2023-09-10T00:12:47.781888+0000","last_peered":"2023-09-10T00:12:47.781888+0000","last_clean":"2023-09-10T00:12:47.781888+0000","last_became_active":"2023-09-10T00:12:42.509305+0000","last_became_peered":"2023-09-10T00:12:42.509305+0000","last_unstale":"2023-09-10T00:12:47.781888+0000","last_undegraded":"2023-09-10T00:12:47.781888+0000","last_fullsized":"2023-09-10T00:12:47.781888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781110+0000","last_change":"2023-09-10T00:12:42.503904+0000","last_active":"2023-09-10T00:12:47.781110+0000","last_peered":"2023-09-10T00:12:47.781110+0000","last_clean":"2023-09-10T00:12:47.781110+0000","last_became_active":"2023-09-10T00:12:42.503477+0000","last_became_peered":"2023-09-10T00:12:42.503477+0000","last_unstale":"2023-09-10T00:12:47.781110+0000","last_undegraded":"2023-09-10T00:12:47.781110+0000","last_fullsized":"2023-09-10T00:12:47.781110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783728+0000","last_change":"2023-09-10T00:12:42.506439+0000","last_active":"2023-09-10T00:12:47.783728+0000","last_peered":"2023-09-10T00:12:47.783728+0000","last_clean":"2023-09-10T00:12:47.783728+0000","last_became_active":"2023-09-10T00:12:42.504454+0000","last_became_peered":"2023-09-10T00:12:42.504454+0000","last_unstale":"2023-09-10T00:12:47.783728+0000","last_undegraded":"2023-09-10T00:12:47.783728+0000","last_fullsized":"2023-09-10T00:12:47.783728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615152+0000","last_change":"2023-09-10T00:12:42.503158+0000","last_active":"2023-09-10T00:12:47.615152+0000","last_peered":"2023-09-10T00:12:47.615152+0000","last_clean":"2023-09-10T00:12:47.615152+0000","last_became_active":"2023-09-10T00:12:42.502881+0000","last_became_peered":"2023-09-10T00:12:42.502881+0000","last_unstale":"2023-09-10T00:12:47.615152+0000","last_undegraded":"2023-09-10T00:12:47.615152+0000","last_fullsized":"2023-09-10T00:12:47.615152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:31.129379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583567+0000","last_change":"2023-09-10T00:12:42.526817+0000","last_active":"2023-09-10T00:12:47.583567+0000","last_peered":"2023-09-10T00:12:47.583567+0000","last_clean":"2023-09-10T00:12:47.583567+0000","last_became_active":"2023-09-10T00:12:42.525834+0000","last_became_peered":"2023-09-10T00:12:42.525834+0000","last_unstale":"2023-09-10T00:12:47.583567+0000","last_undegraded":"2023-09-10T00:12:47.583567+0000","last_fullsized":"2023-09-10T00:12:47.583567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783919+0000","last_change":"2023-09-10T00:12:42.503440+0000","last_active":"2023-09-10T00:12:47.783919+0000","last_peered":"2023-09-10T00:12:47.783919+0000","last_clean":"2023-09-10T00:12:47.783919+0000","last_became_active":"2023-09-10T00:12:42.503128+0000","last_became_peered":"2023-09-10T00:12:42.503128+0000","last_unstale":"2023-09-10T00:12:47.783919+0000","last_undegraded":"2023-09-10T00:12:47.783919+0000","last_fullsized":"2023-09-10T00:12:47.783919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780980+0000","last_change":"2023-09-10T00:12:42.549808+0000","last_active":"2023-09-10T00:12:47.780980+0000","last_peered":"2023-09-10T00:12:47.780980+0000","last_clean":"2023-09-10T00:12:47.780980+0000","last_became_active":"2023-09-10T00:12:42.549085+0000","last_became_peered":"2023-09-10T00:12:42.549085+0000","last_unstale":"2023-09-10T00:12:47.780980+0000","last_undegraded":"2023-09-10T00:12:47.780980+0000","last_fullsized":"2023-09-10T00:12:47.780980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782646+0000","last_change":"2023-09-10T00:12:42.502195+0000","last_active":"2023-09-10T00:12:47.782646+0000","last_peered":"2023-09-10T00:12:47.782646+0000","last_clean":"2023-09-10T00:12:47.782646+0000","last_became_active":"2023-09-10T00:12:42.501637+0000","last_became_peered":"2023-09-10T00:12:42.501637+0000","last_unstale":"2023-09-10T00:12:47.782646+0000","last_undegraded":"2023-09-10T00:12:47.782646+0000","last_fullsized":"2023-09-10T00:12:47.782646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781670+0000","last_change":"2023-09-10T00:12:42.532920+0000","last_active":"2023-09-10T00:12:47.781670+0000","last_peered":"2023-09-10T00:12:47.781670+0000","last_clean":"2023-09-10T00:12:47.781670+0000","last_became_active":"2023-09-10T00:12:42.532282+0000","last_became_peered":"2023-09-10T00:12:42.532282+0000","last_unstale":"2023-09-10T00:12:47.781670+0000","last_undegraded":"2023-09-10T00:12:47.781670+0000","last_fullsized":"2023-09-10T00:12:47.781670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780619+0000","last_change":"2023-09-10T00:12:42.502049+0000","last_active":"2023-09-10T00:12:47.780619+0000","last_peered":"2023-09-10T00:12:47.780619+0000","last_clean":"2023-09-10T00:12:47.780619+0000","last_became_active":"2023-09-10T00:12:42.501720+0000","last_became_peered":"2023-09-10T00:12:42.501720+0000","last_unstale":"2023-09-10T00:12:47.780619+0000","last_undegraded":"2023-09-10T00:12:47.780619+0000","last_fullsized":"2023-09-10T00:12:47.780619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582329+0000","last_change":"2023-09-10T00:12:42.527735+0000","last_active":"2023-09-10T00:12:47.582329+0000","last_peered":"2023-09-10T00:12:47.582329+0000","last_clean":"2023-09-10T00:12:47.582329+0000","last_became_active":"2023-09-10T00:12:42.526982+0000","last_became_peered":"2023-09-10T00:12:42.526982+0000","last_unstale":"2023-09-10T00:12:47.582329+0000","last_undegraded":"2023-09-10T00:12:47.582329+0000","last_fullsized":"2023-09-10T00:12:47.582329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:42.530154+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:42.529662+0000","last_became_peered":"2023-09-10T00:12:42.529662+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578018+0000","last_change":"2023-09-10T00:12:42.539691+0000","last_active":"2023-09-10T00:12:47.578018+0000","last_peered":"2023-09-10T00:12:47.578018+0000","last_clean":"2023-09-10T00:12:47.578018+0000","last_became_active":"2023-09-10T00:12:42.539317+0000","last_became_peered":"2023-09-10T00:12:42.539317+0000","last_unstale":"2023-09-10T00:12:47.578018+0000","last_undegraded":"2023-09-10T00:12:47.578018+0000","last_fullsized":"2023-09-10T00:12:47.578018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:16.849606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782318+0000","last_change":"2023-09-10T00:12:42.559699+0000","last_active":"2023-09-10T00:12:47.782318+0000","last_peered":"2023-09-10T00:12:47.782318+0000","last_clean":"2023-09-10T00:12:47.782318+0000","last_became_active":"2023-09-10T00:12:42.559176+0000","last_became_peered":"2023-09-10T00:12:42.559176+0000","last_unstale":"2023-09-10T00:12:47.782318+0000","last_undegraded":"2023-09-10T00:12:47.782318+0000","last_fullsized":"2023-09-10T00:12:47.782318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:22:14.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780714+0000","last_change":"2023-09-10T00:12:42.550456+0000","last_active":"2023-09-10T00:12:47.780714+0000","last_peered":"2023-09-10T00:12:47.780714+0000","last_clean":"2023-09-10T00:12:47.780714+0000","last_became_active":"2023-09-10T00:12:42.549896+0000","last_became_peered":"2023-09-10T00:12:42.549896+0000","last_unstale":"2023-09-10T00:12:47.780714+0000","last_undegraded":"2023-09-10T00:12:47.780714+0000","last_fullsized":"2023-09-10T00:12:47.780714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614735+0000","last_change":"2023-09-10T00:12:42.505565+0000","last_active":"2023-09-10T00:12:47.614735+0000","last_peered":"2023-09-10T00:12:47.614735+0000","last_clean":"2023-09-10T00:12:47.614735+0000","last_became_active":"2023-09-10T00:12:42.504834+0000","last_became_peered":"2023-09-10T00:12:42.504834+0000","last_unstale":"2023-09-10T00:12:47.614735+0000","last_undegraded":"2023-09-10T00:12:47.614735+0000","last_fullsized":"2023-09-10T00:12:47.614735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:06:02.585817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780755+0000","last_change":"2023-09-10T00:12:42.497048+0000","last_active":"2023-09-10T00:12:47.780755+0000","last_peered":"2023-09-10T00:12:47.780755+0000","last_clean":"2023-09-10T00:12:47.780755+0000","last_became_active":"2023-09-10T00:12:42.496135+0000","last_became_peered":"2023-09-10T00:12:42.496135+0000","last_unstale":"2023-09-10T00:12:47.780755+0000","last_undegraded":"2023-09-10T00:12:47.780755+0000","last_fullsized":"2023-09-10T00:12:47.780755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:31:37.425124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783142+0000","last_change":"2023-09-10T00:12:42.539859+0000","last_active":"2023-09-10T00:12:47.783142+0000","last_peered":"2023-09-10T00:12:47.783142+0000","last_clean":"2023-09-10T00:12:47.783142+0000","last_became_active":"2023-09-10T00:12:42.539545+0000","last_became_peered":"2023-09-10T00:12:42.539545+0000","last_unstale":"2023-09-10T00:12:47.783142+0000","last_undegraded":"2023-09-10T00:12:47.783142+0000","last_fullsized":"2023-09-10T00:12:47.783142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581017+0000","last_change":"2023-09-10T00:12:42.528935+0000","last_active":"2023-09-10T00:12:47.581017+0000","last_peered":"2023-09-10T00:12:47.581017+0000","last_clean":"2023-09-10T00:12:47.581017+0000","last_became_active":"2023-09-10T00:12:42.528159+0000","last_became_peered":"2023-09-10T00:12:42.528159+0000","last_unstale":"2023-09-10T00:12:47.581017+0000","last_undegraded":"2023-09-10T00:12:47.581017+0000","last_fullsized":"2023-09-10T00:12:47.581017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:43.303596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582968+0000","last_change":"2023-09-10T00:12:42.553610+0000","last_active":"2023-09-10T00:12:47.582968+0000","last_peered":"2023-09-10T00:12:47.582968+0000","last_clean":"2023-09-10T00:12:47.582968+0000","last_became_active":"2023-09-10T00:12:42.553091+0000","last_became_peered":"2023-09-10T00:12:42.553091+0000","last_unstale":"2023-09-10T00:12:47.582968+0000","last_undegraded":"2023-09-10T00:12:47.582968+0000","last_fullsized":"2023-09-10T00:12:47.582968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583568+0000","last_change":"2023-09-10T00:12:42.549380+0000","last_active":"2023-09-10T00:12:47.583568+0000","last_peered":"2023-09-10T00:12:47.583568+0000","last_clean":"2023-09-10T00:12:47.583568+0000","last_became_active":"2023-09-10T00:12:42.548763+0000","last_became_peered":"2023-09-10T00:12:42.548763+0000","last_unstale":"2023-09-10T00:12:47.583568+0000","last_undegraded":"2023-09-10T00:12:47.583568+0000","last_fullsized":"2023-09-10T00:12:47.583568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784264+0000","last_change":"2023-09-10T00:12:42.551603+0000","last_active":"2023-09-10T00:12:47.784264+0000","last_peered":"2023-09-10T00:12:47.784264+0000","last_clean":"2023-09-10T00:12:47.784264+0000","last_became_active":"2023-09-10T00:12:42.551111+0000","last_became_peered":"2023-09-10T00:12:42.551111+0000","last_unstale":"2023-09-10T00:12:47.784264+0000","last_undegraded":"2023-09-10T00:12:47.784264+0000","last_fullsized":"2023-09-10T00:12:47.784264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782492+0000","last_change":"2023-09-10T00:12:42.551120+0000","last_active":"2023-09-10T00:12:47.782492+0000","last_peered":"2023-09-10T00:12:47.782492+0000","last_clean":"2023-09-10T00:12:47.782492+0000","last_became_active":"2023-09-10T00:12:42.550803+0000","last_became_peered":"2023-09-10T00:12:42.550803+0000","last_unstale":"2023-09-10T00:12:47.782492+0000","last_undegraded":"2023-09-10T00:12:47.782492+0000","last_fullsized":"2023-09-10T00:12:47.782492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781988+0000","last_change":"2023-09-10T00:12:42.515188+0000","last_active":"2023-09-10T00:12:47.781988+0000","last_peered":"2023-09-10T00:12:47.781988+0000","last_clean":"2023-09-10T00:12:47.781988+0000","last_became_active":"2023-09-10T00:12:42.514135+0000","last_became_peered":"2023-09-10T00:12:42.514135+0000","last_unstale":"2023-09-10T00:12:47.781988+0000","last_undegraded":"2023-09-10T00:12:47.781988+0000","last_fullsized":"2023-09-10T00:12:47.781988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781647+0000","last_change":"2023-09-10T00:12:42.542532+0000","last_active":"2023-09-10T00:12:47.781647+0000","last_peered":"2023-09-10T00:12:47.781647+0000","last_clean":"2023-09-10T00:12:47.781647+0000","last_became_active":"2023-09-10T00:12:42.536897+0000","last_became_peered":"2023-09-10T00:12:42.536897+0000","last_unstale":"2023-09-10T00:12:47.781647+0000","last_undegraded":"2023-09-10T00:12:47.781647+0000","last_fullsized":"2023-09-10T00:12:47.781647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782937+0000","last_change":"2023-09-10T00:12:42.519515+0000","last_active":"2023-09-10T00:12:47.782937+0000","last_peered":"2023-09-10T00:12:47.782937+0000","last_clean":"2023-09-10T00:12:47.782937+0000","last_became_active":"2023-09-10T00:12:42.518734+0000","last_became_peered":"2023-09-10T00:12:42.518734+0000","last_unstale":"2023-09-10T00:12:47.782937+0000","last_undegraded":"2023-09-10T00:12:47.782937+0000","last_fullsized":"2023-09-10T00:12:47.782937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781617+0000","last_change":"2023-09-10T00:12:42.548980+0000","last_active":"2023-09-10T00:12:47.781617+0000","last_peered":"2023-09-10T00:12:47.781617+0000","last_clean":"2023-09-10T00:12:47.781617+0000","last_became_active":"2023-09-10T00:12:42.548305+0000","last_became_peered":"2023-09-10T00:12:42.548305+0000","last_unstale":"2023-09-10T00:12:47.781617+0000","last_undegraded":"2023-09-10T00:12:47.781617+0000","last_fullsized":"2023-09-10T00:12:47.781617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781352+0000","last_change":"2023-09-10T00:12:42.498654+0000","last_active":"2023-09-10T00:12:47.781352+0000","last_peered":"2023-09-10T00:12:47.781352+0000","last_clean":"2023-09-10T00:12:47.781352+0000","last_became_active":"2023-09-10T00:12:42.498336+0000","last_became_peered":"2023-09-10T00:12:42.498336+0000","last_unstale":"2023-09-10T00:12:47.781352+0000","last_undegraded":"2023-09-10T00:12:47.781352+0000","last_fullsized":"2023-09-10T00:12:47.781352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615376+0000","last_change":"2023-09-10T00:12:42.496796+0000","last_active":"2023-09-10T00:12:47.615376+0000","last_peered":"2023-09-10T00:12:47.615376+0000","last_clean":"2023-09-10T00:12:47.615376+0000","last_became_active":"2023-09-10T00:12:42.496366+0000","last_became_peered":"2023-09-10T00:12:42.496366+0000","last_unstale":"2023-09-10T00:12:47.615376+0000","last_undegraded":"2023-09-10T00:12:47.615376+0000","last_fullsized":"2023-09-10T00:12:47.615376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:56.597066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784129+0000","last_change":"2023-09-10T00:12:42.545759+0000","last_active":"2023-09-10T00:12:47.784129+0000","last_peered":"2023-09-10T00:12:47.784129+0000","last_clean":"2023-09-10T00:12:47.784129+0000","last_became_active":"2023-09-10T00:12:42.545347+0000","last_became_peered":"2023-09-10T00:12:42.545347+0000","last_unstale":"2023-09-10T00:12:47.784129+0000","last_undegraded":"2023-09-10T00:12:47.784129+0000","last_fullsized":"2023-09-10T00:12:47.784129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":699380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":699436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:13:06.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:13:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3235151802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda080047d0 msgr2=0x7fda08004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3235151802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda080047d0 0x7fda08004c50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda10001680 tx=0x7fda1001c760 comp rx=0 tx=0).stop 2023-09-10T00:13:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 -- 172.21.15.84:0/3235151802 reap_dead start 2023-09-10T00:13:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3235151802 shutdown_connections 2023-09-10T00:13:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3235151802 >> 172.21.15.84:0/3235151802 conn(0x7fda200cca70 msgr2=0x7fda200cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3235151802 shutdown_connections 2023-09-10T00:13:06.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3235151802 wait complete. 2023-09-10T00:13:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 Processor -- start 2023-09-10T00:13:06.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- start start 2023-09-10T00:13:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda080047d0 0x7fda200cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda20149230 0x7fda2014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c2660 con 0x7fda200c1ca0 2023-09-10T00:13:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200cb320 con 0x7fda20149230 2023-09-10T00:13:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200caa80 con 0x7fda080047d0 2023-09-10T00:13:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43762/0 (socket says 172.21.15.84:43762) 2023-09-10T00:13:06.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 -- 172.21.15.84:0/3506386551 learned_addr learned my addr 172.21.15.84:0/3506386551 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda24882640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda080047d0 0x7fda200cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda1ffff640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda20149230 0x7fda2014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 -- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda080047d0 msgr2=0x7fda200cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda080047d0 0x7fda200cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 -- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda20149230 msgr2=0x7fda2014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda20149230 0x7fda2014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 -- 172.21.15.84:0/3506386551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200cad60 con 0x7fda200c1ca0 2023-09-10T00:13:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda25083640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda200c0170 tx=0x7fda1800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18018070 con 0x7fda200c1ca0 2023-09-10T00:13:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda18004c20 con 0x7fda200c1ca0 2023-09-10T00:13:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda200cb040 con 0x7fda200c1ca0 2023-09-10T00:13:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800cad0 con 0x7fda200c1ca0 2023-09-10T00:13:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.382+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda20149690 con 0x7fda200c1ca0 2023-09-10T00:13:06.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda200712c0 con 0x7fda200c1ca0 2023-09-10T00:13:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda1800cc30 con 0x7fda200c1ca0 2023-09-10T00:13:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda1d7fa640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 0x7fda0c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda18083430 con 0x7fda200c1ca0 2023-09-10T00:13:06.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda24882640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 0x7fda0c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.386+0000 7fda24882640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 0x7fda0c068010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda14001060 tx=0x7fda140015f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.390+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda18050b20 con 0x7fda200c1ca0 2023-09-10T00:13:06.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.542+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda200b0d60 con 0x7fda0c065b50 2023-09-10T00:13:06.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.562+0000 7fda1d7fa640 1 -- 172.21.15.84:0/3506386551 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345172 (secure 0 0 0) 0x7fda140109b0 con 0x7fda0c065b50 2023-09-10T00:13:06.566 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:06.570 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:13:06.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 msgr2=0x7fda0c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 0x7fda0c068010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda14001060 tx=0x7fda140015f0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 msgr2=0x7fda200c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda200c0170 tx=0x7fda1800ee10 comp rx=0 tx=0).stop 2023-09-10T00:13:06.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 shutdown_connections 2023-09-10T00:13:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda0c065b50 0x7fda0c068010 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda200c1ca0 0x7fda200c2120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda20149230 0x7fda2014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 --2- 172.21.15.84:0/3506386551 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda080047d0 0x7fda200cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 >> 172.21.15.84:0/3506386551 conn(0x7fda200cca70 msgr2=0x7fda20069a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 shutdown_connections 2023-09-10T00:13:06.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.566+0000 7fda26ae6640 1 -- 172.21.15.84:0/3506386551 wait complete. 2023-09-10T00:13:06.586 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-09-10T00:13:05.817487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3416064,"data_stored":2057454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004463"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782159+0000","last_change":"2023-09-10T00:12:41.509675+0000","last_active":"2023-09-10T00:12:47.782159+0000","last_peered":"2023-09-10T00:12:47.782159+0000","last_clean":"2023-09-10T00:12:47.782159+0000","last_became_active":"2023-09-10T00:12:41.509279+0000","last_became_peered":"2023-09-10T00:12:41.509279+0000","last_unstale":"2023-09-10T00:12:47.782159+0000","last_undegraded":"2023-09-10T00:12:47.782159+0000","last_fullsized":"2023-09-10T00:12:47.782159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783838+0000","last_change":"2023-09-10T00:12:42.539901+0000","last_active":"2023-09-10T00:12:47.783838+0000","last_peered":"2023-09-10T00:12:47.783838+0000","last_clean":"2023-09-10T00:12:47.783838+0000","last_became_active":"2023-09-10T00:12:42.539648+0000","last_became_peered":"2023-09-10T00:12:42.539648+0000","last_unstale":"2023-09-10T00:12:47.783838+0000","last_undegraded":"2023-09-10T00:12:47.783838+0000","last_fullsized":"2023-09-10T00:12:47.783838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577941+0000","last_change":"2023-09-10T00:12:47.443681+0000","last_active":"2023-09-10T00:12:48.577941+0000","last_peered":"2023-09-10T00:12:48.577941+0000","last_clean":"2023-09-10T00:12:48.577941+0000","last_became_active":"2023-09-10T00:12:47.442588+0000","last_became_peered":"2023-09-10T00:12:47.442588+0000","last_unstale":"2023-09-10T00:12:48.577941+0000","last_undegraded":"2023-09-10T00:12:48.577941+0000","last_fullsized":"2023-09-10T00:12:48.577941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:30:17.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784136+0000","last_change":"2023-09-10T00:12:41.502405+0000","last_active":"2023-09-10T00:12:47.784136+0000","last_peered":"2023-09-10T00:12:47.784136+0000","last_clean":"2023-09-10T00:12:47.784136+0000","last_became_active":"2023-09-10T00:12:41.502081+0000","last_became_peered":"2023-09-10T00:12:41.502081+0000","last_unstale":"2023-09-10T00:12:47.784136+0000","last_undegraded":"2023-09-10T00:12:47.784136+0000","last_fullsized":"2023-09-10T00:12:47.784136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781838+0000","last_change":"2023-09-10T00:12:42.550279+0000","last_active":"2023-09-10T00:12:47.781838+0000","last_peered":"2023-09-10T00:12:47.781838+0000","last_clean":"2023-09-10T00:12:47.781838+0000","last_became_active":"2023-09-10T00:12:42.549968+0000","last_became_peered":"2023-09-10T00:12:42.549968+0000","last_unstale":"2023-09-10T00:12:47.781838+0000","last_undegraded":"2023-09-10T00:12:47.781838+0000","last_fullsized":"2023-09-10T00:12:47.781838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581814+0000","last_change":"2023-09-10T00:12:46.587407+0000","last_active":"2023-09-10T00:12:48.581814+0000","last_peered":"2023-09-10T00:12:48.581814+0000","last_clean":"2023-09-10T00:12:48.581814+0000","last_became_active":"2023-09-10T00:12:46.585950+0000","last_became_peered":"2023-09-10T00:12:46.585950+0000","last_unstale":"2023-09-10T00:12:48.581814+0000","last_undegraded":"2023-09-10T00:12:48.581814+0000","last_fullsized":"2023-09-10T00:12:48.581814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:31.560504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783664+0000","last_change":"2023-09-10T00:12:41.527986+0000","last_active":"2023-09-10T00:12:47.783664+0000","last_peered":"2023-09-10T00:12:47.783664+0000","last_clean":"2023-09-10T00:12:47.783664+0000","last_became_active":"2023-09-10T00:12:41.527417+0000","last_became_peered":"2023-09-10T00:12:41.527417+0000","last_unstale":"2023-09-10T00:12:47.783664+0000","last_undegraded":"2023-09-10T00:12:47.783664+0000","last_fullsized":"2023-09-10T00:12:47.783664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781841+0000","last_change":"2023-09-10T00:12:42.549603+0000","last_active":"2023-09-10T00:12:47.781841+0000","last_peered":"2023-09-10T00:12:47.781841+0000","last_clean":"2023-09-10T00:12:47.781841+0000","last_became_active":"2023-09-10T00:12:42.549082+0000","last_became_peered":"2023-09-10T00:12:42.549082+0000","last_unstale":"2023-09-10T00:12:47.781841+0000","last_undegraded":"2023-09-10T00:12:47.781841+0000","last_fullsized":"2023-09-10T00:12:47.781841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583016+0000","last_change":"2023-09-10T00:12:46.598936+0000","last_active":"2023-09-10T00:12:48.583016+0000","last_peered":"2023-09-10T00:12:48.583016+0000","last_clean":"2023-09-10T00:12:48.583016+0000","last_became_active":"2023-09-10T00:12:46.595513+0000","last_became_peered":"2023-09-10T00:12:46.595513+0000","last_unstale":"2023-09-10T00:12:48.583016+0000","last_undegraded":"2023-09-10T00:12:48.583016+0000","last_fullsized":"2023-09-10T00:12:48.583016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783420+0000","last_change":"2023-09-10T00:12:41.528161+0000","last_active":"2023-09-10T00:12:47.783420+0000","last_peered":"2023-09-10T00:12:47.783420+0000","last_clean":"2023-09-10T00:12:47.783420+0000","last_became_active":"2023-09-10T00:12:41.527502+0000","last_became_peered":"2023-09-10T00:12:41.527502+0000","last_unstale":"2023-09-10T00:12:47.783420+0000","last_undegraded":"2023-09-10T00:12:47.783420+0000","last_fullsized":"2023-09-10T00:12:47.783420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782651+0000","last_change":"2023-09-10T00:12:42.540628+0000","last_active":"2023-09-10T00:12:47.782651+0000","last_peered":"2023-09-10T00:12:47.782651+0000","last_clean":"2023-09-10T00:12:47.782651+0000","last_became_active":"2023-09-10T00:12:42.539869+0000","last_became_peered":"2023-09-10T00:12:42.539869+0000","last_unstale":"2023-09-10T00:12:47.782651+0000","last_undegraded":"2023-09-10T00:12:47.782651+0000","last_fullsized":"2023-09-10T00:12:47.782651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582233+0000","last_change":"2023-09-10T00:12:46.591413+0000","last_active":"2023-09-10T00:12:48.582233+0000","last_peered":"2023-09-10T00:12:48.582233+0000","last_clean":"2023-09-10T00:12:48.582233+0000","last_became_active":"2023-09-10T00:12:46.590270+0000","last_became_peered":"2023-09-10T00:12:46.590270+0000","last_unstale":"2023-09-10T00:12:48.582233+0000","last_undegraded":"2023-09-10T00:12:48.582233+0000","last_fullsized":"2023-09-10T00:12:48.582233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:43:11.882300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581794+0000","last_change":"2023-09-10T00:12:42.507279+0000","last_active":"2023-09-10T00:12:47.581794+0000","last_peered":"2023-09-10T00:12:47.581794+0000","last_clean":"2023-09-10T00:12:47.581794+0000","last_became_active":"2023-09-10T00:12:42.506014+0000","last_became_peered":"2023-09-10T00:12:42.506014+0000","last_unstale":"2023-09-10T00:12:47.581794+0000","last_undegraded":"2023-09-10T00:12:47.581794+0000","last_fullsized":"2023-09-10T00:12:47.581794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783530+0000","last_change":"2023-09-10T00:12:41.530493+0000","last_active":"2023-09-10T00:12:47.783530+0000","last_peered":"2023-09-10T00:12:47.783530+0000","last_clean":"2023-09-10T00:12:47.783530+0000","last_became_active":"2023-09-10T00:12:41.529930+0000","last_became_peered":"2023-09-10T00:12:41.529930+0000","last_unstale":"2023-09-10T00:12:47.783530+0000","last_undegraded":"2023-09-10T00:12:47.783530+0000","last_fullsized":"2023-09-10T00:12:47.783530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584979+0000","last_change":"2023-09-10T00:12:46.585841+0000","last_active":"2023-09-10T00:12:48.584979+0000","last_peered":"2023-09-10T00:12:48.584979+0000","last_clean":"2023-09-10T00:12:48.584979+0000","last_became_active":"2023-09-10T00:12:46.584664+0000","last_became_peered":"2023-09-10T00:12:46.584664+0000","last_unstale":"2023-09-10T00:12:48.584979+0000","last_undegraded":"2023-09-10T00:12:48.584979+0000","last_fullsized":"2023-09-10T00:12:48.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783202+0000","last_change":"2023-09-10T00:12:42.503145+0000","last_active":"2023-09-10T00:12:47.783202+0000","last_peered":"2023-09-10T00:12:47.783202+0000","last_clean":"2023-09-10T00:12:47.783202+0000","last_became_active":"2023-09-10T00:12:42.502860+0000","last_became_peered":"2023-09-10T00:12:42.502860+0000","last_unstale":"2023-09-10T00:12:47.783202+0000","last_undegraded":"2023-09-10T00:12:47.783202+0000","last_fullsized":"2023-09-10T00:12:47.783202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615505+0000","last_change":"2023-09-10T00:12:41.495145+0000","last_active":"2023-09-10T00:12:47.615505+0000","last_peered":"2023-09-10T00:12:47.615505+0000","last_clean":"2023-09-10T00:12:47.615505+0000","last_became_active":"2023-09-10T00:12:41.494723+0000","last_became_peered":"2023-09-10T00:12:41.494723+0000","last_unstale":"2023-09-10T00:12:47.615505+0000","last_undegraded":"2023-09-10T00:12:47.615505+0000","last_fullsized":"2023-09-10T00:12:47.615505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:28:44.771070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584304+0000","last_change":"2023-09-10T00:12:46.598895+0000","last_active":"2023-09-10T00:12:48.584304+0000","last_peered":"2023-09-10T00:12:48.584304+0000","last_clean":"2023-09-10T00:12:48.584304+0000","last_became_active":"2023-09-10T00:12:46.597512+0000","last_became_peered":"2023-09-10T00:12:46.597512+0000","last_unstale":"2023-09-10T00:12:48.584304+0000","last_undegraded":"2023-09-10T00:12:48.584304+0000","last_fullsized":"2023-09-10T00:12:48.584304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782945+0000","last_change":"2023-09-10T00:12:42.506592+0000","last_active":"2023-09-10T00:12:47.782945+0000","last_peered":"2023-09-10T00:12:47.782945+0000","last_clean":"2023-09-10T00:12:47.782945+0000","last_became_active":"2023-09-10T00:12:42.498699+0000","last_became_peered":"2023-09-10T00:12:42.498699+0000","last_unstale":"2023-09-10T00:12:47.782945+0000","last_undegraded":"2023-09-10T00:12:47.782945+0000","last_fullsized":"2023-09-10T00:12:47.782945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614899+0000","last_change":"2023-09-10T00:12:41.511349+0000","last_active":"2023-09-10T00:12:47.614899+0000","last_peered":"2023-09-10T00:12:47.614899+0000","last_clean":"2023-09-10T00:12:47.614899+0000","last_became_active":"2023-09-10T00:12:41.511068+0000","last_became_peered":"2023-09-10T00:12:41.511068+0000","last_unstale":"2023-09-10T00:12:47.614899+0000","last_undegraded":"2023-09-10T00:12:47.614899+0000","last_fullsized":"2023-09-10T00:12:47.614899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:15.836419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224891+0000","last_change":"2023-09-10T00:12:47.444639+0000","last_active":"2023-09-10T00:12:49.224891+0000","last_peered":"2023-09-10T00:12:49.224891+0000","last_clean":"2023-09-10T00:12:49.224891+0000","last_became_active":"2023-09-10T00:12:47.443285+0000","last_became_peered":"2023-09-10T00:12:47.443285+0000","last_unstale":"2023-09-10T00:12:49.224891+0000","last_undegraded":"2023-09-10T00:12:49.224891+0000","last_fullsized":"2023-09-10T00:12:49.224891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:23.785184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580956+0000","last_change":"2023-09-10T00:12:42.502827+0000","last_active":"2023-09-10T00:12:47.580956+0000","last_peered":"2023-09-10T00:12:47.580956+0000","last_clean":"2023-09-10T00:12:47.580956+0000","last_became_active":"2023-09-10T00:12:42.498059+0000","last_became_peered":"2023-09-10T00:12:42.498059+0000","last_unstale":"2023-09-10T00:12:47.580956+0000","last_undegraded":"2023-09-10T00:12:47.580956+0000","last_fullsized":"2023-09-10T00:12:47.580956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:30.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782172+0000","last_change":"2023-09-10T00:12:41.522787+0000","last_active":"2023-09-10T00:12:47.782172+0000","last_peered":"2023-09-10T00:12:47.782172+0000","last_clean":"2023-09-10T00:12:47.782172+0000","last_became_active":"2023-09-10T00:12:41.521261+0000","last_became_peered":"2023-09-10T00:12:41.521261+0000","last_unstale":"2023-09-10T00:12:47.782172+0000","last_undegraded":"2023-09-10T00:12:47.782172+0000","last_fullsized":"2023-09-10T00:12:47.782172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:04:32.449308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584798+0000","last_change":"2023-09-10T00:12:46.594098+0000","last_active":"2023-09-10T00:12:48.584798+0000","last_peered":"2023-09-10T00:12:48.584798+0000","last_clean":"2023-09-10T00:12:48.584798+0000","last_became_active":"2023-09-10T00:12:46.592902+0000","last_became_peered":"2023-09-10T00:12:46.592902+0000","last_unstale":"2023-09-10T00:12:48.584798+0000","last_undegraded":"2023-09-10T00:12:48.584798+0000","last_fullsized":"2023-09-10T00:12:48.584798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781833+0000","last_change":"2023-09-10T00:12:42.494258+0000","last_active":"2023-09-10T00:12:47.781833+0000","last_peered":"2023-09-10T00:12:47.781833+0000","last_clean":"2023-09-10T00:12:47.781833+0000","last_became_active":"2023-09-10T00:12:42.493975+0000","last_became_peered":"2023-09-10T00:12:42.493975+0000","last_unstale":"2023-09-10T00:12:47.781833+0000","last_undegraded":"2023-09-10T00:12:47.781833+0000","last_fullsized":"2023-09-10T00:12:47.781833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583823+0000","last_change":"2023-09-10T00:12:41.507450+0000","last_active":"2023-09-10T00:12:47.583823+0000","last_peered":"2023-09-10T00:12:47.583823+0000","last_clean":"2023-09-10T00:12:47.583823+0000","last_became_active":"2023-09-10T00:12:41.506687+0000","last_became_peered":"2023-09-10T00:12:41.506687+0000","last_unstale":"2023-09-10T00:12:47.583823+0000","last_undegraded":"2023-09-10T00:12:47.583823+0000","last_fullsized":"2023-09-10T00:12:47.583823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582305+0000","last_change":"2023-09-10T00:12:47.439167+0000","last_active":"2023-09-10T00:12:48.582305+0000","last_peered":"2023-09-10T00:12:48.582305+0000","last_clean":"2023-09-10T00:12:48.582305+0000","last_became_active":"2023-09-10T00:12:47.438136+0000","last_became_peered":"2023-09-10T00:12:47.438136+0000","last_unstale":"2023-09-10T00:12:48.582305+0000","last_undegraded":"2023-09-10T00:12:48.582305+0000","last_fullsized":"2023-09-10T00:12:48.582305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:39:24.652596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784017+0000","last_change":"2023-09-10T00:12:42.505311+0000","last_active":"2023-09-10T00:12:47.784017+0000","last_peered":"2023-09-10T00:12:47.784017+0000","last_clean":"2023-09-10T00:12:47.784017+0000","last_became_active":"2023-09-10T00:12:42.504994+0000","last_became_peered":"2023-09-10T00:12:42.504994+0000","last_unstale":"2023-09-10T00:12:47.784017+0000","last_undegraded":"2023-09-10T00:12:47.784017+0000","last_fullsized":"2023-09-10T00:12:47.784017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615569+0000","last_change":"2023-09-10T00:12:41.511281+0000","last_active":"2023-09-10T00:12:47.615569+0000","last_peered":"2023-09-10T00:12:47.615569+0000","last_clean":"2023-09-10T00:12:47.615569+0000","last_became_active":"2023-09-10T00:12:41.510955+0000","last_became_peered":"2023-09-10T00:12:41.510955+0000","last_unstale":"2023-09-10T00:12:47.615569+0000","last_undegraded":"2023-09-10T00:12:47.615569+0000","last_fullsized":"2023-09-10T00:12:47.615569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:04:20.102763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577831+0000","last_change":"2023-09-10T00:12:47.439819+0000","last_active":"2023-09-10T00:12:48.577831+0000","last_peered":"2023-09-10T00:12:48.577831+0000","last_clean":"2023-09-10T00:12:48.577831+0000","last_became_active":"2023-09-10T00:12:47.438387+0000","last_became_peered":"2023-09-10T00:12:47.438387+0000","last_unstale":"2023-09-10T00:12:48.577831+0000","last_undegraded":"2023-09-10T00:12:48.577831+0000","last_fullsized":"2023-09-10T00:12:48.577831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:19:55.443215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615124+0000","last_change":"2023-09-10T00:12:42.505051+0000","last_active":"2023-09-10T00:12:47.615124+0000","last_peered":"2023-09-10T00:12:47.615124+0000","last_clean":"2023-09-10T00:12:47.615124+0000","last_became_active":"2023-09-10T00:12:42.503680+0000","last_became_peered":"2023-09-10T00:12:42.503680+0000","last_unstale":"2023-09-10T00:12:47.615124+0000","last_undegraded":"2023-09-10T00:12:47.615124+0000","last_fullsized":"2023-09-10T00:12:47.615124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:32.318944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:41.530921+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:41.529005+0000","last_became_peered":"2023-09-10T00:12:41.529005+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:39.114481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222557+0000","last_change":"2023-09-10T00:12:47.432879+0000","last_active":"2023-09-10T00:12:49.222557+0000","last_peered":"2023-09-10T00:12:49.222557+0000","last_clean":"2023-09-10T00:12:49.222557+0000","last_became_active":"2023-09-10T00:12:47.431809+0000","last_became_peered":"2023-09-10T00:12:47.431809+0000","last_unstale":"2023-09-10T00:12:49.222557+0000","last_undegraded":"2023-09-10T00:12:49.222557+0000","last_fullsized":"2023-09-10T00:12:49.222557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782710+0000","last_change":"2023-09-10T00:12:42.539827+0000","last_active":"2023-09-10T00:12:47.782710+0000","last_peered":"2023-09-10T00:12:47.782710+0000","last_clean":"2023-09-10T00:12:47.782710+0000","last_became_active":"2023-09-10T00:12:42.537005+0000","last_became_peered":"2023-09-10T00:12:42.537005+0000","last_unstale":"2023-09-10T00:12:47.782710+0000","last_undegraded":"2023-09-10T00:12:47.782710+0000","last_fullsized":"2023-09-10T00:12:47.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615250+0000","last_change":"2023-09-10T00:12:41.502711+0000","last_active":"2023-09-10T00:12:47.615250+0000","last_peered":"2023-09-10T00:12:47.615250+0000","last_clean":"2023-09-10T00:12:47.615250+0000","last_became_active":"2023-09-10T00:12:41.501978+0000","last_became_peered":"2023-09-10T00:12:41.501978+0000","last_unstale":"2023-09-10T00:12:47.615250+0000","last_undegraded":"2023-09-10T00:12:47.615250+0000","last_fullsized":"2023-09-10T00:12:47.615250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:02:42.904824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223956+0000","last_change":"2023-09-10T00:12:46.590131+0000","last_active":"2023-09-10T00:12:49.223956+0000","last_peered":"2023-09-10T00:12:49.223956+0000","last_clean":"2023-09-10T00:12:49.223956+0000","last_became_active":"2023-09-10T00:12:46.589585+0000","last_became_peered":"2023-09-10T00:12:46.589585+0000","last_unstale":"2023-09-10T00:12:49.223956+0000","last_undegraded":"2023-09-10T00:12:49.223956+0000","last_fullsized":"2023-09-10T00:12:49.223956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:27:21.324259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581586+0000","last_change":"2023-09-10T00:12:42.487629+0000","last_active":"2023-09-10T00:12:47.581586+0000","last_peered":"2023-09-10T00:12:47.581586+0000","last_clean":"2023-09-10T00:12:47.581586+0000","last_became_active":"2023-09-10T00:12:42.486705+0000","last_became_peered":"2023-09-10T00:12:42.486705+0000","last_unstale":"2023-09-10T00:12:47.581586+0000","last_undegraded":"2023-09-10T00:12:47.581586+0000","last_fullsized":"2023-09-10T00:12:47.581586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:34:10.530303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782116+0000","last_change":"2023-09-10T00:12:41.524050+0000","last_active":"2023-09-10T00:12:47.782116+0000","last_peered":"2023-09-10T00:12:47.782116+0000","last_clean":"2023-09-10T00:12:47.782116+0000","last_became_active":"2023-09-10T00:12:41.523285+0000","last_became_peered":"2023-09-10T00:12:41.523285+0000","last_unstale":"2023-09-10T00:12:47.782116+0000","last_undegraded":"2023-09-10T00:12:47.782116+0000","last_fullsized":"2023-09-10T00:12:47.782116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224831+0000","last_change":"2023-09-10T00:12:46.591434+0000","last_active":"2023-09-10T00:12:49.224831+0000","last_peered":"2023-09-10T00:12:49.224831+0000","last_clean":"2023-09-10T00:12:49.224831+0000","last_became_active":"2023-09-10T00:12:46.590715+0000","last_became_peered":"2023-09-10T00:12:46.590715+0000","last_unstale":"2023-09-10T00:12:49.224831+0000","last_undegraded":"2023-09-10T00:12:49.224831+0000","last_fullsized":"2023-09-10T00:12:49.224831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:01:46.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615490+0000","last_change":"2023-09-10T00:12:42.497905+0000","last_active":"2023-09-10T00:12:47.615490+0000","last_peered":"2023-09-10T00:12:47.615490+0000","last_clean":"2023-09-10T00:12:47.615490+0000","last_became_active":"2023-09-10T00:12:42.497598+0000","last_became_peered":"2023-09-10T00:12:42.497598+0000","last_unstale":"2023-09-10T00:12:47.615490+0000","last_undegraded":"2023-09-10T00:12:47.615490+0000","last_fullsized":"2023-09-10T00:12:47.615490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:39:55.974777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577625+0000","last_change":"2023-09-10T00:12:41.498033+0000","last_active":"2023-09-10T00:12:47.577625+0000","last_peered":"2023-09-10T00:12:47.577625+0000","last_clean":"2023-09-10T00:12:47.577625+0000","last_became_active":"2023-09-10T00:12:41.497632+0000","last_became_peered":"2023-09-10T00:12:41.497632+0000","last_unstale":"2023-09-10T00:12:47.577625+0000","last_undegraded":"2023-09-10T00:12:47.577625+0000","last_fullsized":"2023-09-10T00:12:47.577625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:53:47.827726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224987+0000","last_change":"2023-09-10T00:12:46.589989+0000","last_active":"2023-09-10T00:12:49.224987+0000","last_peered":"2023-09-10T00:12:49.224987+0000","last_clean":"2023-09-10T00:12:49.224987+0000","last_became_active":"2023-09-10T00:12:46.589560+0000","last_became_peered":"2023-09-10T00:12:46.589560+0000","last_unstale":"2023-09-10T00:12:49.224987+0000","last_undegraded":"2023-09-10T00:12:49.224987+0000","last_fullsized":"2023-09-10T00:12:49.224987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:23:04.922319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780468+0000","last_change":"2023-09-10T00:12:42.492499+0000","last_active":"2023-09-10T00:12:47.780468+0000","last_peered":"2023-09-10T00:12:47.780468+0000","last_clean":"2023-09-10T00:12:47.780468+0000","last_became_active":"2023-09-10T00:12:42.492155+0000","last_became_peered":"2023-09-10T00:12:42.492155+0000","last_unstale":"2023-09-10T00:12:47.780468+0000","last_undegraded":"2023-09-10T00:12:47.780468+0000","last_fullsized":"2023-09-10T00:12:47.780468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:01.022446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782334+0000","last_change":"2023-09-10T00:12:41.523334+0000","last_active":"2023-09-10T00:12:47.782334+0000","last_peered":"2023-09-10T00:12:47.782334+0000","last_clean":"2023-09-10T00:12:47.782334+0000","last_became_active":"2023-09-10T00:12:41.522077+0000","last_became_peered":"2023-09-10T00:12:41.522077+0000","last_unstale":"2023-09-10T00:12:47.782334+0000","last_undegraded":"2023-09-10T00:12:47.782334+0000","last_fullsized":"2023-09-10T00:12:47.782334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:45:56.684537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223676+0000","last_change":"2023-09-10T00:12:47.432900+0000","last_active":"2023-09-10T00:12:49.223676+0000","last_peered":"2023-09-10T00:12:49.223676+0000","last_clean":"2023-09-10T00:12:49.223676+0000","last_became_active":"2023-09-10T00:12:47.431680+0000","last_became_peered":"2023-09-10T00:12:47.431680+0000","last_unstale":"2023-09-10T00:12:49.223676+0000","last_undegraded":"2023-09-10T00:12:49.223676+0000","last_fullsized":"2023-09-10T00:12:49.223676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782928+0000","last_change":"2023-09-10T00:12:42.550864+0000","last_active":"2023-09-10T00:12:47.782928+0000","last_peered":"2023-09-10T00:12:47.782928+0000","last_clean":"2023-09-10T00:12:47.782928+0000","last_became_active":"2023-09-10T00:12:42.550585+0000","last_became_peered":"2023-09-10T00:12:42.550585+0000","last_unstale":"2023-09-10T00:12:47.782928+0000","last_undegraded":"2023-09-10T00:12:47.782928+0000","last_fullsized":"2023-09-10T00:12:47.782928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781180+0000","last_change":"2023-09-10T00:12:41.519797+0000","last_active":"2023-09-10T00:12:47.781180+0000","last_peered":"2023-09-10T00:12:47.781180+0000","last_clean":"2023-09-10T00:12:47.781180+0000","last_became_active":"2023-09-10T00:12:41.519164+0000","last_became_peered":"2023-09-10T00:12:41.519164+0000","last_unstale":"2023-09-10T00:12:47.781180+0000","last_undegraded":"2023-09-10T00:12:47.781180+0000","last_fullsized":"2023-09-10T00:12:47.781180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782450+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:12:47.782450+0000","last_peered":"2023-09-10T00:12:47.782450+0000","last_clean":"2023-09-10T00:12:47.782450+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:12:47.782450+0000","last_undegraded":"2023-09-10T00:12:47.782450+0000","last_fullsized":"2023-09-10T00:12:47.782450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584664+0000","last_change":"2023-09-10T00:12:47.439252+0000","last_active":"2023-09-10T00:12:48.584664+0000","last_peered":"2023-09-10T00:12:48.584664+0000","last_clean":"2023-09-10T00:12:48.584664+0000","last_became_active":"2023-09-10T00:12:47.438174+0000","last_became_peered":"2023-09-10T00:12:47.438174+0000","last_unstale":"2023-09-10T00:12:48.584664+0000","last_undegraded":"2023-09-10T00:12:48.584664+0000","last_fullsized":"2023-09-10T00:12:48.584664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:57.581942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783443+0000","last_change":"2023-09-10T00:12:42.551864+0000","last_active":"2023-09-10T00:12:47.783443+0000","last_peered":"2023-09-10T00:12:47.783443+0000","last_clean":"2023-09-10T00:12:47.783443+0000","last_became_active":"2023-09-10T00:12:42.551345+0000","last_became_peered":"2023-09-10T00:12:42.551345+0000","last_unstale":"2023-09-10T00:12:47.783443+0000","last_undegraded":"2023-09-10T00:12:47.783443+0000","last_fullsized":"2023-09-10T00:12:47.783443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578183+0000","last_change":"2023-09-10T00:12:41.516689+0000","last_active":"2023-09-10T00:12:47.578183+0000","last_peered":"2023-09-10T00:12:47.578183+0000","last_clean":"2023-09-10T00:12:47.578183+0000","last_became_active":"2023-09-10T00:12:41.516069+0000","last_became_peered":"2023-09-10T00:12:41.516069+0000","last_unstale":"2023-09-10T00:12:47.578183+0000","last_undegraded":"2023-09-10T00:12:47.578183+0000","last_fullsized":"2023-09-10T00:12:47.578183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:22:16.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582898+0000","last_change":"2023-09-10T00:12:47.431597+0000","last_active":"2023-09-10T00:12:48.582898+0000","last_peered":"2023-09-10T00:12:48.582898+0000","last_clean":"2023-09-10T00:12:48.582898+0000","last_became_active":"2023-09-10T00:12:47.430655+0000","last_became_peered":"2023-09-10T00:12:47.430655+0000","last_unstale":"2023-09-10T00:12:48.582898+0000","last_undegraded":"2023-09-10T00:12:48.582898+0000","last_fullsized":"2023-09-10T00:12:48.582898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:33:42.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782062+0000","last_change":"2023-09-10T00:12:42.541778+0000","last_active":"2023-09-10T00:12:47.782062+0000","last_peered":"2023-09-10T00:12:47.782062+0000","last_clean":"2023-09-10T00:12:47.782062+0000","last_became_active":"2023-09-10T00:12:42.541049+0000","last_became_peered":"2023-09-10T00:12:42.541049+0000","last_unstale":"2023-09-10T00:12:47.782062+0000","last_undegraded":"2023-09-10T00:12:47.782062+0000","last_fullsized":"2023-09-10T00:12:47.782062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615672+0000","last_change":"2023-09-10T00:12:41.509830+0000","last_active":"2023-09-10T00:12:47.615672+0000","last_peered":"2023-09-10T00:12:47.615672+0000","last_clean":"2023-09-10T00:12:47.615672+0000","last_became_active":"2023-09-10T00:12:41.509495+0000","last_became_peered":"2023-09-10T00:12:41.509495+0000","last_unstale":"2023-09-10T00:12:47.615672+0000","last_undegraded":"2023-09-10T00:12:47.615672+0000","last_fullsized":"2023-09-10T00:12:47.615672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:44:59.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223136+0000","last_change":"2023-09-10T00:12:46.595012+0000","last_active":"2023-09-10T00:12:49.223136+0000","last_peered":"2023-09-10T00:12:49.223136+0000","last_clean":"2023-09-10T00:12:49.223136+0000","last_became_active":"2023-09-10T00:12:46.594222+0000","last_became_peered":"2023-09-10T00:12:46.594222+0000","last_unstale":"2023-09-10T00:12:49.223136+0000","last_undegraded":"2023-09-10T00:12:49.223136+0000","last_fullsized":"2023-09-10T00:12:49.223136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784267+0000","last_change":"2023-09-10T00:12:42.546647+0000","last_active":"2023-09-10T00:12:47.784267+0000","last_peered":"2023-09-10T00:12:47.784267+0000","last_clean":"2023-09-10T00:12:47.784267+0000","last_became_active":"2023-09-10T00:12:42.546180+0000","last_became_peered":"2023-09-10T00:12:42.546180+0000","last_unstale":"2023-09-10T00:12:47.784267+0000","last_undegraded":"2023-09-10T00:12:47.784267+0000","last_fullsized":"2023-09-10T00:12:47.784267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578028+0000","last_change":"2023-09-10T00:12:41.498190+0000","last_active":"2023-09-10T00:12:47.578028+0000","last_peered":"2023-09-10T00:12:47.578028+0000","last_clean":"2023-09-10T00:12:47.578028+0000","last_became_active":"2023-09-10T00:12:41.497767+0000","last_became_peered":"2023-09-10T00:12:41.497767+0000","last_unstale":"2023-09-10T00:12:47.578028+0000","last_undegraded":"2023-09-10T00:12:47.578028+0000","last_fullsized":"2023-09-10T00:12:47.578028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:26:08.442308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222434+0000","last_change":"2023-09-10T00:12:47.432026+0000","last_active":"2023-09-10T00:12:49.222434+0000","last_peered":"2023-09-10T00:12:49.222434+0000","last_clean":"2023-09-10T00:12:49.222434+0000","last_became_active":"2023-09-10T00:12:47.430924+0000","last_became_peered":"2023-09-10T00:12:47.430924+0000","last_unstale":"2023-09-10T00:12:49.222434+0000","last_undegraded":"2023-09-10T00:12:49.222434+0000","last_fullsized":"2023-09-10T00:12:49.222434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783979+0000","last_change":"2023-09-10T00:12:42.541280+0000","last_active":"2023-09-10T00:12:47.783979+0000","last_peered":"2023-09-10T00:12:47.783979+0000","last_clean":"2023-09-10T00:12:47.783979+0000","last_became_active":"2023-09-10T00:12:42.533762+0000","last_became_peered":"2023-09-10T00:12:42.533762+0000","last_unstale":"2023-09-10T00:12:47.783979+0000","last_undegraded":"2023-09-10T00:12:47.783979+0000","last_fullsized":"2023-09-10T00:12:47.783979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581569+0000","last_change":"2023-09-10T00:12:41.503433+0000","last_active":"2023-09-10T00:12:47.581569+0000","last_peered":"2023-09-10T00:12:47.581569+0000","last_clean":"2023-09-10T00:12:47.581569+0000","last_became_active":"2023-09-10T00:12:41.502639+0000","last_became_peered":"2023-09-10T00:12:41.502639+0000","last_unstale":"2023-09-10T00:12:47.581569+0000","last_undegraded":"2023-09-10T00:12:47.581569+0000","last_fullsized":"2023-09-10T00:12:47.581569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:28:54.792772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581399+0000","last_change":"2023-09-10T00:12:46.602461+0000","last_active":"2023-09-10T00:12:48.581399+0000","last_peered":"2023-09-10T00:12:48.581399+0000","last_clean":"2023-09-10T00:12:48.581399+0000","last_became_active":"2023-09-10T00:12:46.601011+0000","last_became_peered":"2023-09-10T00:12:46.601011+0000","last_unstale":"2023-09-10T00:12:48.581399+0000","last_undegraded":"2023-09-10T00:12:48.581399+0000","last_fullsized":"2023-09-10T00:12:48.581399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782746+0000","last_change":"2023-09-10T00:12:42.518701+0000","last_active":"2023-09-10T00:12:47.782746+0000","last_peered":"2023-09-10T00:12:47.782746+0000","last_clean":"2023-09-10T00:12:47.782746+0000","last_became_active":"2023-09-10T00:12:42.517943+0000","last_became_peered":"2023-09-10T00:12:42.517943+0000","last_unstale":"2023-09-10T00:12:47.782746+0000","last_undegraded":"2023-09-10T00:12:47.782746+0000","last_fullsized":"2023-09-10T00:12:47.782746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577561+0000","last_change":"2023-09-10T00:12:41.496219+0000","last_active":"2023-09-10T00:12:47.577561+0000","last_peered":"2023-09-10T00:12:47.577561+0000","last_clean":"2023-09-10T00:12:47.577561+0000","last_became_active":"2023-09-10T00:12:41.495862+0000","last_became_peered":"2023-09-10T00:12:41.495862+0000","last_unstale":"2023-09-10T00:12:47.577561+0000","last_undegraded":"2023-09-10T00:12:47.577561+0000","last_fullsized":"2023-09-10T00:12:47.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:56:10.667850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223317+0000","last_change":"2023-09-10T00:12:46.592307+0000","last_active":"2023-09-10T00:12:49.223317+0000","last_peered":"2023-09-10T00:12:49.223317+0000","last_clean":"2023-09-10T00:12:49.223317+0000","last_became_active":"2023-09-10T00:12:46.591133+0000","last_became_peered":"2023-09-10T00:12:46.591133+0000","last_unstale":"2023-09-10T00:12:49.223317+0000","last_undegraded":"2023-09-10T00:12:49.223317+0000","last_fullsized":"2023-09-10T00:12:49.223317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580013+0000","last_change":"2023-09-10T00:12:42.524709+0000","last_active":"2023-09-10T00:12:47.580013+0000","last_peered":"2023-09-10T00:12:47.580013+0000","last_clean":"2023-09-10T00:12:47.580013+0000","last_became_active":"2023-09-10T00:12:42.505826+0000","last_became_peered":"2023-09-10T00:12:42.505826+0000","last_unstale":"2023-09-10T00:12:47.580013+0000","last_undegraded":"2023-09-10T00:12:47.580013+0000","last_fullsized":"2023-09-10T00:12:47.580013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579962+0000","last_change":"2023-09-10T00:12:41.495448+0000","last_active":"2023-09-10T00:12:47.579962+0000","last_peered":"2023-09-10T00:12:47.579962+0000","last_clean":"2023-09-10T00:12:47.579962+0000","last_became_active":"2023-09-10T00:12:41.494697+0000","last_became_peered":"2023-09-10T00:12:41.494697+0000","last_unstale":"2023-09-10T00:12:47.579962+0000","last_undegraded":"2023-09-10T00:12:47.579962+0000","last_fullsized":"2023-09-10T00:12:47.579962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:21:19.631538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579415+0000","last_change":"2023-09-10T00:12:47.439992+0000","last_active":"2023-09-10T00:12:48.579415+0000","last_peered":"2023-09-10T00:12:48.579415+0000","last_clean":"2023-09-10T00:12:48.579415+0000","last_became_active":"2023-09-10T00:12:47.438590+0000","last_became_peered":"2023-09-10T00:12:47.438590+0000","last_unstale":"2023-09-10T00:12:48.579415+0000","last_undegraded":"2023-09-10T00:12:48.579415+0000","last_fullsized":"2023-09-10T00:12:48.579415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:09:09.398224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783239+0000","last_change":"2023-09-10T00:12:42.541600+0000","last_active":"2023-09-10T00:12:47.783239+0000","last_peered":"2023-09-10T00:12:47.783239+0000","last_clean":"2023-09-10T00:12:47.783239+0000","last_became_active":"2023-09-10T00:12:42.533858+0000","last_became_peered":"2023-09-10T00:12:42.533858+0000","last_unstale":"2023-09-10T00:12:47.783239+0000","last_undegraded":"2023-09-10T00:12:47.783239+0000","last_fullsized":"2023-09-10T00:12:47.783239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781900+0000","last_change":"2023-09-10T00:12:41.523860+0000","last_active":"2023-09-10T00:12:47.781900+0000","last_peered":"2023-09-10T00:12:47.781900+0000","last_clean":"2023-09-10T00:12:47.781900+0000","last_became_active":"2023-09-10T00:12:41.522192+0000","last_became_peered":"2023-09-10T00:12:41.522192+0000","last_unstale":"2023-09-10T00:12:47.781900+0000","last_undegraded":"2023-09-10T00:12:47.781900+0000","last_fullsized":"2023-09-10T00:12:47.781900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:29.890350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578583+0000","last_change":"2023-09-10T00:12:47.432628+0000","last_active":"2023-09-10T00:12:48.578583+0000","last_peered":"2023-09-10T00:12:48.578583+0000","last_clean":"2023-09-10T00:12:48.578583+0000","last_became_active":"2023-09-10T00:12:47.431415+0000","last_became_peered":"2023-09-10T00:12:47.431415+0000","last_unstale":"2023-09-10T00:12:48.578583+0000","last_undegraded":"2023-09-10T00:12:48.578583+0000","last_fullsized":"2023-09-10T00:12:48.578583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:30:23.542385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780877+0000","last_change":"2023-09-10T00:12:42.514023+0000","last_active":"2023-09-10T00:12:47.780877+0000","last_peered":"2023-09-10T00:12:47.780877+0000","last_clean":"2023-09-10T00:12:47.780877+0000","last_became_active":"2023-09-10T00:12:42.513715+0000","last_became_peered":"2023-09-10T00:12:42.513715+0000","last_unstale":"2023-09-10T00:12:47.780877+0000","last_undegraded":"2023-09-10T00:12:47.780877+0000","last_fullsized":"2023-09-10T00:12:47.780877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781349+0000","last_change":"2023-09-10T00:12:41.501329+0000","last_active":"2023-09-10T00:12:47.781349+0000","last_peered":"2023-09-10T00:12:47.781349+0000","last_clean":"2023-09-10T00:12:47.781349+0000","last_became_active":"2023-09-10T00:12:41.500908+0000","last_became_peered":"2023-09-10T00:12:41.500908+0000","last_unstale":"2023-09-10T00:12:47.781349+0000","last_undegraded":"2023-09-10T00:12:47.781349+0000","last_fullsized":"2023-09-10T00:12:47.781349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:42.290409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223679+0000","last_change":"2023-09-10T00:12:47.439596+0000","last_active":"2023-09-10T00:12:49.223679+0000","last_peered":"2023-09-10T00:12:49.223679+0000","last_clean":"2023-09-10T00:12:49.223679+0000","last_became_active":"2023-09-10T00:12:47.438423+0000","last_became_peered":"2023-09-10T00:12:47.438423+0000","last_unstale":"2023-09-10T00:12:49.223679+0000","last_undegraded":"2023-09-10T00:12:49.223679+0000","last_fullsized":"2023-09-10T00:12:49.223679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783453+0000","last_change":"2023-09-10T00:12:42.518431+0000","last_active":"2023-09-10T00:12:47.783453+0000","last_peered":"2023-09-10T00:12:47.783453+0000","last_clean":"2023-09-10T00:12:47.783453+0000","last_became_active":"2023-09-10T00:12:42.515011+0000","last_became_peered":"2023-09-10T00:12:42.515011+0000","last_unstale":"2023-09-10T00:12:47.783453+0000","last_undegraded":"2023-09-10T00:12:47.783453+0000","last_fullsized":"2023-09-10T00:12:47.783453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:52.647101+0000","last_change":"2023-09-10T00:12:41.501247+0000","last_active":"2023-09-10T00:12:52.647101+0000","last_peered":"2023-09-10T00:12:52.647101+0000","last_clean":"2023-09-10T00:12:52.647101+0000","last_became_active":"2023-09-10T00:12:41.500391+0000","last_became_peered":"2023-09-10T00:12:41.500391+0000","last_unstale":"2023-09-10T00:12:52.647101+0000","last_undegraded":"2023-09-10T00:12:52.647101+0000","last_fullsized":"2023-09-10T00:12:52.647101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224306+0000","last_change":"2023-09-10T00:12:46.591484+0000","last_active":"2023-09-10T00:12:49.224306+0000","last_peered":"2023-09-10T00:12:49.224306+0000","last_clean":"2023-09-10T00:12:49.224306+0000","last_became_active":"2023-09-10T00:12:46.590895+0000","last_became_peered":"2023-09-10T00:12:46.590895+0000","last_unstale":"2023-09-10T00:12:49.224306+0000","last_undegraded":"2023-09-10T00:12:49.224306+0000","last_fullsized":"2023-09-10T00:12:49.224306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:50:45.730271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581291+0000","last_change":"2023-09-10T00:12:42.521690+0000","last_active":"2023-09-10T00:12:47.581291+0000","last_peered":"2023-09-10T00:12:47.581291+0000","last_clean":"2023-09-10T00:12:47.581291+0000","last_became_active":"2023-09-10T00:12:42.520931+0000","last_became_peered":"2023-09-10T00:12:42.520931+0000","last_unstale":"2023-09-10T00:12:47.581291+0000","last_undegraded":"2023-09-10T00:12:47.581291+0000","last_fullsized":"2023-09-10T00:12:47.581291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:03.905490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615500+0000","last_change":"2023-09-10T00:12:41.527727+0000","last_active":"2023-09-10T00:12:47.615500+0000","last_peered":"2023-09-10T00:12:47.615500+0000","last_clean":"2023-09-10T00:12:47.615500+0000","last_became_active":"2023-09-10T00:12:41.527495+0000","last_became_peered":"2023-09-10T00:12:41.527495+0000","last_unstale":"2023-09-10T00:12:47.615500+0000","last_undegraded":"2023-09-10T00:12:47.615500+0000","last_fullsized":"2023-09-10T00:12:47.615500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:41.673766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583605+0000","last_change":"2023-09-10T00:12:46.593774+0000","last_active":"2023-09-10T00:12:48.583605+0000","last_peered":"2023-09-10T00:12:48.583605+0000","last_clean":"2023-09-10T00:12:48.583605+0000","last_became_active":"2023-09-10T00:12:46.592641+0000","last_became_peered":"2023-09-10T00:12:46.592641+0000","last_unstale":"2023-09-10T00:12:48.583605+0000","last_undegraded":"2023-09-10T00:12:48.583605+0000","last_fullsized":"2023-09-10T00:12:48.583605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781921+0000","last_change":"2023-09-10T00:12:42.541125+0000","last_active":"2023-09-10T00:12:47.781921+0000","last_peered":"2023-09-10T00:12:47.781921+0000","last_clean":"2023-09-10T00:12:47.781921+0000","last_became_active":"2023-09-10T00:12:42.540816+0000","last_became_peered":"2023-09-10T00:12:42.540816+0000","last_unstale":"2023-09-10T00:12:47.781921+0000","last_undegraded":"2023-09-10T00:12:47.781921+0000","last_fullsized":"2023-09-10T00:12:47.781921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781459+0000","last_change":"2023-09-10T00:12:41.525602+0000","last_active":"2023-09-10T00:12:47.781459+0000","last_peered":"2023-09-10T00:12:47.781459+0000","last_clean":"2023-09-10T00:12:47.781459+0000","last_became_active":"2023-09-10T00:12:41.524971+0000","last_became_peered":"2023-09-10T00:12:41.524971+0000","last_unstale":"2023-09-10T00:12:47.781459+0000","last_undegraded":"2023-09-10T00:12:47.781459+0000","last_fullsized":"2023-09-10T00:12:47.781459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578028+0000","last_change":"2023-09-10T00:12:46.590880+0000","last_active":"2023-09-10T00:12:48.578028+0000","last_peered":"2023-09-10T00:12:48.578028+0000","last_clean":"2023-09-10T00:12:48.578028+0000","last_became_active":"2023-09-10T00:12:46.590393+0000","last_became_peered":"2023-09-10T00:12:46.590393+0000","last_unstale":"2023-09-10T00:12:48.578028+0000","last_undegraded":"2023-09-10T00:12:48.578028+0000","last_fullsized":"2023-09-10T00:12:48.578028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:26.815586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781335+0000","last_change":"2023-09-10T00:12:42.546455+0000","last_active":"2023-09-10T00:12:47.781335+0000","last_peered":"2023-09-10T00:12:47.781335+0000","last_clean":"2023-09-10T00:12:47.781335+0000","last_became_active":"2023-09-10T00:12:42.545882+0000","last_became_peered":"2023-09-10T00:12:42.545882+0000","last_unstale":"2023-09-10T00:12:47.781335+0000","last_undegraded":"2023-09-10T00:12:47.781335+0000","last_fullsized":"2023-09-10T00:12:47.781335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583657+0000","last_change":"2023-09-10T00:12:41.526211+0000","last_active":"2023-09-10T00:12:47.583657+0000","last_peered":"2023-09-10T00:12:47.583657+0000","last_clean":"2023-09-10T00:12:47.583657+0000","last_became_active":"2023-09-10T00:12:41.525658+0000","last_became_peered":"2023-09-10T00:12:41.525658+0000","last_unstale":"2023-09-10T00:12:47.583657+0000","last_undegraded":"2023-09-10T00:12:47.583657+0000","last_fullsized":"2023-09-10T00:12:47.583657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578029+0000","last_change":"2023-09-10T00:12:47.440422+0000","last_active":"2023-09-10T00:12:48.578029+0000","last_peered":"2023-09-10T00:12:48.578029+0000","last_clean":"2023-09-10T00:12:48.578029+0000","last_became_active":"2023-09-10T00:12:47.438490+0000","last_became_peered":"2023-09-10T00:12:47.438490+0000","last_unstale":"2023-09-10T00:12:48.578029+0000","last_undegraded":"2023-09-10T00:12:48.578029+0000","last_fullsized":"2023-09-10T00:12:48.578029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:42:20.520101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222944+0000","last_change":"2023-09-10T00:12:47.440252+0000","last_active":"2023-09-10T00:12:49.222944+0000","last_peered":"2023-09-10T00:12:49.222944+0000","last_clean":"2023-09-10T00:12:49.222944+0000","last_became_active":"2023-09-10T00:12:47.438785+0000","last_became_peered":"2023-09-10T00:12:47.438785+0000","last_unstale":"2023-09-10T00:12:49.222944+0000","last_undegraded":"2023-09-10T00:12:49.222944+0000","last_fullsized":"2023-09-10T00:12:49.222944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614683+0000","last_change":"2023-09-10T00:12:42.503107+0000","last_active":"2023-09-10T00:12:47.614683+0000","last_peered":"2023-09-10T00:12:47.614683+0000","last_clean":"2023-09-10T00:12:47.614683+0000","last_became_active":"2023-09-10T00:12:42.502824+0000","last_became_peered":"2023-09-10T00:12:42.502824+0000","last_unstale":"2023-09-10T00:12:47.614683+0000","last_undegraded":"2023-09-10T00:12:47.614683+0000","last_fullsized":"2023-09-10T00:12:47.614683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:12:53.862661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781222+0000","last_change":"2023-09-10T00:12:41.530180+0000","last_active":"2023-09-10T00:12:47.781222+0000","last_peered":"2023-09-10T00:12:47.781222+0000","last_clean":"2023-09-10T00:12:47.781222+0000","last_became_active":"2023-09-10T00:12:41.529649+0000","last_became_peered":"2023-09-10T00:12:41.529649+0000","last_unstale":"2023-09-10T00:12:47.781222+0000","last_undegraded":"2023-09-10T00:12:47.781222+0000","last_fullsized":"2023-09-10T00:12:47.781222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:46.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.586697+0000","last_change":"2023-09-10T00:12:46.606697+0000","last_active":"2023-09-10T00:12:48.586697+0000","last_peered":"2023-09-10T00:12:48.586697+0000","last_clean":"2023-09-10T00:12:48.586697+0000","last_became_active":"2023-09-10T00:12:46.605416+0000","last_became_peered":"2023-09-10T00:12:46.605416+0000","last_unstale":"2023-09-10T00:12:48.586697+0000","last_undegraded":"2023-09-10T00:12:48.586697+0000","last_fullsized":"2023-09-10T00:12:48.586697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782768+0000","last_change":"2023-09-10T00:12:42.504040+0000","last_active":"2023-09-10T00:12:47.782768+0000","last_peered":"2023-09-10T00:12:47.782768+0000","last_clean":"2023-09-10T00:12:47.782768+0000","last_became_active":"2023-09-10T00:12:42.497706+0000","last_became_peered":"2023-09-10T00:12:42.497706+0000","last_unstale":"2023-09-10T00:12:47.782768+0000","last_undegraded":"2023-09-10T00:12:47.782768+0000","last_fullsized":"2023-09-10T00:12:47.782768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782782+0000","last_change":"2023-09-10T00:12:41.507432+0000","last_active":"2023-09-10T00:12:47.782782+0000","last_peered":"2023-09-10T00:12:47.782782+0000","last_clean":"2023-09-10T00:12:47.782782+0000","last_became_active":"2023-09-10T00:12:41.507133+0000","last_became_peered":"2023-09-10T00:12:41.507133+0000","last_unstale":"2023-09-10T00:12:47.782782+0000","last_undegraded":"2023-09-10T00:12:47.782782+0000","last_fullsized":"2023-09-10T00:12:47.782782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582295+0000","last_change":"2023-09-10T00:12:41.503643+0000","last_active":"2023-09-10T00:12:47.582295+0000","last_peered":"2023-09-10T00:12:47.582295+0000","last_clean":"2023-09-10T00:12:47.582295+0000","last_became_active":"2023-09-10T00:12:41.502542+0000","last_became_peered":"2023-09-10T00:12:41.502542+0000","last_unstale":"2023-09-10T00:12:47.582295+0000","last_undegraded":"2023-09-10T00:12:47.582295+0000","last_fullsized":"2023-09-10T00:12:47.582295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781211+0000","last_change":"2023-09-10T00:12:42.496774+0000","last_active":"2023-09-10T00:12:47.781211+0000","last_peered":"2023-09-10T00:12:47.781211+0000","last_clean":"2023-09-10T00:12:47.781211+0000","last_became_active":"2023-09-10T00:12:42.496456+0000","last_became_peered":"2023-09-10T00:12:42.496456+0000","last_unstale":"2023-09-10T00:12:47.781211+0000","last_undegraded":"2023-09-10T00:12:47.781211+0000","last_fullsized":"2023-09-10T00:12:47.781211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.221683+0000","last_change":"2023-09-10T00:12:46.594913+0000","last_active":"2023-09-10T00:12:49.221683+0000","last_peered":"2023-09-10T00:12:49.221683+0000","last_clean":"2023-09-10T00:12:49.221683+0000","last_became_active":"2023-09-10T00:12:46.594488+0000","last_became_peered":"2023-09-10T00:12:46.594488+0000","last_unstale":"2023-09-10T00:12:49.221683+0000","last_undegraded":"2023-09-10T00:12:49.221683+0000","last_fullsized":"2023-09-10T00:12:49.221683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:35.215018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783437+0000","last_change":"2023-09-10T00:12:41.507753+0000","last_active":"2023-09-10T00:12:47.783437+0000","last_peered":"2023-09-10T00:12:47.783437+0000","last_clean":"2023-09-10T00:12:47.783437+0000","last_became_active":"2023-09-10T00:12:41.507335+0000","last_became_peered":"2023-09-10T00:12:41.507335+0000","last_unstale":"2023-09-10T00:12:47.783437+0000","last_undegraded":"2023-09-10T00:12:47.783437+0000","last_fullsized":"2023-09-10T00:12:47.783437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580684+0000","last_change":"2023-09-10T00:12:42.501100+0000","last_active":"2023-09-10T00:12:47.580684+0000","last_peered":"2023-09-10T00:12:47.580684+0000","last_clean":"2023-09-10T00:12:47.580684+0000","last_became_active":"2023-09-10T00:12:42.500331+0000","last_became_peered":"2023-09-10T00:12:42.500331+0000","last_unstale":"2023-09-10T00:12:47.580684+0000","last_undegraded":"2023-09-10T00:12:47.580684+0000","last_fullsized":"2023-09-10T00:12:47.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:55.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579211+0000","last_change":"2023-09-10T00:12:46.577981+0000","last_active":"2023-09-10T00:12:48.579211+0000","last_peered":"2023-09-10T00:12:48.579211+0000","last_clean":"2023-09-10T00:12:48.579211+0000","last_became_active":"2023-09-10T00:12:46.577624+0000","last_became_peered":"2023-09-10T00:12:46.577624+0000","last_unstale":"2023-09-10T00:12:48.579211+0000","last_undegraded":"2023-09-10T00:12:48.579211+0000","last_fullsized":"2023-09-10T00:12:48.579211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:03:59.306486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579555+0000","last_change":"2023-09-10T00:12:42.523920+0000","last_active":"2023-09-10T00:12:47.579555+0000","last_peered":"2023-09-10T00:12:47.579555+0000","last_clean":"2023-09-10T00:12:47.579555+0000","last_became_active":"2023-09-10T00:12:42.523139+0000","last_became_peered":"2023-09-10T00:12:42.523139+0000","last_unstale":"2023-09-10T00:12:47.579555+0000","last_undegraded":"2023-09-10T00:12:47.579555+0000","last_fullsized":"2023-09-10T00:12:47.579555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577535+0000","last_change":"2023-09-10T00:12:42.541910+0000","last_active":"2023-09-10T00:12:47.577535+0000","last_peered":"2023-09-10T00:12:47.577535+0000","last_clean":"2023-09-10T00:12:47.577535+0000","last_became_active":"2023-09-10T00:12:42.541606+0000","last_became_peered":"2023-09-10T00:12:42.541606+0000","last_unstale":"2023-09-10T00:12:47.577535+0000","last_undegraded":"2023-09-10T00:12:47.577535+0000","last_fullsized":"2023-09-10T00:12:47.577535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:50.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781888+0000","last_change":"2023-09-10T00:12:42.520562+0000","last_active":"2023-09-10T00:12:47.781888+0000","last_peered":"2023-09-10T00:12:47.781888+0000","last_clean":"2023-09-10T00:12:47.781888+0000","last_became_active":"2023-09-10T00:12:42.509305+0000","last_became_peered":"2023-09-10T00:12:42.509305+0000","last_unstale":"2023-09-10T00:12:47.781888+0000","last_undegraded":"2023-09-10T00:12:47.781888+0000","last_fullsized":"2023-09-10T00:12:47.781888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781110+0000","last_change":"2023-09-10T00:12:42.503904+0000","last_active":"2023-09-10T00:12:47.781110+0000","last_peered":"2023-09-10T00:12:47.781110+0000","last_clean":"2023-09-10T00:12:47.781110+0000","last_became_active":"2023-09-10T00:12:42.503477+0000","last_became_peered":"2023-09-10T00:12:42.503477+0000","last_unstale":"2023-09-10T00:12:47.781110+0000","last_undegraded":"2023-09-10T00:12:47.781110+0000","last_fullsized":"2023-09-10T00:12:47.781110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783728+0000","last_change":"2023-09-10T00:12:42.506439+0000","last_active":"2023-09-10T00:12:47.783728+0000","last_peered":"2023-09-10T00:12:47.783728+0000","last_clean":"2023-09-10T00:12:47.783728+0000","last_became_active":"2023-09-10T00:12:42.504454+0000","last_became_peered":"2023-09-10T00:12:42.504454+0000","last_unstale":"2023-09-10T00:12:47.783728+0000","last_undegraded":"2023-09-10T00:12:47.783728+0000","last_fullsized":"2023-09-10T00:12:47.783728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615152+0000","last_change":"2023-09-10T00:12:42.503158+0000","last_active":"2023-09-10T00:12:47.615152+0000","last_peered":"2023-09-10T00:12:47.615152+0000","last_clean":"2023-09-10T00:12:47.615152+0000","last_became_active":"2023-09-10T00:12:42.502881+0000","last_became_peered":"2023-09-10T00:12:42.502881+0000","last_unstale":"2023-09-10T00:12:47.615152+0000","last_undegraded":"2023-09-10T00:12:47.615152+0000","last_fullsized":"2023-09-10T00:12:47.615152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:31.129379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583567+0000","last_change":"2023-09-10T00:12:42.526817+0000","last_active":"2023-09-10T00:12:47.583567+0000","last_peered":"2023-09-10T00:12:47.583567+0000","last_clean":"2023-09-10T00:12:47.583567+0000","last_became_active":"2023-09-10T00:12:42.525834+0000","last_became_peered":"2023-09-10T00:12:42.525834+0000","last_unstale":"2023-09-10T00:12:47.583567+0000","last_undegraded":"2023-09-10T00:12:47.583567+0000","last_fullsized":"2023-09-10T00:12:47.583567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783919+0000","last_change":"2023-09-10T00:12:42.503440+0000","last_active":"2023-09-10T00:12:47.783919+0000","last_peered":"2023-09-10T00:12:47.783919+0000","last_clean":"2023-09-10T00:12:47.783919+0000","last_became_active":"2023-09-10T00:12:42.503128+0000","last_became_peered":"2023-09-10T00:12:42.503128+0000","last_unstale":"2023-09-10T00:12:47.783919+0000","last_undegraded":"2023-09-10T00:12:47.783919+0000","last_fullsized":"2023-09-10T00:12:47.783919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780980+0000","last_change":"2023-09-10T00:12:42.549808+0000","last_active":"2023-09-10T00:12:47.780980+0000","last_peered":"2023-09-10T00:12:47.780980+0000","last_clean":"2023-09-10T00:12:47.780980+0000","last_became_active":"2023-09-10T00:12:42.549085+0000","last_became_peered":"2023-09-10T00:12:42.549085+0000","last_unstale":"2023-09-10T00:12:47.780980+0000","last_undegraded":"2023-09-10T00:12:47.780980+0000","last_fullsized":"2023-09-10T00:12:47.780980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782646+0000","last_change":"2023-09-10T00:12:42.502195+0000","last_active":"2023-09-10T00:12:47.782646+0000","last_peered":"2023-09-10T00:12:47.782646+0000","last_clean":"2023-09-10T00:12:47.782646+0000","last_became_active":"2023-09-10T00:12:42.501637+0000","last_became_peered":"2023-09-10T00:12:42.501637+0000","last_unstale":"2023-09-10T00:12:47.782646+0000","last_undegraded":"2023-09-10T00:12:47.782646+0000","last_fullsized":"2023-09-10T00:12:47.782646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781670+0000","last_change":"2023-09-10T00:12:42.532920+0000","last_active":"2023-09-10T00:12:47.781670+0000","last_peered":"2023-09-10T00:12:47.781670+0000","last_clean":"2023-09-10T00:12:47.781670+0000","last_became_active":"2023-09-10T00:12:42.532282+0000","last_became_peered":"2023-09-10T00:12:42.532282+0000","last_unstale":"2023-09-10T00:12:47.781670+0000","last_undegraded":"2023-09-10T00:12:47.781670+0000","last_fullsized":"2023-09-10T00:12:47.781670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780619+0000","last_change":"2023-09-10T00:12:42.502049+0000","last_active":"2023-09-10T00:12:47.780619+0000","last_peered":"2023-09-10T00:12:47.780619+0000","last_clean":"2023-09-10T00:12:47.780619+0000","last_became_active":"2023-09-10T00:12:42.501720+0000","last_became_peered":"2023-09-10T00:12:42.501720+0000","last_unstale":"2023-09-10T00:12:47.780619+0000","last_undegraded":"2023-09-10T00:12:47.780619+0000","last_fullsized":"2023-09-10T00:12:47.780619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582329+0000","last_change":"2023-09-10T00:12:42.527735+0000","last_active":"2023-09-10T00:12:47.582329+0000","last_peered":"2023-09-10T00:12:47.582329+0000","last_clean":"2023-09-10T00:12:47.582329+0000","last_became_active":"2023-09-10T00:12:42.526982+0000","last_became_peered":"2023-09-10T00:12:42.526982+0000","last_unstale":"2023-09-10T00:12:47.582329+0000","last_undegraded":"2023-09-10T00:12:47.582329+0000","last_fullsized":"2023-09-10T00:12:47.582329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:42.530154+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:42.529662+0000","last_became_peered":"2023-09-10T00:12:42.529662+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578018+0000","last_change":"2023-09-10T00:12:42.539691+0000","last_active":"2023-09-10T00:12:47.578018+0000","last_peered":"2023-09-10T00:12:47.578018+0000","last_clean":"2023-09-10T00:12:47.578018+0000","last_became_active":"2023-09-10T00:12:42.539317+0000","last_became_peered":"2023-09-10T00:12:42.539317+0000","last_unstale":"2023-09-10T00:12:47.578018+0000","last_undegraded":"2023-09-10T00:12:47.578018+0000","last_fullsized":"2023-09-10T00:12:47.578018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:16.849606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782318+0000","last_change":"2023-09-10T00:12:42.559699+0000","last_active":"2023-09-10T00:12:47.782318+0000","last_peered":"2023-09-10T00:12:47.782318+0000","last_clean":"2023-09-10T00:12:47.782318+0000","last_became_active":"2023-09-10T00:12:42.559176+0000","last_became_peered":"2023-09-10T00:12:42.559176+0000","last_unstale":"2023-09-10T00:12:47.782318+0000","last_undegraded":"2023-09-10T00:12:47.782318+0000","last_fullsized":"2023-09-10T00:12:47.782318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:22:14.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780714+0000","last_change":"2023-09-10T00:12:42.550456+0000","last_active":"2023-09-10T00:12:47.780714+0000","last_peered":"2023-09-10T00:12:47.780714+0000","last_clean":"2023-09-10T00:12:47.780714+0000","last_became_active":"2023-09-10T00:12:42.549896+0000","last_became_peered":"2023-09-10T00:12:42.549896+0000","last_unstale":"2023-09-10T00:12:47.780714+0000","last_undegraded":"2023-09-10T00:12:47.780714+0000","last_fullsized":"2023-09-10T00:12:47.780714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614735+0000","last_change":"2023-09-10T00:12:42.505565+0000","last_active":"2023-09-10T00:12:47.614735+0000","last_peered":"2023-09-10T00:12:47.614735+0000","last_clean":"2023-09-10T00:12:47.614735+0000","last_became_active":"2023-09-10T00:12:42.504834+0000","last_became_peered":"2023-09-10T00:12:42.504834+0000","last_unstale":"2023-09-10T00:12:47.614735+0000","last_undegraded":"2023-09-10T00:12:47.614735+0000","last_fullsized":"2023-09-10T00:12:47.614735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:06:02.585817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780755+0000","last_change":"2023-09-10T00:12:42.497048+0000","last_active":"2023-09-10T00:12:47.780755+0000","last_peered":"2023-09-10T00:12:47.780755+0000","last_clean":"2023-09-10T00:12:47.780755+0000","last_became_active":"2023-09-10T00:12:42.496135+0000","last_became_peered":"2023-09-10T00:12:42.496135+0000","last_unstale":"2023-09-10T00:12:47.780755+0000","last_undegraded":"2023-09-10T00:12:47.780755+0000","last_fullsized":"2023-09-10T00:12:47.780755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:31:37.425124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783142+0000","last_change":"2023-09-10T00:12:42.539859+0000","last_active":"2023-09-10T00:12:47.783142+0000","last_peered":"2023-09-10T00:12:47.783142+0000","last_clean":"2023-09-10T00:12:47.783142+0000","last_became_active":"2023-09-10T00:12:42.539545+0000","last_became_peered":"2023-09-10T00:12:42.539545+0000","last_unstale":"2023-09-10T00:12:47.783142+0000","last_undegraded":"2023-09-10T00:12:47.783142+0000","last_fullsized":"2023-09-10T00:12:47.783142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581017+0000","last_change":"2023-09-10T00:12:42.528935+0000","last_active":"2023-09-10T00:12:47.581017+0000","last_peered":"2023-09-10T00:12:47.581017+0000","last_clean":"2023-09-10T00:12:47.581017+0000","last_became_active":"2023-09-10T00:12:42.528159+0000","last_became_peered":"2023-09-10T00:12:42.528159+0000","last_unstale":"2023-09-10T00:12:47.581017+0000","last_undegraded":"2023-09-10T00:12:47.581017+0000","last_fullsized":"2023-09-10T00:12:47.581017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:43.303596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582968+0000","last_change":"2023-09-10T00:12:42.553610+0000","last_active":"2023-09-10T00:12:47.582968+0000","last_peered":"2023-09-10T00:12:47.582968+0000","last_clean":"2023-09-10T00:12:47.582968+0000","last_became_active":"2023-09-10T00:12:42.553091+0000","last_became_peered":"2023-09-10T00:12:42.553091+0000","last_unstale":"2023-09-10T00:12:47.582968+0000","last_undegraded":"2023-09-10T00:12:47.582968+0000","last_fullsized":"2023-09-10T00:12:47.582968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583568+0000","last_change":"2023-09-10T00:12:42.549380+0000","last_active":"2023-09-10T00:12:47.583568+0000","last_peered":"2023-09-10T00:12:47.583568+0000","last_clean":"2023-09-10T00:12:47.583568+0000","last_became_active":"2023-09-10T00:12:42.548763+0000","last_became_peered":"2023-09-10T00:12:42.548763+0000","last_unstale":"2023-09-10T00:12:47.583568+0000","last_undegraded":"2023-09-10T00:12:47.583568+0000","last_fullsized":"2023-09-10T00:12:47.583568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784264+0000","last_change":"2023-09-10T00:12:42.551603+0000","last_active":"2023-09-10T00:12:47.784264+0000","last_peered":"2023-09-10T00:12:47.784264+0000","last_clean":"2023-09-10T00:12:47.784264+0000","last_became_active":"2023-09-10T00:12:42.551111+0000","last_became_peered":"2023-09-10T00:12:42.551111+0000","last_unstale":"2023-09-10T00:12:47.784264+0000","last_undegraded":"2023-09-10T00:12:47.784264+0000","last_fullsized":"2023-09-10T00:12:47.784264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782492+0000","last_change":"2023-09-10T00:12:42.551120+0000","last_active":"2023-09-10T00:12:47.782492+0000","last_peered":"2023-09-10T00:12:47.782492+0000","last_clean":"2023-09-10T00:12:47.782492+0000","last_became_active":"2023-09-10T00:12:42.550803+0000","last_became_peered":"2023-09-10T00:12:42.550803+0000","last_unstale":"2023-09-10T00:12:47.782492+0000","last_undegraded":"2023-09-10T00:12:47.782492+0000","last_fullsized":"2023-09-10T00:12:47.782492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781988+0000","last_change":"2023-09-10T00:12:42.515188+0000","last_active":"2023-09-10T00:12:47.781988+0000","last_peered":"2023-09-10T00:12:47.781988+0000","last_clean":"2023-09-10T00:12:47.781988+0000","last_became_active":"2023-09-10T00:12:42.514135+0000","last_became_peered":"2023-09-10T00:12:42.514135+0000","last_unstale":"2023-09-10T00:12:47.781988+0000","last_undegraded":"2023-09-10T00:12:47.781988+0000","last_fullsized":"2023-09-10T00:12:47.781988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781647+0000","last_change":"2023-09-10T00:12:42.542532+0000","last_active":"2023-09-10T00:12:47.781647+0000","last_peered":"2023-09-10T00:12:47.781647+0000","last_clean":"2023-09-10T00:12:47.781647+0000","last_became_active":"2023-09-10T00:12:42.536897+0000","last_became_peered":"2023-09-10T00:12:42.536897+0000","last_unstale":"2023-09-10T00:12:47.781647+0000","last_undegraded":"2023-09-10T00:12:47.781647+0000","last_fullsized":"2023-09-10T00:12:47.781647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782937+0000","last_change":"2023-09-10T00:12:42.519515+0000","last_active":"2023-09-10T00:12:47.782937+0000","last_peered":"2023-09-10T00:12:47.782937+0000","last_clean":"2023-09-10T00:12:47.782937+0000","last_became_active":"2023-09-10T00:12:42.518734+0000","last_became_peered":"2023-09-10T00:12:42.518734+0000","last_unstale":"2023-09-10T00:12:47.782937+0000","last_undegraded":"2023-09-10T00:12:47.782937+0000","last_fullsized":"2023-09-10T00:12:47.782937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781617+0000","last_change":"2023-09-10T00:12:42.548980+0000","last_active":"2023-09-10T00:12:47.781617+0000","last_peered":"2023-09-10T00:12:47.781617+0000","last_clean":"2023-09-10T00:12:47.781617+0000","last_became_active":"2023-09-10T00:12:42.548305+0000","last_became_peered":"2023-09-10T00:12:42.548305+0000","last_unstale":"2023-09-10T00:12:47.781617+0000","last_undegraded":"2023-09-10T00:12:47.781617+0000","last_fullsized":"2023-09-10T00:12:47.781617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781352+0000","last_change":"2023-09-10T00:12:42.498654+0000","last_active":"2023-09-10T00:12:47.781352+0000","last_peered":"2023-09-10T00:12:47.781352+0000","last_clean":"2023-09-10T00:12:47.781352+0000","last_became_active":"2023-09-10T00:12:42.498336+0000","last_became_peered":"2023-09-10T00:12:42.498336+0000","last_unstale":"2023-09-10T00:12:47.781352+0000","last_undegraded":"2023-09-10T00:12:47.781352+0000","last_fullsized":"2023-09-10T00:12:47.781352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615376+0000","last_change":"2023-09-10T00:12:42.496796+0000","last_active":"2023-09-10T00:12:47.615376+0000","last_peered":"2023-09-10T00:12:47.615376+0000","last_clean":"2023-09-10T00:12:47.615376+0000","last_became_active":"2023-09-10T00:12:42.496366+0000","last_became_peered":"2023-09-10T00:12:42.496366+0000","last_unstale":"2023-09-10T00:12:47.615376+0000","last_undegraded":"2023-09-10T00:12:47.615376+0000","last_fullsized":"2023-09-10T00:12:47.615376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:56.597066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784129+0000","last_change":"2023-09-10T00:12:42.545759+0000","last_active":"2023-09-10T00:12:47.784129+0000","last_peered":"2023-09-10T00:12:47.784129+0000","last_clean":"2023-09-10T00:12:47.784129+0000","last_became_active":"2023-09-10T00:12:42.545347+0000","last_became_peered":"2023-09-10T00:12:42.545347+0000","last_unstale":"2023-09-10T00:12:47.784129+0000","last_undegraded":"2023-09-10T00:12:47.784129+0000","last_fullsized":"2023-09-10T00:12:47.784129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":699380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4750000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":699436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:13:06.593 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-10T00:13:06.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-09-10T00:13:06.595 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-10T00:13:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 -- 172.21.15.84:0/237621680 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa398069e40 msgr2=0x7fa39806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 --2- 172.21.15.84:0/237621680 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa398069e40 0x7fa39806a2a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa388009840 tx=0x7fa38801c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 -- 172.21.15.84:0/237621680 shutdown_connections 2023-09-10T00:13:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 --2- 172.21.15.84:0/237621680 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa398069e40 0x7fa39806a2a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 --2- 172.21.15.84:0/237621680 >> v2:172.21.15.100:3300/0 conn(0x7fa398157290 0x7fa3980ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 -- 172.21.15.84:0/237621680 >> 172.21.15.84:0/237621680 conn(0x7fa3980c9500 msgr2=0x7fa3980c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 -- 172.21.15.84:0/237621680 shutdown_connections 2023-09-10T00:13:06.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.754+0000 7fa39f66b640 1 -- 172.21.15.84:0/237621680 wait complete. 2023-09-10T00:13:06.761 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 Processor -- start 2023-09-10T00:13:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- start start 2023-09-10T00:13:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 0x7fa398157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3980c6cd0 0x7fa39814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39814fc90 con 0x7fa398157290 2023-09-10T00:13:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398150810 con 0x7fa398069e40 2023-09-10T00:13:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39814fee0 con 0x7fa3980c6cd0 2023-09-10T00:13:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43768/0 (socket says 172.21.15.84:43768) 2023-09-10T00:13:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 -- 172.21.15.84:0/3362346168 learned_addr learned my addr 172.21.15.84:0/3362346168 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39d407640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 0x7fa398157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39cc06640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3980c6cd0 0x7fa39814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 -- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3980c6cd0 msgr2=0x7fa39814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3980c6cd0 0x7fa39814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 -- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 msgr2=0x7fa398157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 0x7fa398157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 -- 172.21.15.84:0/3362346168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3880094a0 con 0x7fa398157290 2023-09-10T00:13:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39d407640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 0x7fa398157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:06.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39dc08640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39000cb70 tx=0x7fa39000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39000aa50 con 0x7fa398157290 2023-09-10T00:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa39000aca0 con 0x7fa398157290 2023-09-10T00:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3981501c0 con 0x7fa398157290 2023-09-10T00:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390012680 con 0x7fa398157290 2023-09-10T00:13:06.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa398157db0 con 0x7fa398157290 2023-09-10T00:13:06.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3981509a0 con 0x7fa398157290 2023-09-10T00:13:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.758+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa39001a3b0 con 0x7fa398157290 2023-09-10T00:13:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.762+0000 7fa38dffb640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 0x7fa37c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.762+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa390083a20 con 0x7fa398157290 2023-09-10T00:13:06.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.762+0000 7fa39d407640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 0x7fa37c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.762+0000 7fa39d407640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 0x7fa37c068010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa394009b90 tx=0x7fa3940091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:06.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.766+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa390050fe0 con 0x7fa398157290 2023-09-10T00:13:06.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.918+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7fa39806cd90 con 0x7fa398157290 2023-09-10T00:13:06.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa38dffb640 1 -- 172.21.15.84:0/3362346168 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7fa3900160b0 con 0x7fa398157290 2023-09-10T00:13:06.924 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 msgr2=0x7fa37c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 0x7fa37c068010 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa394009b90 tx=0x7fa3940091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 msgr2=0x7fa3980c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:06.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa39000cb70 tx=0x7fa39000cc60 comp rx=0 tx=0).stop 2023-09-10T00:13:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 shutdown_connections 2023-09-10T00:13:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa37c065b50 0x7fa37c068010 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa398157290 0x7fa3980c2840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3980c6cd0 0x7fa39814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 --2- 172.21.15.84:0/3362346168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa398069e40 0x7fa398157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 >> 172.21.15.84:0/3362346168 conn(0x7fa3980c9500 msgr2=0x7fa39814f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 shutdown_connections 2023-09-10T00:13:06.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:06.922+0000 7fa39f66b640 1 -- 172.21.15.84:0/3362346168 wait complete. 2023-09-10T00:13:06.942 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":30,"timestamp":"2023-09-10T00:12:28.216059+0000","name":"","changes":[{"name":"osd.7/osd_mclock_max_capacity_iops_ssd","new_value":"3611.022013"}]}] 2023-09-10T00:13:06.943 INFO:tasks.ceph_manager:config epoch is 30 2023-09-10T00:13:06.943 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-10T00:13:06.943 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-10T00:13:06.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-10T00:13:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/1945907656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c003980 msgr2=0x7f074c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 --2- 172.21.15.84:0/1945907656 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f074c003980 0x7f074c003da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0754001060 tx=0x7f075401cee0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 -- 172.21.15.84:0/1945907656 reap_dead start 2023-09-10T00:13:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/1945907656 shutdown_connections 2023-09-10T00:13:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/1945907656 >> 172.21.15.84:0/1945907656 conn(0x7f07640cca70 msgr2=0x7f07640cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/1945907656 shutdown_connections 2023-09-10T00:13:07.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/1945907656 wait complete. 2023-09-10T00:13:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 Processor -- start 2023-09-10T00:13:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- start start 2023-09-10T00:13:07.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f076414f050 0x7f07640c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07640c10f0 0x7f0764151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764151e60 con 0x7f07641519b0 2023-09-10T00:13:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c1590 con 0x7f07640c10f0 2023-09-10T00:13:07.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c1870 con 0x7f076414f050 2023-09-10T00:13:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43778/0 (socket says 172.21.15.84:43778) 2023-09-10T00:13:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 -- 172.21.15.84:0/3624025535 learned_addr learned my addr 172.21.15.84:0/3624025535 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:07.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f0769835640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f076414f050 0x7f07640c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f0769034640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07640c10f0 0x7f0764151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 -- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f076414f050 msgr2=0x7f07640c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f076414f050 0x7f07640c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 -- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07640c10f0 msgr2=0x7f0764151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07640c10f0 0x7f0764151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 -- 172.21.15.84:0/3624025535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640c1b50 con 0x7f07641519b0 2023-09-10T00:13:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076a036640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07640adf30 tx=0x7f075c010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c00ea20 con 0x7f07641519b0 2023-09-10T00:13:07.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f075c00ec90 con 0x7f07641519b0 2023-09-10T00:13:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0764156e40 con 0x7f07641519b0 2023-09-10T00:13:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c012450 con 0x7f07641519b0 2023-09-10T00:13:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.066+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076414f430 con 0x7f07641519b0 2023-09-10T00:13:07.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640712c0 con 0x7f07641519b0 2023-09-10T00:13:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f075c0125b0 con 0x7f07641519b0 2023-09-10T00:13:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f075a7fc640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 0x7f0750067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f075c016070 con 0x7f07641519b0 2023-09-10T00:13:07.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f0769835640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 0x7f0750067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.070+0000 7f0769835640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 0x7f0750067fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07540ab000 tx=0x7f0754019c80 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.074+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f075c051810 con 0x7f07641519b0 2023-09-10T00:13:07.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.250+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0764073400 con 0x7f07641519b0 2023-09-10T00:13:07.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f075a7fc640 1 -- 172.21.15.84:0/3624025535 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163501 (secure 0 0 0) 0x7f075c04fec0 con 0x7f07641519b0 2023-09-10T00:13:07.261 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 msgr2=0x7f0750067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 0x7f0750067fe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07540ab000 tx=0x7f0754019c80 comp rx=0 tx=0).stop 2023-09-10T00:13:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 msgr2=0x7f07641f7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07640adf30 tx=0x7f075c010b50 comp rx=0 tx=0).stop 2023-09-10T00:13:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 shutdown_connections 2023-09-10T00:13:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0750065b20 0x7f0750067fe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07641519b0 0x7f07641f7720 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07640c10f0 0x7f0764151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 --2- 172.21.15.84:0/3624025535 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f076414f050 0x7f07640c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 >> 172.21.15.84:0/3624025535 conn(0x7f07640cca70 msgr2=0x7f076415a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 shutdown_connections 2023-09-10T00:13:07.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.258+0000 7f076ba99640 1 -- 172.21.15.84:0/3624025535 wait complete. 2023-09-10T00:13:07.277 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"active_gid":4212,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":670516398},{"type":"v1","addr":"172.21.15.84:6833","nonce":670516398}]},"active_addr":"172.21.15.84:6833/670516398","active_change":"2023-09-10T00:12:21.794258+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4227,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2779343160}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1314188849}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1599305110}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2006077610}]}]} 2023-09-10T00:13:07.281 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-10T00:13:07.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-10T00:13:07.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/3706067106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a00039b0 msgr2=0x7f96a0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 --2- 172.21.15.84:0/3706067106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96a00039b0 0x7f96a0003dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f96a4006fb0 tx=0x7f96a401cfc0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b37fe640 1 -- 172.21.15.84:0/3706067106 reap_dead start 2023-09-10T00:13:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/3706067106 shutdown_connections 2023-09-10T00:13:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/3706067106 >> 172.21.15.84:0/3706067106 conn(0x7f96b40cca70 msgr2=0x7f96b40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/3706067106 shutdown_connections 2023-09-10T00:13:07.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/3706067106 wait complete. 2023-09-10T00:13:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 Processor -- start 2023-09-10T00:13:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- start start 2023-09-10T00:13:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 0x7f96b40c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.410 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96b414cdd0 0x7f96b4140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4140ea0 con 0x7f96b40c9650 2023-09-10T00:13:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40c3c80 con 0x7f96b40c9270 2023-09-10T00:13:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40c3eb0 con 0x7f96b414cdd0 2023-09-10T00:13:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.411 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43792/0 (socket says 172.21.15.84:43792) 2023-09-10T00:13:07.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 -- 172.21.15.84:0/1370696924 learned_addr learned my addr 172.21.15.84:0/1370696924 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:07.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b2ffd640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 0x7f96b40c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 -- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96b414cdd0 msgr2=0x7f96b4140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96b414cdd0 0x7f96b4140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 -- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 msgr2=0x7f96b40c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 0x7f96b40c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 -- 172.21.15.84:0/1370696924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40c4190 con 0x7f96b40c9650 2023-09-10T00:13:07.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b2ffd640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 0x7f96b40c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:07.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96abfff640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f969c006fd0 tx=0x7f969c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011870 con 0x7f96b40c9650 2023-09-10T00:13:07.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b40c4470 con 0x7f96b40c9650 2023-09-10T00:13:07.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40c4a30 con 0x7f96b40c9650 2023-09-10T00:13:07.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f969c0119d0 con 0x7f96b40c9650 2023-09-10T00:13:07.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.402+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011d60 con 0x7f96b40c9650 2023-09-10T00:13:07.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b40712c0 con 0x7f96b40c9650 2023-09-10T00:13:07.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f969c01a400 con 0x7f96b40c9650 2023-09-10T00:13:07.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b0ff9640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 0x7f9694068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f969c083ee0 con 0x7f96b40c9650 2023-09-10T00:13:07.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b2ffd640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 0x7f9694068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.406+0000 7f96b2ffd640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 0x7f9694068010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96a4006fb0 tx=0x7f96a4019d60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.410+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f969c051600 con 0x7f96b40c9650 2023-09-10T00:13:07.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.562+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96b4073400 con 0x7f96b40c9650 2023-09-10T00:13:07.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b0ff9640 1 -- 172.21.15.84:0/1370696924 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f969c054c20 con 0x7f96b40c9650 2023-09-10T00:13:07.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:07.569 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 msgr2=0x7f9694068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 0x7f9694068010 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96a4006fb0 tx=0x7f96a4019d60 comp rx=0 tx=0).stop 2023-09-10T00:13:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 msgr2=0x7f96b4140420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f969c006fd0 tx=0x7f969c001640 comp rx=0 tx=0).stop 2023-09-10T00:13:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 shutdown_connections 2023-09-10T00:13:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9694065b50 0x7f9694068010 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96b414cdd0 0x7f96b4140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96b40c9650 0x7f96b4140420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 --2- 172.21.15.84:0/1370696924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c9270 0x7f96b40c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.566+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 >> 172.21.15.84:0/1370696924 conn(0x7f96b40cca70 msgr2=0x7f96b415a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.570+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 shutdown_connections 2023-09-10T00:13:07.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.570+0000 7f96b987c640 1 -- 172.21.15.84:0/1370696924 wait complete. 2023-09-10T00:13:07.589 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-10T00:13:07.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/3368953975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 msgr2=0x7fccc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/3368953975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fccd40014e0 tx=0x7fccd401c590 comp rx=0 tx=0).stop 2023-09-10T00:13:07.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccde2bb640 1 -- 172.21.15.84:0/3368953975 reap_dead start 2023-09-10T00:13:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/3368953975 shutdown_connections 2023-09-10T00:13:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/3368953975 >> 172.21.15.84:0/3368953975 conn(0x7fccd80cca70 msgr2=0x7fccd80cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/3368953975 shutdown_connections 2023-09-10T00:13:07.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/3368953975 wait complete. 2023-09-10T00:13:07.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 Processor -- start 2023-09-10T00:13:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- start start 2023-09-10T00:13:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd814b500 0x7fccd8154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 0x7fccd80c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd814b980 con 0x7fccc40039b0 2023-09-10T00:13:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8154fa0 con 0x7fccd814b500 2023-09-10T00:13:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c51b0 con 0x7fccd80c47c0 2023-09-10T00:13:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43806/0 (socket says 172.21.15.84:43806) 2023-09-10T00:13:07.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 -- 172.21.15.84:0/1444932337 learned_addr learned my addr 172.21.15.84:0/1444932337 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccde2bb640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 0x7fccd80c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 -- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 msgr2=0x7fccd80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdd2b9640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd814b500 0x7fccd8154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 0x7fccd80c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 -- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd814b500 msgr2=0x7fccd8154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd814b500 0x7fccd8154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 -- 172.21.15.84:0/1444932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8155a50 con 0x7fccc40039b0 2023-09-10T00:13:07.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccde2bb640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 0x7fccd80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccddaba640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fccd40014e0 tx=0x7fccd4003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40068f0 con 0x7fccc40039b0 2023-09-10T00:13:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fccd4006050 con 0x7fccc40039b0 2023-09-10T00:13:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd81551b0 con 0x7fccc40039b0 2023-09-10T00:13:07.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd40b56c0 con 0x7fccc40039b0 2023-09-10T00:13:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.714+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd8155770 con 0x7fccc40039b0 2023-09-10T00:13:07.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80712c0 con 0x7fccc40039b0 2023-09-10T00:13:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fccd40b5820 con 0x7fccc40039b0 2023-09-10T00:13:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccce7fc640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 0x7fccbc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fccd411e140 con 0x7fccc40039b0 2023-09-10T00:13:07.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccdd2b9640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 0x7fccbc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.718+0000 7fccdd2b9640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 0x7fccbc067fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd814b120 tx=0x7fccc80091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:07.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.722+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fccd40eb830 con 0x7fccc40039b0 2023-09-10T00:13:07.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.878+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd80ae080 con 0x7fccc40039b0 2023-09-10T00:13:07.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.882+0000 7fccce7fc640 1 -- 172.21.15.84:0/1444932337 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fccd80ae080 con 0x7fccc40039b0 2023-09-10T00:13:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:07.886 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 msgr2=0x7fccbc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 0x7fccbc067fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fccd814b120 tx=0x7fccc80091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 msgr2=0x7fccd814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:07.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fccd40014e0 tx=0x7fccd4003c40 comp rx=0 tx=0).stop 2023-09-10T00:13:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 shutdown_connections 2023-09-10T00:13:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fccbc065b20 0x7fccbc067fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fccd80c47c0 0x7fccd80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd814b500 0x7fccd8154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 --2- 172.21.15.84:0/1444932337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fccc40039b0 0x7fccd814a720 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 >> 172.21.15.84:0/1444932337 conn(0x7fccd80cca70 msgr2=0x7fccd814ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 shutdown_connections 2023-09-10T00:13:07.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:07.886+0000 7fccdfd1e640 1 -- 172.21.15.84:0/1444932337 wait complete. 2023-09-10T00:13:07.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-10T00:13:07.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-10T00:13:07.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-10T00:13:07.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-10T00:13:07.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-10T00:13:07.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-10T00:13:07.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-10T00:13:07.909 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-10T00:13:08.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 -- 172.21.15.84:0/3740662627 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 msgr2=0x7f105c0cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 --2- 172.21.15.84:0/3740662627 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 0x7f105c0cbe50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1054009bc0 tx=0x7f105401cb70 comp rx=0 tx=0).stop 2023-09-10T00:13:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 -- 172.21.15.84:0/1426189373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40cf930 msgr2=0x7f54e40b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 --2- 172.21.15.84:0/1426189373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40cf930 0x7f54e40b3ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009bc0 tx=0x7f54dc01cb90 comp rx=0 tx=0).stop 2023-09-10T00:13:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 -- 172.21.15.84:0/1426189373 shutdown_connections 2023-09-10T00:13:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 --2- 172.21.15.84:0/1426189373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40cf930 0x7f54e40b3ce0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009bc0 tx=0x7f54dc01cb90 comp rx=0 tx=0).stop 2023-09-10T00:13:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 --2- 172.21.15.84:0/1426189373 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e415e2f0 0x7f54e415f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 -- 172.21.15.84:0/1426189373 >> 172.21.15.84:0/1426189373 conn(0x7f54e40cd350 msgr2=0x7f54e40cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 -- 172.21.15.84:0/3740662627 shutdown_connections 2023-09-10T00:13:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 --2- 172.21.15.84:0/3740662627 >> v2:172.21.15.100:3300/0 conn(0x7f105c0ca8b0 0x7f105c15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 --2- 172.21.15.84:0/3740662627 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 0x7f105c0cbe50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 -- 172.21.15.84:0/3740662627 >> 172.21.15.84:0/3740662627 conn(0x7f105c0cc4e0 msgr2=0x7f105c0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 -- 172.21.15.84:0/3405325228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c156e30 msgr2=0x7f014c0c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 -- 172.21.15.84:0/3740662627 shutdown_connections 2023-09-10T00:13:08.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f014959a640 1 -- 172.21.15.84:0/3405325228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5a10 con 0x7f014c156e30 2023-09-10T00:13:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 -- 172.21.15.84:0/1602735565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 msgr2=0x7f50ac0c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 --2- 172.21.15.84:0/1602735565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 0x7f50ac0c92c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f509c009900 tx=0x7f509c01c830 comp rx=0 tx=0).stop 2023-09-10T00:13:08.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 -- 172.21.15.84:0/1426189373 shutdown_connections 2023-09-10T00:13:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 --2- 172.21.15.84:0/3405325228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c156e30 0x7f014c0c77e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f014c06f5e0 tx=0x7f014001ca10 comp rx=0 tx=0).stop 2023-09-10T00:13:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 -- 172.21.15.84:0/1602735565 shutdown_connections 2023-09-10T00:13:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 --2- 172.21.15.84:0/1602735565 >> v2:172.21.15.100:3300/0 conn(0x7f50ac0c9800 0x7f50ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 --2- 172.21.15.84:0/1602735565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 0x7f50ac0c92c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 -- 172.21.15.84:0/1602735565 >> 172.21.15.84:0/1602735565 conn(0x7f50ac0ae410 msgr2=0x7f50ac0ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f54eab45640 1 -- 172.21.15.84:0/1426189373 wait complete. 2023-09-10T00:13:08.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 -- 172.21.15.84:0/1602735565 shutdown_connections 2023-09-10T00:13:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f1062c41640 1 -- 172.21.15.84:0/3740662627 wait complete. 2023-09-10T00:13:08.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f4574ade640 1 -- 172.21.15.84:0/1608931764 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457006d910 msgr2=0x7f45700c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f4574ade640 1 --2- 172.21.15.84:0/1608931764 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457006d910 0x7f45700c7b70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4564009870 tx=0x7f456401eff0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 -- 172.21.15.84:0/3405325228 shutdown_connections 2023-09-10T00:13:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 --2- 172.21.15.84:0/3405325228 >> v2:172.21.15.100:3300/0 conn(0x7f014c0c7070 0x7f014c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 --2- 172.21.15.84:0/3405325228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f014c0cbda0 0x7f014c0c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 --2- 172.21.15.84:0/3405325228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c156e30 0x7f014c0c77e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f0150ed4640 1 -- 172.21.15.84:0/3405325228 >> 172.21.15.84:0/3405325228 conn(0x7f014c0ae410 msgr2=0x7f014c0ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.090+0000 7f50b35f8640 1 -- 172.21.15.84:0/1602735565 wait complete. 2023-09-10T00:13:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 -- 172.21.15.84:0/1608931764 shutdown_connections 2023-09-10T00:13:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 --2- 172.21.15.84:0/1608931764 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457006d910 0x7f45700c7b70 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4564009870 tx=0x7f456401eff0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 -- 172.21.15.84:0/1608931764 >> 172.21.15.84:0/1608931764 conn(0x7f45700ae410 msgr2=0x7f45700ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f0150ed4640 1 -- 172.21.15.84:0/3405325228 shutdown_connections 2023-09-10T00:13:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 Processor -- start 2023-09-10T00:13:08.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 -- 172.21.15.84:0/1608931764 shutdown_connections 2023-09-10T00:13:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 -- 172.21.15.84:0/1608931764 wait complete. 2023-09-10T00:13:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 Processor -- start 2023-09-10T00:13:08.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 -- 172.21.15.84:0/3940047489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22b00069e0 msgr2=0x7f22b0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 --2- 172.21.15.84:0/3940047489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22b00069e0 0x7f22b0006e60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009b60 tx=0x7f22c001d2b0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- start start 2023-09-10T00:13:08.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 0x7f105c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 0x7f105c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105c0ca8b0 0x7f105c0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c156160 con 0x7f105c0c7380 2023-09-10T00:13:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0afbc0 con 0x7f105c0ca8b0 2023-09-10T00:13:08.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0afe10 con 0x7f105c0c6fa0 2023-09-10T00:13:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- start start 2023-09-10T00:13:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 0x7f50ac152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 0x7f50ac1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ac157660 0x7f50ac1fad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac1fa900 con 0x7f50ac0c9800 2023-09-10T00:13:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac153010 con 0x7f50ac157660 2023-09-10T00:13:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50ac1f9cf0 con 0x7f50ac0cbc80 2023-09-10T00:13:08.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cab5c640 1 -- 172.21.15.84:0/3940047489 reap_dead start 2023-09-10T00:13:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f0150ed4640 1 -- 172.21.15.84:0/3405325228 wait complete. 2023-09-10T00:13:08.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 -- 172.21.15.84:0/3940047489 shutdown_connections 2023-09-10T00:13:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 -- 172.21.15.84:0/3940047489 >> 172.21.15.84:0/3940047489 conn(0x7f22bc009f90 msgr2=0x7f22bc00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 -- 172.21.15.84:0/3940047489 shutdown_connections 2023-09-10T00:13:08.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 0x7f105c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 0x7f105c155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43838/0 (socket says 172.21.15.84:43838) 2023-09-10T00:13:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 -- 172.21.15.84:0/971546988 learned_addr learned my addr 172.21.15.84:0/971546988 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f10611de640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105c0ca8b0 0x7f105c0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f10609dd640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 0x7f105c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 Processor -- start 2023-09-10T00:13:08.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f54eab45640 1 Processor -- start 2023-09-10T00:13:08.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 -- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 msgr2=0x7f105c15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f105c0c6fa0 0x7f105c15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 -- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105c0ca8b0 msgr2=0x7f105c0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105c0ca8b0 0x7f105c0abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009820 con 0x7f105c0c7380 2023-09-10T00:13:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 0x7f50ac152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 0x7f50ac152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43836/0 (socket says 172.21.15.84:43836) 2023-09-10T00:13:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 -- 172.21.15.84:0/1494705250 learned_addr learned my addr 172.21.15.84:0/1494705250 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1b95640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ac157660 0x7f50ac1fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b0b93640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 0x7f50ac1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 -- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 msgr2=0x7f50ac1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50ac0cbc80 0x7f50ac1f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 -- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ac157660 msgr2=0x7f50ac1fad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50ac157660 0x7f50ac1fad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c009560 con 0x7f50ac0c9800 2023-09-10T00:13:08.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f105bfff640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 0x7f105c155c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7d0 tx=0x7f105000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b1394640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 0x7f50ac152ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c3c0 tx=0x7f50a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 -- 172.21.15.84:0/3940047489 wait complete. 2023-09-10T00:13:08.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80052d0 con 0x7f50ac0c9800 2023-09-10T00:13:08.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50a8003600 con 0x7f50ac0c9800 2023-09-10T00:13:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8003a10 con 0x7f50ac0c9800 2023-09-10T00:13:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ac1f9fd0 con 0x7f50ac0c9800 2023-09-10T00:13:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f50b35f8640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ac1fa590 con 0x7f50ac0c9800 2023-09-10T00:13:08.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050009590 con 0x7f105c0c7380 2023-09-10T00:13:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f0150ed4640 1 Processor -- start 2023-09-10T00:13:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0b00f0 con 0x7f105c0c7380 2023-09-10T00:13:08.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c0b06b0 con 0x7f105c0c7380 2023-09-10T00:13:08.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f22cc5bf640 1 Processor -- start 2023-09-10T00:13:08.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.094+0000 7f4574ade640 1 -- start start 2023-09-10T00:13:08.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 -- start start 2023-09-10T00:13:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45700c6cf0 0x7f45700c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45700c92c0 0x7f4570150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45700ab720 0x7f45700acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c2e30 con 0x7f45700ab720 2023-09-10T00:13:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c2590 con 0x7f45700c92c0 2023-09-10T00:13:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c2870 con 0x7f45700c6cf0 2023-09-10T00:13:08.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456e59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45700c6cf0 0x7f45700c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456e59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45700c6cf0 0x7f45700c1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56590/0 (socket says 172.21.15.84:56590) 2023-09-10T00:13:08.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456e59c640 1 -- 172.21.15.84:0/3420862711 learned_addr learned my addr 172.21.15.84:0/3420862711 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45700c92c0 0x7f4570150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456ed9d640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45700ab720 0x7f45700acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f105000cdb0 con 0x7f105c0c7380 2023-09-10T00:13:08.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f105c0695b0 con 0x7f105c0c7380 2023-09-10T00:13:08.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000eee0 con 0x7f105c0c7380 2023-09-10T00:13:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- start start 2023-09-10T00:13:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22b00069e0 0x7f22bc19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22bc04e660 0x7f22bc0ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22bc0fabd0 0x7f22bc0fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0fb590 con 0x7f22bc04e660 2023-09-10T00:13:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1a0a20 con 0x7f22bc0fabd0 2023-09-10T00:13:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1a0180 con 0x7f22b00069e0 2023-09-10T00:13:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 -- 172.21.15.84:0/3899535810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80e3550 msgr2=0x7f71f8053b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 --2- 172.21.15.84:0/3899535810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80e3550 0x7f71f8053b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f720004eeb0 tx=0x7f7200094410 comp rx=0 tx=0).stop 2023-09-10T00:13:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f50a8003b70 con 0x7f50ac0c9800 2023-09-10T00:13:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50b35f8640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50ac073390 con 0x7f50ac0c9800 2023-09-10T00:13:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5090065c20 0x7f50900680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50a8082d40 con 0x7f50ac0c9800 2023-09-10T00:13:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c0c7070 0x7f014c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 0x7f014c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f014c156e30 0x7f014c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c66e0 con 0x7f014c0c7070 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c6120 con 0x7f014c0cbda0 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0150ed4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0c6400 con 0x7f014c156e30 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 0x7f014c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 0x7f014c0b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:56038/0 (socket says 172.21.15.84:56038) 2023-09-10T00:13:08.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 -- 172.21.15.84:0/3849531367 learned_addr learned my addr 172.21.15.84:0/3849531367 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f014ad9d640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f014c156e30 0x7f014c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50b0b93640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5090065c20 0x7f50900680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 -- start start 2023-09-10T00:13:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40b4220 0x7f54e4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54e415e2f0 0x7f54e40b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7f509006f1e0 0x7f5090071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5090071cf0 con 0x7f509006f1e0 2023-09-10T00:13:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 0x7f54e4152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40b1b10 con 0x7f54e40b4220 2023-09-10T00:13:08.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4153b50 con 0x7f54e415e2f0 2023-09-10T00:13:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54eab45640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4152f40 con 0x7f54e40b1660 2023-09-10T00:13:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 0x7f54e4152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 -- 172.21.15.84:0/3899535810 shutdown_connections 2023-09-10T00:13:08.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 --2- 172.21.15.84:0/3899535810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80e3550 0x7f71f8053b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 --2- 172.21.15.84:0/3899535810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71f80074c0 0x7f71f80e3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 -- 172.21.15.84:0/3899535810 >> 172.21.15.84:0/3899535810 conn(0x7f71f80553a0 msgr2=0x7f71f80557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 -- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45700c6cf0 msgr2=0x7f45700c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45700c6cf0 0x7f45700c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 -- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45700ab720 msgr2=0x7f45700acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45700ab720 0x7f45700acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45640094a0 con 0x7f45700c92c0 2023-09-10T00:13:08.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 -- 172.21.15.84:0/3899535810 shutdown_connections 2023-09-10T00:13:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 -- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f014c156e30 msgr2=0x7f014c1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f014c156e30 0x7f014c1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 -- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c0c7070 msgr2=0x7f014c0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f014c0c7070 0x7f014c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 0x7f54e4152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56624/0 (socket says 172.21.15.84:56624) 2023-09-10T00:13:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 -- 172.21.15.84:0/3022712451 learned_addr learned my addr 172.21.15.84:0/3022712451 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f456dd9b640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45700c92c0 0x7f4570150330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45700c7110 tx=0x7f456000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e3fff640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54e415e2f0 0x7f54e40b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50a8000fa0 con 0x7f50ac0c9800 2023-09-10T00:13:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50b0b93640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5090065c20 0x7f50900680e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f509c0af000 tx=0x7f509c01b070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f50b1b95640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7f509006f1e0 0x7f5090071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 -- 172.21.15.84:0/3676360204 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 msgr2=0x7f250806e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 --2- 172.21.15.84:0/3676360204 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250806e070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2504009840 tx=0x7f250401c820 comp rx=0 tx=0).stop 2023-09-10T00:13:08.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e88e1640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40b4220 0x7f54e4153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 -- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54e415e2f0 msgr2=0x7f54e40b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54e415e2f0 0x7f54e40b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 -- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40b4220 msgr2=0x7f54e4153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40b4220 0x7f54e4153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009820 con 0x7f54e40b1660 2023-09-10T00:13:08.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e88e1640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f54e40b4220 0x7f54e4153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:08.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e3fff640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54e415e2f0 0x7f54e40b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:08.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560011790 con 0x7f45700c92c0 2023-09-10T00:13:08.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22ca35b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22b00069e0 0x7f22bc19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22ca35b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22b00069e0 0x7f22bc19fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56606/0 (socket says 172.21.15.84:56606) 2023-09-10T00:13:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22ca35b640 1 -- 172.21.15.84:0/2935943764 learned_addr learned my addr 172.21.15.84:0/2935943764 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22bc04e660 0x7f22bc0ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cab5c640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22bc0fabd0 0x7f22bc0fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 -- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22b00069e0 msgr2=0x7f22bc19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22b00069e0 0x7f22bc19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 -- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22bc0fabd0 msgr2=0x7f22bc0fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22bc0fabd0 0x7f22bc0fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc1a0460 con 0x7f22bc04e660 2023-09-10T00:13:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f54e90e2640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 0x7f54e4152250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54d400c430 tx=0x7f54d400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 -- 172.21.15.84:0/3676360204 shutdown_connections 2023-09-10T00:13:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 --2- 172.21.15.84:0/3676360204 >> v2:172.21.15.100:3300/0 conn(0x7f25080abe30 0x7f250806d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 --2- 172.21.15.84:0/3676360204 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250806e070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f2510165640 1 -- 172.21.15.84:0/3676360204 >> 172.21.15.84:0/3676360204 conn(0x7f25080ccb50 msgr2=0x7f25080ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22c9b5a640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22bc04e660 0x7f22bc0ffc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22b000e110 tx=0x7f22c0005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.148 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45700c2b50 con 0x7f45700c92c0 2023-09-10T00:13:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4570150870 con 0x7f45700c92c0 2023-09-10T00:13:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00bb070 con 0x7f22bc04e660 2023-09-10T00:13:08.149 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc1a0740 con 0x7f22bc04e660 2023-09-10T00:13:08.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc04eae0 con 0x7f22bc04e660 2023-09-10T00:13:08.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014000a670 con 0x7f014c0cbda0 2023-09-10T00:13:08.150 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f0149d9b640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 0x7f014c0b1370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f013c00a900 tx=0x7f013c00adc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45600119e0 con 0x7f45700c92c0 2023-09-10T00:13:08.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.098+0000 7f72060e2640 1 -- 172.21.15.84:0/3899535810 wait complete. 2023-09-10T00:13:08.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 Processor -- start 2023-09-10T00:13:08.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560011e10 con 0x7f45700c92c0 2023-09-10T00:13:08.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4554000fd0 con 0x7f45700c92c0 2023-09-10T00:13:08.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22bc0052e0 con 0x7f22bc04e660 2023-09-10T00:13:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 -- start start 2023-09-10T00:13:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 0x7f71f80ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71f80df460 0x7f71f8038fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71f80d6cd0 0x7f71f80cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f803a560 con 0x7f71f80074c0 2023-09-10T00:13:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80398e0 con 0x7f71f80df460 2023-09-10T00:13:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f72060e2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8039bc0 con 0x7f71f80d6cd0 2023-09-10T00:13:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 0x7f71f80ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 0x7f71f80ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43892/0 (socket says 172.21.15.84:43892) 2023-09-10T00:13:08.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 -- 172.21.15.84:0/3944675387 learned_addr learned my addr 172.21.15.84:0/3944675387 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f2510165640 1 -- 172.21.15.84:0/3676360204 shutdown_connections 2023-09-10T00:13:08.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1050010690 con 0x7f105c0c7380 2023-09-10T00:13:08.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f22c0004410 con 0x7f22bc04e660 2023-09-10T00:13:08.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f2510165640 1 -- 172.21.15.84:0/3676360204 wait complete. 2023-09-10T00:13:08.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0004930 con 0x7f22bc04e660 2023-09-10T00:13:08.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71feffd640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71f80df460 0x7f71f8038fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c010070 con 0x7f014c0cbda0 2023-09-10T00:13:08.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71fffff640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71f80d6cd0 0x7f71f80cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f50b1b95640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7f509006f1e0 0x7f5090071620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 -- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71f80d6cd0 msgr2=0x7f71f80cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f71f80d6cd0 0x7f71f80cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 -- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71f80df460 msgr2=0x7f71f8038fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71f80df460 0x7f71f8038fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720004de30 con 0x7f71f80074c0 2023-09-10T00:13:08.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71feffd640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71f80df460 0x7f71f8038fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:08.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f013c007a70 con 0x7f014c0cbda0 2023-09-10T00:13:08.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f0150ed4640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c1590c0 con 0x7f014c0cbda0 2023-09-10T00:13:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f0150ed4640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0b2180 con 0x7f014c0cbda0 2023-09-10T00:13:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c007e60 con 0x7f014c0cbda0 2023-09-10T00:13:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1048065b70 0x7f1048068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1050014070 con 0x7f105c0c7380 2023-09-10T00:13:08.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7f104806f1b0 0x7f10480715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1048071cc0 con 0x7f104806f1b0 2023-09-10T00:13:08.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1050084c80 con 0x7f105c0c7380 2023-09-10T00:13:08.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10611de640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7f104806f1b0 0x7f10480715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4011790 con 0x7f54e40b1660 2023-09-10T00:13:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f54d40119e0 con 0x7f54e40b1660 2023-09-10T00:13:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4011df0 con 0x7f54e40b1660 2023-09-10T00:13:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e4153220 con 0x7f54e40b1660 2023-09-10T00:13:08.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10611de640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7f104806f1b0 0x7f10480715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ff7fe640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 0x7f71f80ce230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b410 tx=0x7f71ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10609dd640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1048065b70 0x7f1048068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f2510165640 1 Processor -- start 2023-09-10T00:13:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e41537e0 con 0x7f54e40b1660 2023-09-10T00:13:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f54e4073390 con 0x7f54e40b1660 2023-09-10T00:13:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f0150ed4640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0130000fd0 con 0x7f014c0cbda0 2023-09-10T00:13:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f456001c460 con 0x7f45700c92c0 2023-09-10T00:13:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== osd.7 v2:172.21.15.100:6808/2524383320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5090071cf0 con 0x7f509006f1e0 2023-09-10T00:13:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== osd.1 v2:172.21.15.84:6800/680462698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1048071cc0 con 0x7f104806f1b0 2023-09-10T00:13:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f10609dd640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1048065b70 0x7f1048068030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10540af000 tx=0x7f105401b3b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f22c0004ad0 con 0x7f22bc04e660 2023-09-10T00:13:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec004020 con 0x7f71f80074c0 2023-09-10T00:13:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f71ec004270 con 0x7f71f80074c0 2023-09-10T00:13:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec011890 con 0x7f71f80074c0 2023-09-10T00:13:08.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.102+0000 7f2510165640 1 -- start start 2023-09-10T00:13:08.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f455effd640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4550065c20 0x7f45500680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f456e59c640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4550065c20 0x7f45500680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f013c014410 con 0x7f014c0cbda0 2023-09-10T00:13:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f72060e2640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f8039ea0 con 0x7f71f80074c0 2023-09-10T00:13:08.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f72060e2640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80ce770 con 0x7f71f80074c0 2023-09-10T00:13:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f72060e2640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71f80057a0 con 0x7f71f80074c0 2023-09-10T00:13:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f012c065b70 0x7f012c068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f013c0830c0 con 0x7f014c0cbda0 2023-09-10T00:13:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22baffd640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f22a8065bf0 0x7f22a80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f012c06f1b0 0x7f012c0715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f012c071cc0 con 0x7f012c06f1b0 2023-09-10T00:13:08.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f013c0856a0 con 0x7f014c0cbda0 2023-09-10T00:13:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4560083f10 con 0x7f45700c92c0 2023-09-10T00:13:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f455effd640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7f455006f0f0 0x7f4550071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4550071c00 con 0x7f455006f0f0 2023-09-10T00:13:08.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45600842c0 con 0x7f45700c92c0 2023-09-10T00:13:08.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54d401c460 con 0x7f54e40b1660 2023-09-10T00:13:08.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f54d0065bf0 0x7f54d00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f54d4084100 con 0x7f54e40b1660 2023-09-10T00:13:08.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e88e1640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f54d0065bf0 0x7f54d00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f54d006f230 0x7f54d0071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54d0071d40 con 0x7f54d006f230 2023-09-10T00:13:08.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54d40844b0 con 0x7f54e40b1660 2023-09-10T00:13:08.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25080abe30 0x7f2508151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25080cb9a0 0x7f25081552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2508154ad0 con 0x7f25080abe30 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250814c0d0 con 0x7f25080cb9a0 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2508154510 con 0x7f25081587e0 2023-09-10T00:13:08.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250d700640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25080cb9a0 0x7f25081552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250815a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56642/0 (socket says 172.21.15.84:56642) 2023-09-10T00:13:08.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 -- 172.21.15.84:0/914821160 learned_addr learned my addr 172.21.15.84:0/914821160 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250df01640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25080abe30 0x7f2508151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 -- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25080cb9a0 msgr2=0x7f25081552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25080cb9a0 0x7f25081552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 -- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25080abe30 msgr2=0x7f2508151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25080abe30 0x7f2508151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040094a0 con 0x7f25081587e0 2023-09-10T00:13:08.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250d700640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25080cb9a0 0x7f25081552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:13:08.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f250e702640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250815a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2500002240 tx=0x7f250000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22c011df50 con 0x7f22bc04e660 2023-09-10T00:13:08.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22baffd640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f22a806f230 0x7f22a8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22a8071d40 con 0x7f22a806f230 2023-09-10T00:13:08.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22c0120570 con 0x7f22bc04e660 2023-09-10T00:13:08.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f22cab5c640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f22a806f230 0x7f22a8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f456e59c640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4550065c20 0x7f45500680e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f456401bc00 tx=0x7f456401d830 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e3fff640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f54d006f230 0x7f54d0071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f54e88e1640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f54d0065bf0 0x7f54d00680b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009ac0 tx=0x7f54d80091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f014a59c640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f012c065b70 0x7f012c068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f014ad9d640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f012c06f1b0 0x7f012c0715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f54e3fff640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f54d006f230 0x7f54d0071670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f22ca35b640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f22a8065bf0 0x7f22a80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f014a59c640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f012c065b70 0x7f012c068030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01400af000 tx=0x7f01400197b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f014ad9d640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f012c06f1b0 0x7f012c0715f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== osd.3 v2:172.21.15.84:6808/2125649625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f54d0071d40 con 0x7f54d006f230 2023-09-10T00:13:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500003d90 con 0x7f25081587e0 2023-09-10T00:13:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f250000ce50 con 0x7f25081587e0 2023-09-10T00:13:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000052b0 con 0x7f25081587e0 2023-09-10T00:13:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25081547f0 con 0x7f25081587e0 2023-09-10T00:13:08.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.106+0000 7f2510165640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250815a2a0 con 0x7f25081587e0 2023-09-10T00:13:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f2510165640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24f0000fd0 con 0x7f25081587e0 2023-09-10T00:13:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f22cab5c640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f22a806f230 0x7f22a8071670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f71ec0119f0 con 0x7f71f80074c0 2023-09-10T00:13:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f71e4065b50 0x7f71e4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71ec084070 con 0x7f71f80074c0 2023-09-10T00:13:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f71e406f190 0x7f71e40715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71feffd640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f71e4065b50 0x7f71e4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71e4071ca0 con 0x7f71e406f190 2023-09-10T00:13:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ec084420 con 0x7f71f80074c0 2023-09-10T00:13:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2500005410 con 0x7f25081587e0 2023-09-10T00:13:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24ec065b20 0x7f24ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f22ca35b640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f22a8065bf0 0x7f22a80680b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22b40017d0 tx=0x7f22b4006710 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2500083710 con 0x7f25081587e0 2023-09-10T00:13:08.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f24ec06f0e0 0x7f24ec071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24ec071bf0 con 0x7f24ec06f0e0 2023-09-10T00:13:08.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2500083b60 con 0x7f25081587e0 2023-09-10T00:13:08.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f250df01640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24ec065b20 0x7f24ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71fffff640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f71e406f190 0x7f71e40715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f250d700640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f24ec06f0e0 0x7f24ec071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f250df01640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24ec065b20 0x7f24ec067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f25040af000 tx=0x7f250401b060 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== osd.0 v2:172.21.15.84:6816/3601459291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f012c071cc0 con 0x7f012c06f1b0 2023-09-10T00:13:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f250d700640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f24ec06f0e0 0x7f24ec071520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71fffff640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f71e406f190 0x7f71e40715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f71feffd640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f71e4065b50 0x7f71e4068010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71f80f29a0 tx=0x7f71f400a370 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.110+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== osd.5 v2:172.21.15.100:6810/3847761032 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f22a8071d40 con 0x7f22a806f230 2023-09-10T00:13:08.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.114+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== osd.4 v2:172.21.15.100:6800/2271215042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f24ec071bf0 con 0x7f24ec06f0e0 2023-09-10T00:13:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.114+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== osd.6 v2:172.21.15.100:6824/133961389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f71e4071ca0 con 0x7f71e406f190 2023-09-10T00:13:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.118+0000 7f456ed9d640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7f455006f0f0 0x7f4550071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.118+0000 7f456ed9d640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7f455006f0f0 0x7f4550071530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.118+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== osd.2 v2:172.21.15.84:6817/1006742702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4550071c00 con 0x7f455006f0f0 2023-09-10T00:13:08.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f0150ed4640 1 -- 172.21.15.84:0/3849531367 --> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0130002cc0 con 0x7f012c06f1b0 2023-09-10T00:13:08.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f013affd640 1 -- 172.21.15.84:0/3849531367 <== osd.0 v2:172.21.15.84:6816/3601459291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0130002cc0 con 0x7f012c06f1b0 2023-09-10T00:13:08.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f012c06f1b0 msgr2=0x7f012c0715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f0138ff9640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f012c06f1b0 0x7f012c0715f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 --> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f105c0b08d0 con 0x7f104806f1b0 2023-09-10T00:13:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.130+0000 7f10597fa640 1 -- 172.21.15.84:0/971546988 <== osd.1 v2:172.21.15.84:6800/680462698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f105c0b08d0 con 0x7f104806f1b0 2023-09-10T00:13:08.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f50b35f8640 1 -- 172.21.15.84:0/1494705250 --> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50ac1faa40 con 0x7f509006f1e0 2023-09-10T00:13:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f012c065b70 msgr2=0x7f012c068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f012c065b70 0x7f012c068030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f01400af000 tx=0x7f01400197b0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 msgr2=0x7f014c0b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 --2- 172.21.15.84:0/3849531367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014c0cbda0 0x7f014c0b1370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f013c00a900 tx=0x7f013c00adc0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f014ad9d640 1 -- 172.21.15.84:0/3849531367 reap_dead start 2023-09-10T00:13:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 shutdown_connections 2023-09-10T00:13:08.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 >> 172.21.15.84:0/3849531367 conn(0x7f014c0ae410 msgr2=0x7f014c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7f104806f1b0 msgr2=0x7f10480715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7f104806f1b0 0x7f10480715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 shutdown_connections 2023-09-10T00:13:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f0138ff9640 1 -- 172.21.15.84:0/3849531367 wait complete. 2023-09-10T00:13:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1048065b70 msgr2=0x7f1048068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1048065b70 0x7f1048068030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10540af000 tx=0x7f105401b3b0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 msgr2=0x7f105c155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 --2- 172.21.15.84:0/971546988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f105c0c7380 0x7f105c155c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f105000e7d0 tx=0x7f105000ec90 comp rx=0 tx=0).stop 2023-09-10T00:13:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f10611de640 1 -- 172.21.15.84:0/971546988 reap_dead start 2023-09-10T00:13:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 shutdown_connections 2023-09-10T00:13:08.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 >> 172.21.15.84:0/971546988 conn(0x7f105c0cc4e0 msgr2=0x7f105c15bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 shutdown_connections 2023-09-10T00:13:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f1062c41640 1 -- 172.21.15.84:0/971546988 wait complete. 2023-09-10T00:13:08.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f50a1ffb640 1 -- 172.21.15.84:0/1494705250 <== osd.7 v2:172.21.15.100:6808/2524383320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50a4004b30 con 0x7f509006f1e0 2023-09-10T00:13:08.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7f509006f1e0 msgr2=0x7f5090071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7f509006f1e0 0x7f5090071620 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5090065c20 msgr2=0x7f50900680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5090065c20 0x7f50900680e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f509c0af000 tx=0x7f509c01b070 comp rx=0 tx=0).stop 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 msgr2=0x7f50ac152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 --2- 172.21.15.84:0/1494705250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50ac0c9800 0x7f50ac152ad0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50a800c3c0 tx=0x7f50a800c880 comp rx=0 tx=0).stop 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f50b1b95640 1 -- 172.21.15.84:0/1494705250 reap_dead start 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 shutdown_connections 2023-09-10T00:13:08.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 >> 172.21.15.84:0/1494705250 conn(0x7f50ac0ae410 msgr2=0x7f50ac0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 shutdown_connections 2023-09-10T00:13:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.134+0000 7f508f7fe640 1 -- 172.21.15.84:0/1494705250 wait complete. 2023-09-10T00:13:08.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 --> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22bc04bee0 con 0x7f22a806f230 2023-09-10T00:13:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 --> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54e4153cc0 con 0x7f54d006f230 2023-09-10T00:13:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f22baffd640 1 -- 172.21.15.84:0/2935943764 <== osd.5 v2:172.21.15.100:6810/3847761032 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22bc04bee0 con 0x7f22a806f230 2023-09-10T00:13:08.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54e17fa640 1 -- 172.21.15.84:0/3022712451 <== osd.3 v2:172.21.15.84:6808/2125649625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f54e4153cc0 con 0x7f54d006f230 2023-09-10T00:13:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f54d006f230 msgr2=0x7f54d0071670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f54d006f230 0x7f54d0071670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f54d0065bf0 msgr2=0x7f54d00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f54d0065bf0 0x7f54d00680b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54d8009ac0 tx=0x7f54d80091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 msgr2=0x7f54e4152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 --2- 172.21.15.84:0/3022712451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54e40b1660 0x7f54e4152250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54d400c430 tx=0x7f54d400c8f0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54e90e2640 1 -- 172.21.15.84:0/3022712451 reap_dead start 2023-09-10T00:13:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 shutdown_connections 2023-09-10T00:13:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 >> 172.21.15.84:0/3022712451 conn(0x7f54e40cd350 msgr2=0x7f54e40cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 shutdown_connections 2023-09-10T00:13:08.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.138+0000 7f54eab45640 1 -- 172.21.15.84:0/3022712451 wait complete. 2023-09-10T00:13:08.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f22a806f230 msgr2=0x7f22a8071670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f22a806f230 0x7f22a8071670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f22a8065bf0 msgr2=0x7f22a80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f22a8065bf0 0x7f22a80680b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f22b40017d0 tx=0x7f22b4006710 comp rx=0 tx=0).stop 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22bc04e660 msgr2=0x7f22bc0ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 --2- 172.21.15.84:0/2935943764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22bc04e660 0x7f22bc0ffc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22b000e110 tx=0x7f22c0005900 comp rx=0 tx=0).stop 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cab5c640 1 -- 172.21.15.84:0/2935943764 reap_dead start 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 shutdown_connections 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 >> 172.21.15.84:0/2935943764 conn(0x7f22bc009f90 msgr2=0x7f22bc104860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 shutdown_connections 2023-09-10T00:13:08.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f22cc5bf640 1 -- 172.21.15.84:0/2935943764 wait complete. 2023-09-10T00:13:08.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f2510165640 1 -- 172.21.15.84:0/914821160 --> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f24f0002cc0 con 0x7f24ec06f0e0 2023-09-10T00:13:08.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f72060e2640 1 -- 172.21.15.84:0/3944675387 --> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71f8053040 con 0x7f71e406f190 2023-09-10T00:13:08.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.142+0000 7f24fe7fc640 1 -- 172.21.15.84:0/914821160 <== osd.4 v2:172.21.15.100:6800/2271215042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f24f0002cc0 con 0x7f24ec06f0e0 2023-09-10T00:13:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71ebfff640 1 -- 172.21.15.84:0/3944675387 <== osd.6 v2:172.21.15.100:6824/133961389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71f8053040 con 0x7f71e406f190 2023-09-10T00:13:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f71e406f190 msgr2=0x7f71e40715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f71e406f190 0x7f71e40715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f71e4065b50 msgr2=0x7f71e4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f71e4065b50 0x7f71e4068010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71f80f29a0 tx=0x7f71f400a370 comp rx=0 tx=0).stop 2023-09-10T00:13:08.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 msgr2=0x7f71f80ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 --2- 172.21.15.84:0/3944675387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71f80074c0 0x7f71f80ce230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b410 tx=0x7f71ec00b8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71fffff640 1 -- 172.21.15.84:0/3944675387 reap_dead start 2023-09-10T00:13:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 shutdown_connections 2023-09-10T00:13:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 >> 172.21.15.84:0/3944675387 conn(0x7f71f80553a0 msgr2=0x7f71f80e2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 shutdown_connections 2023-09-10T00:13:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f71e9ffb640 1 -- 172.21.15.84:0/3944675387 wait complete. 2023-09-10T00:13:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 --> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4554002cb0 con 0x7f455006f0f0 2023-09-10T00:13:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f455effd640 1 -- 172.21.15.84:0/3420862711 <== osd.2 v2:172.21.15.84:6817/1006742702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4554002cb0 con 0x7f455006f0f0 2023-09-10T00:13:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7f455006f0f0 msgr2=0x7f4550071530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7f455006f0f0 0x7f4550071530 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4550065c20 msgr2=0x7f45500680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4550065c20 0x7f45500680e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f456401bc00 tx=0x7f456401d830 comp rx=0 tx=0).stop 2023-09-10T00:13:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45700c92c0 msgr2=0x7f4570150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f4574ade640 1 --2- 172.21.15.84:0/3420862711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45700c92c0 0x7f4570150330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45700c7110 tx=0x7f456000c890 comp rx=0 tx=0).stop 2023-09-10T00:13:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.146+0000 7f456ed9d640 1 -- 172.21.15.84:0/3420862711 reap_dead start 2023-09-10T00:13:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.150+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 shutdown_connections 2023-09-10T00:13:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.150+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 >> 172.21.15.84:0/3420862711 conn(0x7f45700ae410 msgr2=0x7f4570159090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.150+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 shutdown_connections 2023-09-10T00:13:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.150+0000 7f4574ade640 1 -- 172.21.15.84:0/3420862711 wait complete. 2023-09-10T00:13:08.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f24ec06f0e0 msgr2=0x7f24ec071520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f24ec06f0e0 0x7f24ec071520 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24ec065b20 msgr2=0x7f24ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24ec065b20 0x7f24ec067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f25040af000 tx=0x7f250401b060 comp rx=0 tx=0).stop 2023-09-10T00:13:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 msgr2=0x7f250815a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 --2- 172.21.15.84:0/914821160 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25081587e0 0x7f250815a7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2500002240 tx=0x7f250000cc00 comp rx=0 tx=0).stop 2023-09-10T00:13:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f250e702640 1 -- 172.21.15.84:0/914821160 reap_dead start 2023-09-10T00:13:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 shutdown_connections 2023-09-10T00:13:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 >> 172.21.15.84:0/914821160 conn(0x7f25080ccb50 msgr2=0x7f25080ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 shutdown_connections 2023-09-10T00:13:08.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.158+0000 7f24ebfff640 1 -- 172.21.15.84:0/914821160 wait complete. 2023-09-10T00:13:08.225 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:08.225 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:08.226 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-10T00:13:08.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-10T00:13:08.228 INFO:teuthology.orchestra.run.smithi084.stdout:64424509451 2023-09-10T00:13:08.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-10T00:13:08.229 INFO:teuthology.orchestra.run.smithi084.stdout:64424509451 2023-09-10T00:13:08.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-10T00:13:08.230 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-09-10T00:13:08.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-10T00:13:08.231 INFO:teuthology.orchestra.run.smithi084.stdout:64424509451 2023-09-10T00:13:08.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-10T00:13:08.233 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:08.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-10T00:13:08.234 INFO:teuthology.orchestra.run.smithi084.stdout:64424509449 2023-09-10T00:13:08.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-10T00:13:08.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 -- 172.21.15.84:0/296827413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 msgr2=0x7ff38c0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 --2- 172.21.15.84:0/296827413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c7b70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0c8e50 tx=0x7ff37401c890 comp rx=0 tx=0).stop 2023-09-10T00:13:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 -- 172.21.15.84:0/296827413 shutdown_connections 2023-09-10T00:13:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 --2- 172.21.15.84:0/296827413 >> v2:172.21.15.100:3300/0 conn(0x7ff38c0c9800 0x7ff38c0695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 --2- 172.21.15.84:0/296827413 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff38c0c6cf0 0x7ff38c0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 --2- 172.21.15.84:0/296827413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c7b70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 -- 172.21.15.84:0/296827413 >> 172.21.15.84:0/296827413 conn(0x7ff38c0ae410 msgr2=0x7ff38c0ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 -- 172.21.15.84:0/296827413 shutdown_connections 2023-09-10T00:13:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.450+0000 7ff392336640 1 -- 172.21.15.84:0/296827413 wait complete. 2023-09-10T00:13:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- 172.21.15.84:0/165948635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 msgr2=0x7f17e40c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 --2- 172.21.15.84:0/165948635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e40c7b70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17d400afd0 tx=0x7f17d401d460 comp rx=0 tx=0).stop 2023-09-10T00:13:08.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 Processor -- start 2023-09-10T00:13:08.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f81ec0fd640 1 -- 172.21.15.84:0/1193151267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 msgr2=0x7f81dc0e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/1193151267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e2cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009900 tx=0x7f81d401c850 comp rx=0 tx=0).stop 2023-09-10T00:13:08.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- start start 2023-09-10T00:13:08.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- 172.21.15.84:0/1200116666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0c7450 msgr2=0x7f705c0ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 --2- 172.21.15.84:0/1200116666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0c7450 0x7f705c0ca8b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f705c06e320 tx=0x7f705401cb50 comp rx=0 tx=0).stop 2023-09-10T00:13:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- 172.21.15.84:0/165948635 shutdown_connections 2023-09-10T00:13:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 --2- 172.21.15.84:0/165948635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e40c7b70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- 172.21.15.84:0/165948635 >> 172.21.15.84:0/165948635 conn(0x7f17e40ae410 msgr2=0x7f17e40ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- 172.21.15.84:0/1200116666 shutdown_connections 2023-09-10T00:13:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 --2- 172.21.15.84:0/1200116666 >> v2:172.21.15.84:3300/0 conn(0x7f705c0cbf30 0x7f705c15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 --2- 172.21.15.84:0/1200116666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0c7450 0x7f705c0ca8b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- 172.21.15.84:0/1200116666 >> 172.21.15.84:0/1200116666 conn(0x7f705c0cc4e0 msgr2=0x7f705c0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- 172.21.15.84:0/1200116666 shutdown_connections 2023-09-10T00:13:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- 172.21.15.84:0/1200116666 wait complete. 2023-09-10T00:13:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f81ec0fd640 1 -- 172.21.15.84:0/1193151267 shutdown_connections 2023-09-10T00:13:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/1193151267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e2cb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- 172.21.15.84:0/165948635 shutdown_connections 2023-09-10T00:13:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff38c0c6cf0 0x7ff38c1fe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff38c0c9800 0x7ff38c200e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c151580 con 0x7ff38c1568e0 2023-09-10T00:13:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c2016a0 con 0x7ff38c0c9800 2023-09-10T00:13:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c201980 con 0x7ff38c0c6cf0 2023-09-10T00:13:08.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44004/0 (socket says 172.21.15.84:44004) 2023-09-10T00:13:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 -- 172.21.15.84:0/458088345 learned_addr learned my addr 172.21.15.84:0/458088345 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff383fff640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff38c0c9800 0x7ff38c200e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 Processor -- start 2023-09-10T00:13:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 -- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff38c0c6cf0 msgr2=0x7ff38c1fe4b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T00:13:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff38c0c6cf0 0x7ff38c1fe4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 -- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff38c0c9800 msgr2=0x7ff38c200e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff38c0c9800 0x7ff38c200e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 -- 172.21.15.84:0/458088345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009560 con 0x7ff38c1568e0 2023-09-10T00:13:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3908d3640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff38400e960 tx=0x7ff38400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- 172.21.15.84:0/165948635 wait complete. 2023-09-10T00:13:08.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 Processor -- start 2023-09-10T00:13:08.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 -- start start 2023-09-10T00:13:08.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 0x7f705c14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f7062077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 0x7f705c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f705affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 0x7f705c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f705affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 0x7f705c0c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44018/0 (socket says 172.21.15.84:44018) 2023-09-10T00:13:08.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384004d30 con 0x7ff38c1568e0 2023-09-10T00:13:08.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff38400cb20 con 0x7ff38c1568e0 2023-09-10T00:13:08.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff384005020 con 0x7ff38c1568e0 2023-09-10T00:13:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- 172.21.15.84:0/458088345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c201c60 con 0x7ff38c1568e0 2023-09-10T00:13:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- 172.21.15.84:0/458088345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c201380 con 0x7ff38c1568e0 2023-09-10T00:13:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7ff392336640 1 -- 172.21.15.84:0/458088345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c0c2460 con 0x7ff38c1568e0 2023-09-10T00:13:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7fda71085640 1 -- 172.21.15.84:0/3278846670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda540052b0 msgr2=0x7fda5400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7fda71085640 1 --2- 172.21.15.84:0/3278846670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda540052b0 0x7fda5400b990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fda6400e8a0 tx=0x7fda64021a30 comp rx=0 tx=0).stop 2023-09-10T00:13:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f705affd640 1 -- 172.21.15.84:0/2805757120 learned_addr learned my addr 172.21.15.84:0/2805757120 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f7062077640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0cbf30 0x7f705c0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/1193151267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 0x7f81dc007220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- 172.21.15.84:0/1193151267 >> 172.21.15.84:0/1193151267 conn(0x7f81dc054b10 msgr2=0x7f81dc054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- start start 2023-09-10T00:13:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 0x7f17e414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 0x7f17e40b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e4159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.454+0000 7f17ec20e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e414bc10 con 0x7f17e41568e0 2023-09-10T00:13:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ec20e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41fc010 con 0x7f17e40c6cf0 2023-09-10T00:13:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ec20e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e41fc2f0 con 0x7f17e40c99d0 2023-09-10T00:13:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c14d570 con 0x7f705c0c7450 2023-09-10T00:13:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c159f20 con 0x7f705c0cbf30 2023-09-10T00:13:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c14a990 con 0x7f705c071230 2023-09-10T00:13:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 0x7f705c14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705bfff640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0cbf30 0x7f705c0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- 172.21.15.84:0/1193151267 shutdown_connections 2023-09-10T00:13:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- 172.21.15.84:0/1193151267 wait complete. 2023-09-10T00:13:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 0x7f17e414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e97a9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 0x7f17e40b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e97a9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 0x7f17e40b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56692/0 (socket says 172.21.15.84:56692) 2023-09-10T00:13:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e97a9640 1 -- 172.21.15.84:0/2231180447 learned_addr learned my addr 172.21.15.84:0/2231180447 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7fda71085640 1 -- 172.21.15.84:0/3278846670 shutdown_connections 2023-09-10T00:13:08.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7fda71085640 1 --2- 172.21.15.84:0/3278846670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda540052b0 0x7fda5400b990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7fda71085640 1 -- 172.21.15.84:0/3278846670 >> 172.21.15.84:0/3278846670 conn(0x7fda6c0ae800 msgr2=0x7fda6c0aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ea7ab640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e4159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 -- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0cbf30 msgr2=0x7f705c0c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0cbf30 0x7f705c0c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 -- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 msgr2=0x7f705c0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 0x7f705c0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009560 con 0x7f705c071230 2023-09-10T00:13:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 -- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 msgr2=0x7f17e40b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 0x7f17e40b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 -- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 msgr2=0x7f17e4159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e4159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 -- 172.21.15.84:0/2231180447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d400ae40 con 0x7f17e40c6cf0 2023-09-10T00:13:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 Processor -- start 2023-09-10T00:13:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- start start 2023-09-10T00:13:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f705b7fe640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 0x7f705c14a450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f705000c460 tx=0x7f705000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f29bddbf640 1 -- 172.21.15.84:0/3213031352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 msgr2=0x7f29a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3213031352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29a0004c50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009b10 tx=0x7f29ac01d210 comp rx=0 tx=0).stop 2023-09-10T00:13:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17e9faa640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 0x7f17e414b2e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f17d40ab000 tx=0x7f17d4007e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7fda71085640 1 -- 172.21.15.84:0/3278846670 shutdown_connections 2023-09-10T00:13:08.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40ba070 con 0x7f17e40c6cf0 2023-09-10T00:13:08.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ec20e640 1 -- 172.21.15.84:0/2231180447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e41fc5d0 con 0x7f17e40c6cf0 2023-09-10T00:13:08.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ec20e640 1 -- 172.21.15.84:0/2231180447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e41fcb90 con 0x7f17e40c6cf0 2023-09-10T00:13:08.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 0x7f81dc0e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 0x7f81dc0d90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0dafa0 con 0x7f81dc054140 2023-09-10T00:13:08.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0e7cc0 con 0x7f81dc053ce0 2023-09-10T00:13:08.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ec0fd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0d96f0 con 0x7f81dc0df2f0 2023-09-10T00:13:08.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17d4004330 con 0x7f17e40c6cf0 2023-09-10T00:13:08.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400a520 con 0x7f17e40c6cf0 2023-09-10T00:13:08.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f29bddbf640 1 -- 172.21.15.84:0/3213031352 shutdown_connections 2023-09-10T00:13:08.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3213031352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29a0004c50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f29bddbf640 1 -- 172.21.15.84:0/3213031352 >> 172.21.15.84:0/3213031352 conn(0x7f29b80cc4e0 msgr2=0x7f29b80cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 -- 172.21.15.84:0/785540340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 msgr2=0x7f3d7815e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 --2- 172.21.15.84:0/785540340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 0x7f3d7815e5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3d7806b780 tx=0x7f3d7002dd30 comp rx=0 tx=0).stop 2023-09-10T00:13:08.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9e99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9e99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:56164/0 (socket says 172.21.15.84:56164) 2023-09-10T00:13:08.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9e99640 1 -- 172.21.15.84:0/3760073167 learned_addr learned my addr 172.21.15.84:0/3760073167 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 0x7f81dc0e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 -- 172.21.15.84:0/785540340 shutdown_connections 2023-09-10T00:13:08.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 --2- 172.21.15.84:0/785540340 >> v2:172.21.15.84:3300/0 conn(0x7f3d780c8dc0 0x7f3d78069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 --2- 172.21.15.84:0/785540340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 0x7f3d7815e5d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 -- 172.21.15.84:0/785540340 >> 172.21.15.84:0/785540340 conn(0x7f3d780af490 msgr2=0x7f3d780af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81ea69a640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 0x7f81dc0d90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff384005180 con 0x7ff38c1568e0 2023-09-10T00:13:08.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7ff3897fa640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff384083ff0 con 0x7ff38c1568e0 2023-09-10T00:13:08.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f17ec20e640 1 -- 172.21.15.84:0/2231180447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e4073390 con 0x7f17e40c6cf0 2023-09-10T00:13:08.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 -- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 msgr2=0x7f81dc0d90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 0x7f81dc0d90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 -- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 msgr2=0x7f81dc0e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7fda71085640 1 -- 172.21.15.84:0/3278846670 wait complete. 2023-09-10T00:13:08.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f81e9698640 1 -- 172.21.15.84:0/3760073167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4009560 con 0x7f81dc054140 2023-09-10T00:13:08.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 -- 172.21.15.84:0/785540340 shutdown_connections 2023-09-10T00:13:08.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f3d7759e640 1 -- 172.21.15.84:0/785540340 wait complete. 2023-09-10T00:13:08.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.458+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003600 con 0x7f705c071230 2023-09-10T00:13:08.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- 172.21.15.84:0/3213031352 shutdown_connections 2023-09-10T00:13:08.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7054009820 con 0x7f705c071230 2023-09-10T00:13:08.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c14e920 con 0x7f705c071230 2023-09-10T00:13:08.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 Processor -- start 2023-09-10T00:13:08.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 -- start start 2023-09-10T00:13:08.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 0x7fda6c1edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 0x7fda6c0c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 0x7fda6c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0c1a40 con 0x7fda6c0b2770 2023-09-10T00:13:08.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0c39c0 con 0x7fda540052b0 2023-09-10T00:13:08.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda71085640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0c1c90 con 0x7fda6c1f0cf0 2023-09-10T00:13:08.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7050003760 con 0x7f705c071230 2023-09-10T00:13:08.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003600 con 0x7f705c071230 2023-09-10T00:13:08.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 0x7fda6c1edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 0x7fda6c0c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 0x7fda6c1edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:56176/0 (socket says 172.21.15.84:56176) 2023-09-10T00:13:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 0x7fda6c0c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56714/0 (socket says 172.21.15.84:56714) 2023-09-10T00:13:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6ad9d640 1 -- 172.21.15.84:0/2629002177 learned_addr learned my addr 172.21.15.84:0/2629002177 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 0x7fda6c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- 172.21.15.84:0/3213031352 wait complete. 2023-09-10T00:13:08.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 Processor -- start 2023-09-10T00:13:08.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 Processor -- start 2023-09-10T00:13:08.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 -- start start 2023-09-10T00:13:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c005260 con 0x7f705c071230 2023-09-10T00:13:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 0x7f3d78156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3d780c8dc0 0x7f3d781571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780c4150 con 0x7f3d7806a4e0 2023-09-10T00:13:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78095e40 con 0x7f3d780ab900 2023-09-10T00:13:08.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7759e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780c37b0 con 0x7f3d780c8dc0 2023-09-10T00:13:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 -- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 msgr2=0x7fda6c0c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 0x7fda6c0c0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 -- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 msgr2=0x7fda6c1edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 0x7fda6c1edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 -- 172.21.15.84:0/2629002177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0c1f70 con 0x7fda6c0b2770 2023-09-10T00:13:08.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7fda6b59e640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 0x7fda6c0c1500 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0ac720 tx=0x7fda64006db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44044/0 (socket says 172.21.15.84:44044) 2023-09-10T00:13:08.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 -- 172.21.15.84:0/2414676662 learned_addr learned my addr 172.21.15.84:0/2414676662 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f17d400a680 con 0x7f17e40c6cf0 2023-09-10T00:13:08.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f17da7fc640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 0x7f17c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17d411d300 con 0x7f17e40c6cf0 2023-09-10T00:13:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- start start 2023-09-10T00:13:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b815d330 0x7f29b81f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29b81f5c90 0x7f29b80aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c5740 con 0x7f29a00047d0 2023-09-10T00:13:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c46a0 con 0x7f29b815d330 2023-09-10T00:13:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29bddbf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b80c4980 con 0x7f29b81f5c90 2023-09-10T00:13:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44054/0 (socket says 172.21.15.84:44054) 2023-09-10T00:13:08.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 -- 172.21.15.84:0/3567971000 learned_addr learned my addr 172.21.15.84:0/3567971000 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 -- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3d780c8dc0 msgr2=0x7f3d781571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3d780c8dc0 0x7f3d781571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 -- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 msgr2=0x7f3d78156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 0x7f3d78156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 -- 172.21.15.84:0/2414676662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009880 con 0x7f3d7806a4e0 2023-09-10T00:13:08.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f17e97a9640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 0x7f17c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 -- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29b81f5c90 msgr2=0x7f29b80aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29b81f5c90 0x7f29b80aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 -- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b815d330 msgr2=0x7f29b81f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b815d330 0x7f29b81f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 -- 172.21.15.84:0/3567971000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b80c4c60 con 0x7f29a00047d0 2023-09-10T00:13:08.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f3d7659c640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000f90 tx=0x7f3d700043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f29b77fe640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006600 tx=0x7f29a80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7ff38bfff640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7ff38bfff640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 0x7ff36c067fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff3740af000 tx=0x7ff37401b0d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f17e97a9640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 0x7f17c8067fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17e0001300 tx=0x7f17e0001290 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.462+0000 7f81e9698640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 0x7f81dc0e7630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81d40ac000 tx=0x7f81d4005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7050003910 con 0x7f705c071230 2023-09-10T00:13:08.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f7043fff640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 0x7f70480680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70500827d0 con 0x7f705c071230 2023-09-10T00:13:08.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f705affd640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 0x7f70480680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f705affd640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 0x7f70480680d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7054000f90 tx=0x7f705401b390 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700cb070 con 0x7f3d7806a4e0 2023-09-10T00:13:08.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d780c3a90 con 0x7f3d7806a4e0 2023-09-10T00:13:08.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64001a10 con 0x7fda6c0b2770 2023-09-10T00:13:08.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff3840517e0 con 0x7ff38c1568e0 2023-09-10T00:13:08.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7808ed50 con 0x7f3d7806a4e0 2023-09-10T00:13:08.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c1f01a0 con 0x7fda6c0b2770 2023-09-10T00:13:08.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c1f0760 con 0x7fda6c0b2770 2023-09-10T00:13:08.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800f960 con 0x7f29a00047d0 2023-09-10T00:13:08.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b80c4f40 con 0x7f29a00047d0 2023-09-10T00:13:08.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b80aa5f0 con 0x7f29a00047d0 2023-09-10T00:13:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b8073390 con 0x7f29a00047d0 2023-09-10T00:13:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f29a800fac0 con 0x7f29a00047d0 2023-09-10T00:13:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800fe90 con 0x7f29a00047d0 2023-09-10T00:13:08.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3d70004870 con 0x7f3d7806a4e0 2023-09-10T00:13:08.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70004c50 con 0x7f3d7806a4e0 2023-09-10T00:13:08.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d780c4290 con 0x7f3d7806a4e0 2023-09-10T00:13:08.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c071c20 con 0x7fda6c0b2770 2023-09-10T00:13:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3d700c5040 con 0x7f3d7806a4e0 2023-09-10T00:13:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4005020 con 0x7f81dc054140 2023-09-10T00:13:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc0d99d0 con 0x7f81dc054140 2023-09-10T00:13:08.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.466+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc0d9f90 con 0x7f81dc054140 2023-09-10T00:13:08.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f81d4005180 con 0x7f81dc054140 2023-09-10T00:13:08.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4005550 con 0x7f81dc054140 2023-09-10T00:13:08.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc005260 con 0x7f81dc054140 2023-09-10T00:13:08.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f3d66ffd640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 0x7f3d58067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda640ab560 con 0x7fda6c0b2770 2023-09-10T00:13:08.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640ab910 con 0x7fda6c0b2770 2023-09-10T00:13:08.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.470+0000 7f3d75d9b640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 0x7f3d58067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f3d75d9b640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 0x7f3d58067fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d780b08d0 tx=0x7f3d6c005c00 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda640b1070 con 0x7fda6c0b2770 2023-09-10T00:13:08.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7fda537fe640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 0x7fda58067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7fda6ad9d640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 0x7fda58067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f29a8025440 con 0x7f29a00047d0 2023-09-10T00:13:08.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f299ffff640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 0x7f29a4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f29b6ffd640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 0x7f29a4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f29b6ffd640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 0x7f29a4068010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0ad000 tx=0x7f29a0005800 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7fda6ad9d640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 0x7fda58067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda6000bcc0 tx=0x7fda6000b410 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fda640f1dd0 con 0x7fda6c0b2770 2023-09-10T00:13:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d70101e10 con 0x7f3d7806a4e0 2023-09-10T00:13:08.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29a80564c0 con 0x7f29a00047d0 2023-09-10T00:13:08.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f81d40b4040 con 0x7f81dc054140 2023-09-10T00:13:08.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f81da7fc640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 0x7f81c8068040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f81e9e99640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 0x7f81c8068040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81d40ef2c0 con 0x7f81dc054140 2023-09-10T00:13:08.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f81e9e99640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 0x7f81c8068040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81e000afd0 tx=0x7f81e000c040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.474+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17d40ea970 con 0x7f17e40c6cf0 2023-09-10T00:13:08.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.478+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f705004fed0 con 0x7f705c071230 2023-09-10T00:13:08.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.482+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda640ee110 con 0x7fda6c0b2770 2023-09-10T00:13:08.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.482+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3d700fda50 con 0x7f3d7806a4e0 2023-09-10T00:13:08.537 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.486+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f29a8052100 con 0x7f29a00047d0 2023-09-10T00:13:08.538 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.490+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/3499758961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c48157990 msgr2=0x7f9c480ac6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.490+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/3499758961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c48157990 0x7f9c480ac6b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009900 tx=0x7f9c3c01c810 comp rx=0 tx=0).stop 2023-09-10T00:13:08.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/3499758961 shutdown_connections 2023-09-10T00:13:08.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/3499758961 >> v2:172.21.15.100:3300/0 conn(0x7f9c480c9500 0x7f9c480c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/3499758961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c48157990 0x7f9c480ac6b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.539 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/3499758961 >> 172.21.15.84:0/3499758961 conn(0x7f9c480ca0a0 msgr2=0x7f9c480ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/3499758961 shutdown_connections 2023-09-10T00:13:08.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/3499758961 wait complete. 2023-09-10T00:13:08.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 Processor -- start 2023-09-10T00:13:08.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- start start 2023-09-10T00:13:08.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c480c8a30 0x7f9c480c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c48157990 0x7f9c480ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480c2650 con 0x7f9c480c9500 2023-09-10T00:13:08.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480c2930 con 0x7f9c480c8a30 2023-09-10T00:13:08.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d9bd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c480c2c10 con 0x7f9c48157990 2023-09-10T00:13:08.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c47fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44058/0 (socket says 172.21.15.84:44058) 2023-09-10T00:13:08.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c47fff640 1 -- 172.21.15.84:0/567141547 learned_addr learned my addr 172.21.15.84:0/567141547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:08.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4c9bb640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c480c8a30 0x7f9c480c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.494+0000 7f9c4d1bc640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c48157990 0x7f9c480ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 -- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c48157990 msgr2=0x7f9c480ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c48157990 0x7f9c480ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 -- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c480c8a30 msgr2=0x7f9c480c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c480c8a30 0x7f9c480c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 -- 172.21.15.84:0/567141547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009560 con 0x7f9c480c9500 2023-09-10T00:13:08.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f81d40eb690 con 0x7f81dc054140 2023-09-10T00:13:08.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.498+0000 7f9c47fff640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c370 tx=0x7f9c3400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.502+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c340052d0 con 0x7f9c480c9500 2023-09-10T00:13:08.545 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.502+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c34007020 con 0x7f9c480c9500 2023-09-10T00:13:08.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.502+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c480c2ef0 con 0x7f9c480c9500 2023-09-10T00:13:08.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.502+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c48154e00 con 0x7f9c480c9500 2023-09-10T00:13:08.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.506+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34007430 con 0x7f9c480c9500 2023-09-10T00:13:08.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.506+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9c340067e0 con 0x7f9c480c9500 2023-09-10T00:13:08.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.506+0000 7f9c457fa640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 0x7f9c2c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:08.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.506+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c480c3130 con 0x7f9c480c9500 2023-09-10T00:13:08.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.514+0000 7f9c4c9bb640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 0x7f9c2c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:08.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.514+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c34082b30 con 0x7f9c480c9500 2023-09-10T00:13:08.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.514+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9c340881f0 con 0x7f9c480c9500 2023-09-10T00:13:08.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.518+0000 7f9c4c9bb640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 0x7f9c2c0680b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0af000 tx=0x7f9c3c01b050 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.770+0000 7ff392336640 1 -- 172.21.15.84:0/458088345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff38c0c2460 con 0x7ff38c1568e0 2023-09-10T00:13:08.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.770+0000 7ff3897fa640 1 -- 172.21.15.84:0/458088345 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff38c0c2460 con 0x7ff38c1568e0 2023-09-10T00:13:08.777 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-09-10T00:13:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 msgr2=0x7ff36c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 0x7ff36c067fe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff3740af000 tx=0x7ff37401b0d0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 msgr2=0x7ff38c0c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff38400e960 tx=0x7ff38400ee20 comp rx=0 tx=0).stop 2023-09-10T00:13:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 shutdown_connections 2023-09-10T00:13:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff36c065b20 0x7ff36c067fe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff38c1568e0 0x7ff38c0c2740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff38c0c9800 0x7ff38c200e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 --2- 172.21.15.84:0/458088345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff38c0c6cf0 0x7ff38c1fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 >> 172.21.15.84:0/458088345 conn(0x7ff38c0ae410 msgr2=0x7ff38c1589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 shutdown_connections 2023-09-10T00:13:08.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.774+0000 7ff3827fc640 1 -- 172.21.15.84:0/458088345 wait complete. 2023-09-10T00:13:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.782+0000 7f7062077640 1 -- 172.21.15.84:0/2805757120 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f703c0057e0 con 0x7f705c071230 2023-09-10T00:13:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.782+0000 7f7043fff640 1 -- 172.21.15.84:0/2805757120 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7050017020 con 0x7f705c071230 2023-09-10T00:13:08.790 INFO:teuthology.orchestra.run.smithi084.stdout:64424509450 2023-09-10T00:13:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 msgr2=0x7f70480680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 0x7f70480680d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7054000f90 tx=0x7f705401b390 comp rx=0 tx=0).stop 2023-09-10T00:13:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 msgr2=0x7f705c14a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 0x7f705c14a450 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f705000c460 tx=0x7f705000c920 comp rx=0 tx=0).stop 2023-09-10T00:13:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 shutdown_connections 2023-09-10T00:13:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.786+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7048065c10 0x7f70480680d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f705c0cbf30 0x7f705c0c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f705c0c7450 0x7f705c0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 --2- 172.21.15.84:0/2805757120 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f705c071230 0x7f705c14a450 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 >> 172.21.15.84:0/2805757120 conn(0x7f705c0cc4e0 msgr2=0x7f705c0c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 shutdown_connections 2023-09-10T00:13:08.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f7041ffb640 1 -- 172.21.15.84:0/2805757120 wait complete. 2023-09-10T00:13:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f17ec20e640 1 -- 172.21.15.84:0/2231180447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f17e4071270 con 0x7f17e40c6cf0 2023-09-10T00:13:08.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.790+0000 7f17da7fc640 1 -- 172.21.15.84:0/2231180447 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17d40edf90 con 0x7f17e40c6cf0 2023-09-10T00:13:08.795 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-09-10T00:13:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 msgr2=0x7f17c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 0x7f17c8067fe0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f17e0001300 tx=0x7f17e0001290 comp rx=0 tx=0).stop 2023-09-10T00:13:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 msgr2=0x7f17e414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 0x7f17e414b2e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f17d40ab000 tx=0x7f17d4007e70 comp rx=0 tx=0).stop 2023-09-10T00:13:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 shutdown_connections 2023-09-10T00:13:08.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17c8065b20 0x7f17c8067fe0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17e41568e0 0x7f17e4159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17e40c99d0 0x7f17e40b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 --2- 172.21.15.84:0/2231180447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17e40c6cf0 0x7f17e414b2e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 >> 172.21.15.84:0/2231180447 conn(0x7f17e40ae410 msgr2=0x7f17e4150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 shutdown_connections 2023-09-10T00:13:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f17c7fff640 1 -- 172.21.15.84:0/2231180447 wait complete. 2023-09-10T00:13:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d78073390 con 0x7f3d7806a4e0 2023-09-10T00:13:08.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fda6c073390 con 0x7fda6c0b2770 2023-09-10T00:13:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7f3d66ffd640 1 -- 172.21.15.84:0/2414676662 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d700c3070 con 0x7f3d7806a4e0 2023-09-10T00:13:08.801 INFO:teuthology.orchestra.run.smithi084.stdout:60129542154 2023-09-10T00:13:08.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.794+0000 7fda537fe640 1 -- 172.21.15.84:0/2629002177 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda640c1020 con 0x7fda6c0b2770 2023-09-10T00:13:08.802 INFO:teuthology.orchestra.run.smithi084.stdout:64424509448 2023-09-10T00:13:08.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f29b80ca180 con 0x7f29a00047d0 2023-09-10T00:13:08.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f299ffff640 1 -- 172.21.15.84:0/3567971000 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f29a8020020 con 0x7f29a00047d0 2023-09-10T00:13:08.803 INFO:teuthology.orchestra.run.smithi084.stdout:64424509450 2023-09-10T00:13:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 msgr2=0x7fda58067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 0x7fda58067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda6000bcc0 tx=0x7fda6000b410 comp rx=0 tx=0).stop 2023-09-10T00:13:08.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 msgr2=0x7fda6c0c1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 0x7fda6c0c1500 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0ac720 tx=0x7fda64006db0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 shutdown_connections 2023-09-10T00:13:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda58065b20 0x7fda58067fe0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fda6000bcc0 tx=0x7fda6000b410 comp rx=0 tx=0).stop 2023-09-10T00:13:08.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda6c0b2770 0x7fda6c0c1500 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda6c1f0cf0 0x7fda6c0c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 --2- 172.21.15.84:0/2629002177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda540052b0 0x7fda6c1edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 >> 172.21.15.84:0/2629002177 conn(0x7fda6c0ae800 msgr2=0x7fda6c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 msgr2=0x7f3d58067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 0x7f3d58067fe0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d780b08d0 tx=0x7f3d6c005c00 comp rx=0 tx=0).stop 2023-09-10T00:13:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 msgr2=0x7f3d78095900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3d70000f90 tx=0x7f3d700043b0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 shutdown_connections 2023-09-10T00:13:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3d58065b20 0x7f3d58067fe0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d780b08d0 tx=0x7f3d6c005c00 comp rx=0 tx=0).stop 2023-09-10T00:13:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3d780c8dc0 0x7f3d781571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d780ab900 0x7f3d78156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 --2- 172.21.15.84:0/2414676662 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d7806a4e0 0x7f3d78095900 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.798+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 >> 172.21.15.84:0/2414676662 conn(0x7f3d780af490 msgr2=0x7f3d780c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.1 2023-09-10T00:13:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 shutdown_connections 2023-09-10T00:13:08.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f3d7759e640 1 -- 172.21.15.84:0/2414676662 wait complete. 2023-09-10T00:13:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 msgr2=0x7f29a4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 0x7f29a4068010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0ad000 tx=0x7f29a0005800 comp rx=0 tx=0).stop 2023-09-10T00:13:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 msgr2=0x7f29b815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006600 tx=0x7f29a80039d0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 shutdown_connections 2023-09-10T00:13:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f29a4065b50 0x7f29a4068010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29b81f5c90 0x7f29b80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29b815d330 0x7f29b81f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 --2- 172.21.15.84:0/3567971000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a00047d0 0x7f29b815cdf0 secure :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006600 tx=0x7f29a80039d0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 >> 172.21.15.84:0/3567971000 conn(0x7f29b80cc4e0 msgr2=0x7f29b80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 shutdown_connections 2023-09-10T00:13:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f29bddbf640 1 -- 172.21.15.84:0/3567971000 wait complete. 2023-09-10T00:13:08.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81cc0050d0 con 0x7f81dc054140 2023-09-10T00:13:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 shutdown_connections 2023-09-10T00:13:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7fda71085640 1 -- 172.21.15.84:0/2629002177 wait complete. 2023-09-10T00:13:08.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.802+0000 7f81da7fc640 1 -- 172.21.15.84:0/3760073167 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81d40b2020 con 0x7f81dc054140 2023-09-10T00:13:08.815 INFO:teuthology.orchestra.run.smithi084.stdout:60129542153 2023-09-10T00:13:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 msgr2=0x7f81c8068040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 0x7f81c8068040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f81e000afd0 tx=0x7f81e000c040 comp rx=0 tx=0).stop 2023-09-10T00:13:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 msgr2=0x7f81dc0e7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 0x7f81dc0e7630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f81d40ac000 tx=0x7f81d4005e00 comp rx=0 tx=0).stop 2023-09-10T00:13:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 shutdown_connections 2023-09-10T00:13:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f81c8065b80 0x7f81c8068040 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f81dc0df2f0 0x7f81dc0d90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81dc054140 0x7f81dc0e7630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 --2- 172.21.15.84:0/3760073167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81dc053ce0 0x7f81dc0e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 >> 172.21.15.84:0/3760073167 conn(0x7f81dc054b10 msgr2=0x7f81dc038fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 shutdown_connections 2023-09-10T00:13:08.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.810+0000 7f81ec0fd640 1 -- 172.21.15.84:0/3760073167 wait complete. 2023-09-10T00:13:08.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2023-09-10T00:13:08.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.0 2023-09-10T00:13:08.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.822+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9c48073390 con 0x7f9c480c9500 2023-09-10T00:13:08.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.822+0000 7f9c457fa640 1 -- 172.21.15.84:0/567141547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c340502b0 con 0x7f9c480c9500 2023-09-10T00:13:08.826 INFO:teuthology.orchestra.run.smithi084.stdout:64424509450 2023-09-10T00:13:08.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 msgr2=0x7f9c2c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 0x7f9c2c0680b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0af000 tx=0x7f9c3c01b050 comp rx=0 tx=0).stop 2023-09-10T00:13:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 msgr2=0x7f9c480ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c370 tx=0x7f9c3400c830 comp rx=0 tx=0).stop 2023-09-10T00:13:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 shutdown_connections 2023-09-10T00:13:08.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c2c065bf0 0x7f9c2c0680b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c48157990 0x7f9c480ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c480c9500 0x7f9c480ad3b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 --2- 172.21.15.84:0/567141547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c480c8a30 0x7f9c480c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 >> 172.21.15.84:0/567141547 conn(0x7f9c480ca0a0 msgr2=0x7f9c4814d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:08.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 shutdown_connections 2023-09-10T00:13:08.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:08.826+0000 7f9c4d9bd640 1 -- 172.21.15.84:0/567141547 wait complete. 2023-09-10T00:13:08.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2023-09-10T00:13:08.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.2 2023-09-10T00:13:08.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2023-09-10T00:13:08.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.3 2023-09-10T00:13:08.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2023-09-10T00:13:09.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:13:09.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:13:09.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-10T00:13:09.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-10T00:13:09.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-10T00:13:09.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-10T00:13:09.838 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-10T00:13:09.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-10T00:13:09.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-10T00:13:09.851 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-10T00:13:10.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- 172.21.15.84:0/2924037930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580c6fa0 msgr2=0x7fde580cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 --2- 172.21.15.84:0/2924037930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580c6fa0 0x7fde580cbe50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009900 tx=0x7fde4c01c8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- 172.21.15.84:0/2924037930 shutdown_connections 2023-09-10T00:13:10.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 --2- 172.21.15.84:0/2924037930 >> v2:172.21.15.100:3300/0 conn(0x7fde580ca8b0 0x7fde5815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 --2- 172.21.15.84:0/2924037930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580c6fa0 0x7fde580cbe50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- 172.21.15.84:0/2924037930 >> 172.21.15.84:0/2924037930 conn(0x7fde580cc4e0 msgr2=0x7fde580cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- 172.21.15.84:0/2924037930 shutdown_connections 2023-09-10T00:13:10.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- 172.21.15.84:0/2924037930 wait complete. 2023-09-10T00:13:10.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 Processor -- start 2023-09-10T00:13:10.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:09.998+0000 7fde5da44640 1 -- start start 2023-09-10T00:13:10.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 0x7fde580ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580aff30 0x7fde580c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde56ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 0x7fde580ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde56ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 0x7fde580ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46216/0 (socket says 172.21.15.84:46216) 2023-09-10T00:13:10.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde58200aa0 con 0x7fde580c7380 2023-09-10T00:13:10.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5815b230 con 0x7fde580ca8b0 2023-09-10T00:13:10.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde5da44640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b0410 con 0x7fde580aff30 2023-09-10T00:13:10.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:43656/0 (socket says 172.21.15.84:43656) 2023-09-10T00:13:10.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 -- 172.21.15.84:0/3499697210 learned_addr learned my addr 172.21.15.84:0/3499697210 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde577fe640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580aff30 0x7fde580c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 -- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580aff30 msgr2=0x7fde580c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580aff30 0x7fde580c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 -- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 msgr2=0x7fde580ab6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 0x7fde580ab6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 -- 172.21.15.84:0/3499697210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009560 con 0x7fde580ca8b0 2023-09-10T00:13:10.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.002+0000 7fde567fc640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e7a0 tx=0x7fde4800ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.006+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800ccc0 con 0x7fde580ca8b0 2023-09-10T00:13:10.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.006+0000 7fde5da44640 1 -- 172.21.15.84:0/3499697210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580b06f0 con 0x7fde580ca8b0 2023-09-10T00:13:10.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.006+0000 7fde5da44640 1 -- 172.21.15.84:0/3499697210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580b0cb0 con 0x7fde580ca8b0 2023-09-10T00:13:10.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde4800eeb0 con 0x7fde580ca8b0 2023-09-10T00:13:10.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48010690 con 0x7fde580ca8b0 2023-09-10T00:13:10.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fde480107f0 con 0x7fde580ca8b0 2023-09-10T00:13:10.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde3ffff640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 0x7fde400681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde48014070 con 0x7fde580ca8b0 2023-09-10T00:13:10.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde56ffd640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 0x7fde400681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde5da44640 1 -- 172.21.15.84:0/3499697210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde38005260 con 0x7fde580ca8b0 2023-09-10T00:13:10.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.010+0000 7fde56ffd640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 0x7fde400681d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0af000 tx=0x7fde4c01b110 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.022+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fde4804fdb0 con 0x7fde580ca8b0 2023-09-10T00:13:10.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- 172.21.15.84:0/904419309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 msgr2=0x7f03480c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 --2- 172.21.15.84:0/904419309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c6b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f034806b160 tx=0x7f034401c830 comp rx=0 tx=0).stop 2023-09-10T00:13:10.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 -- 172.21.15.84:0/784896608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 msgr2=0x7fdd70069760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/784896608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd70069760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdd7006f920 tx=0x7fdd6801cd20 comp rx=0 tx=0).stop 2023-09-10T00:13:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 -- 172.21.15.84:0/784896608 shutdown_connections 2023-09-10T00:13:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/784896608 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd70069760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/784896608 >> v2:172.21.15.100:3300/0 conn(0x7fdd7015abf0 0x7fdd700b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 -- 172.21.15.84:0/784896608 >> 172.21.15.84:0/784896608 conn(0x7fdd700c9100 msgr2=0x7fdd700c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- 172.21.15.84:0/904419309 shutdown_connections 2023-09-10T00:13:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 --2- 172.21.15.84:0/904419309 >> v2:172.21.15.100:3300/0 conn(0x7f0348069fa0 0x7f034806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 --2- 172.21.15.84:0/904419309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c6b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- 172.21.15.84:0/904419309 >> 172.21.15.84:0/904419309 conn(0x7f03480af490 msgr2=0x7f03480af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- 172.21.15.84:0/904419309 shutdown_connections 2023-09-10T00:13:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 -- 172.21.15.84:0/1484506798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800c9760 msgr2=0x7fbb8015e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/1484506798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800c9760 0x7fbb8015e6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009cb0 tx=0x7fbb7801cce0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- 172.21.15.84:0/904419309 wait complete. 2023-09-10T00:13:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 -- 172.21.15.84:0/1484506798 shutdown_connections 2023-09-10T00:13:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/1484506798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800c9760 0x7fbb8015e6b0 secure :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009cb0 tx=0x7fbb7801cce0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/1484506798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 0x7fbb800b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 -- 172.21.15.84:0/1484506798 >> 172.21.15.84:0/1484506798 conn(0x7fbb800ca0a0 msgr2=0x7fbb800ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 -- 172.21.15.84:0/784896608 shutdown_connections 2023-09-10T00:13:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fdd75b4e640 1 -- 172.21.15.84:0/784896608 wait complete. 2023-09-10T00:13:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 -- 172.21.15.84:0/1484506798 shutdown_connections 2023-09-10T00:13:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 Processor -- start 2023-09-10T00:13:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7f034efdc640 1 -- start start 2023-09-10T00:13:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.038+0000 7fbb7ffff640 1 -- 172.21.15.84:0/1484506798 wait complete. 2023-09-10T00:13:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 Processor -- start 2023-09-10T00:13:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 Processor -- start 2023-09-10T00:13:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 -- start start 2023-09-10T00:13:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0348069fa0 0x7f03480c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- 172.21.15.84:0/229565185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f180047d0 msgr2=0x7f8f18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 --2- 172.21.15.84:0/229565185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f180047d0 0x7f8f18004c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009b60 tx=0x7f8f2001d2b0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f34c9b640 1 -- 172.21.15.84:0/229565185 reap_dead start 2023-09-10T00:13:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- 172.21.15.84:0/229565185 shutdown_connections 2023-09-10T00:13:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- 172.21.15.84:0/229565185 >> 172.21.15.84:0/229565185 conn(0x7f8f300d0b30 msgr2=0x7f8f300d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- 172.21.15.84:0/229565185 shutdown_connections 2023-09-10T00:13:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd7006d570 0x7fdd7014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 0x7fdd700c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c4160 con 0x7fdd700c8600 2023-09-10T00:13:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c4f80 con 0x7fdd7015abf0 2023-09-10T00:13:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd75b4e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700c4370 con 0x7fdd7006d570 2023-09-10T00:13:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 -- 172.21.15.84:0/3206912350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 msgr2=0x7f65680c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 --2- 172.21.15.84:0/3206912350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f65680c6b90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f655c0098f0 tx=0x7f655c01c870 comp rx=0 tx=0).stop 2023-09-10T00:13:10.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 -- start start 2023-09-10T00:13:10.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 0x7fbb80200a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 0x7fbb8015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 0x7fbb800a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015c5a0 con 0x7fbb8015ebf0 2023-09-10T00:13:10.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015b9b0 con 0x7fbb8015db60 2023-09-10T00:13:10.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7ffff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8015bc00 con 0x7fbb8006d390 2023-09-10T00:13:10.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 -- 172.21.15.84:0/3206912350 shutdown_connections 2023-09-10T00:13:10.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 --2- 172.21.15.84:0/3206912350 >> v2:172.21.15.100:3300/0 conn(0x7f6568069fa0 0x7f656806a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 --2- 172.21.15.84:0/3206912350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f65680c6b90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 -- 172.21.15.84:0/3206912350 >> 172.21.15.84:0/3206912350 conn(0x7f65680af490 msgr2=0x7f65680af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 0x7f034815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480bf510 con 0x7f03480aba00 2023-09-10T00:13:10.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481513d0 con 0x7f0348069fa0 2023-09-10T00:13:10.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034efdc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480bf760 con 0x7f03480c8dc0 2023-09-10T00:13:10.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7effd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 0x7fbb80200a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 0x7fbb8015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 0x7fbb8015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46258/0 (socket says 172.21.15.84:46258) 2023-09-10T00:13:10.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/2392876300 learned_addr learned my addr 172.21.15.84:0/2392876300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 0x7fbb800a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46272/0 (socket says 172.21.15.84:46272) 2023-09-10T00:13:10.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 -- 172.21.15.84:0/3939571926 learned_addr learned my addr 172.21.15.84:0/3939571926 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034e7db640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 0x7f034815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 -- 172.21.15.84:0/3206912350 shutdown_connections 2023-09-10T00:13:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034e7db640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 0x7f034815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56040/0 (socket says 172.21.15.84:56040) 2023-09-10T00:13:10.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034e7db640 1 -- 172.21.15.84:0/3384233270 learned_addr learned my addr 172.21.15.84:0/3384233270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f656d164640 1 -- 172.21.15.84:0/3206912350 wait complete. 2023-09-10T00:13:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd6ffff640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 0x7fdd700c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034dfda640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0348069fa0 0x7f03480c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- 172.21.15.84:0/229565185 wait complete. 2023-09-10T00:13:10.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 Processor -- start 2023-09-10T00:13:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 msgr2=0x7fbb80200a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 0x7fbb80200a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 msgr2=0x7fbb8015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 0x7fbb8015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/2392876300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780098e0 con 0x7fbb8015db60 2023-09-10T00:13:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd6f7fe640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd7006d570 0x7fdd7014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 -- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd7006d570 msgr2=0x7fdd7014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd7006d570 0x7fdd7014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 -- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 msgr2=0x7fdd700c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 0x7fdd700c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd67fff640 1 -- 172.21.15.84:0/3939571926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680098e0 con 0x7fdd700c8600 2023-09-10T00:13:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fdd6ffff640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 0x7fdd700c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:13:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 0x7fbb800a5e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400b3e0 tx=0x7fbb7400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 -- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 msgr2=0x7f034815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 0x7f034815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 -- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0348069fa0 msgr2=0x7f03480c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0348069fa0 0x7f03480c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f034d7d9640 1 -- 172.21.15.84:0/3384233270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009500 con 0x7f03480aba00 2023-09-10T00:13:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.042+0000 7f8f366fe640 1 -- start start 2023-09-10T00:13:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd67fff640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b4d0 tx=0x7fdd5800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f301f7e10 0x7f8f300b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8f300b1440 0x7f8f300c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300ca570 con 0x7f8f300ca0c0 2023-09-10T00:13:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300b1950 con 0x7f8f301f7e10 2023-09-10T00:13:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300b1c30 con 0x7f8f300b1440 2023-09-10T00:13:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58010870 con 0x7fdd700c8600 2023-09-10T00:13:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdd58010ac0 con 0x7fdd700c8600 2023-09-10T00:13:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800f3c0 con 0x7fdd700c8600 2023-09-10T00:13:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd700c4650 con 0x7fdd700c8600 2023-09-10T00:13:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd700c4c10 con 0x7fdd700c8600 2023-09-10T00:13:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f034d7d9640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c3610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f033800b460 tx=0x7f033800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46286/0 (socket says 172.21.15.84:46286) 2023-09-10T00:13:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 -- 172.21.15.84:0/1666961658 learned_addr learned my addr 172.21.15.84:0/1666961658 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 Processor -- start 2023-09-10T00:13:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- start start 2023-09-10T00:13:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011830 con 0x7f03480aba00 2023-09-10T00:13:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0338011aa0 con 0x7f03480aba00 2023-09-10T00:13:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03480bfa40 con 0x7f03480aba00 2023-09-10T00:13:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0348154480 con 0x7f03480aba00 2023-09-10T00:13:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f2f7fe640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8f300b1440 0x7f8f300c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f2ffff640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f301f7e10 0x7f8f300b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338010380 con 0x7f03480aba00 2023-09-10T00:13:10.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 -- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8f300b1440 msgr2=0x7f8f300c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8f300b1440 0x7f8f300c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 -- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f301f7e10 msgr2=0x7f8f300b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f301f7e10 0x7f8f300b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 -- 172.21.15.84:0/1666961658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300b1f10 con 0x7f8f300ca0c0 2023-09-10T00:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f34c9b640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f300b3720 tx=0x7f8f280092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800fda0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f28003980 con 0x7f8f300ca0c0 2023-09-10T00:13:10.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28003d90 con 0x7f8f300ca0c0 2023-09-10T00:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd54005260 con 0x7fdd700c8600 2023-09-10T00:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330005260 con 0x7f03480aba00 2023-09-10T00:13:10.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f03380104e0 con 0x7f03480aba00 2023-09-10T00:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f033e7fc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 0x7f032c068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0338083520 con 0x7f03480aba00 2023-09-10T00:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- 172.21.15.84:0/1666961658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300b21f0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- 172.21.15.84:0/1666961658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f301f81f0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f8f366fe640 1 -- 172.21.15.84:0/1666961658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f10005260 con 0x7f8f300ca0c0 2023-09-10T00:13:10.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74011830 con 0x7fbb8015db60 2023-09-10T00:13:10.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8015bee0 con 0x7fbb8015db60 2023-09-10T00:13:10.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800c5550 con 0x7fbb8015db60 2023-09-10T00:13:10.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568069fa0 0x7f6568151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65680c8dc0 0x7f656815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65680ca1b0 con 0x7f65680c8dc0 2023-09-10T00:13:10.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6568155f60 con 0x7f6568069fa0 2023-09-10T00:13:10.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6568156240 con 0x7f65680aba00 2023-09-10T00:13:10.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56058/0 (socket says 172.21.15.84:56058) 2023-09-10T00:13:10.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 -- 172.21.15.84:0/346437701 learned_addr learned my addr 172.21.15.84:0/346437701 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 -- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568069fa0 msgr2=0x7f6568151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568069fa0 0x7f6568151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 -- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65680c8dc0 msgr2=0x7f656815b580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T00:13:10.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65680c8dc0 0x7f656815b580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 -- 172.21.15.84:0/346437701 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c009500 con 0x7f65680aba00 2023-09-10T00:13:10.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f65677fe640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f655800b3f0 tx=0x7f655800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558011830 con 0x7f65680aba00 2023-09-10T00:13:10.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6568156520 con 0x7f65680aba00 2023-09-10T00:13:10.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 -- 172.21.15.84:0/2559497224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1800d870 msgr2=0x7f4a1800fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 --2- 172.21.15.84:0/2559497224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1800d870 0x7f4a1800fc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c070e80 tx=0x7f4a2401caa0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 -- 172.21.15.84:0/2559497224 shutdown_connections 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 --2- 172.21.15.84:0/2559497224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a1800d870 0x7f4a1800fc60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 -- 172.21.15.84:0/2559497224 >> 172.21.15.84:0/2559497224 conn(0x7f4a2c0c9100 msgr2=0x7f4a2c0c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 -- 172.21.15.84:0/2559497224 shutdown_connections 2023-09-10T00:13:10.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f4a3415c640 1 -- 172.21.15.84:0/2559497224 wait complete. 2023-09-10T00:13:10.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbb74011a80 con 0x7fbb8015db60 2023-09-10T00:13:10.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb74011e90 con 0x7fbb8015db60 2023-09-10T00:13:10.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f034dfda640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 0x7f032c068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8f28004030 con 0x7f8f300ca0c0 2023-09-10T00:13:10.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f8f2cff9640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 0x7f8f18069a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f28083ee0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.046+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6568151850 con 0x7f65680aba00 2023-09-10T00:13:10.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6568073390 con 0x7f65680aba00 2023-09-10T00:13:10.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6558011a80 con 0x7f65680aba00 2023-09-10T00:13:10.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558011e70 con 0x7f65680aba00 2023-09-10T00:13:10.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 Processor -- start 2023-09-10T00:13:10.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f8f2ffff640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 0x7f8f18069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb60005260 con 0x7fbb8015db60 2023-09-10T00:13:10.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f8f2ffff640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 0x7f8f18069a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001980 tx=0x7f8f2400a8d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f034dfda640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 0x7f032c068030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03440af000 tx=0x7f034401b070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbb7401a400 con 0x7fbb8015db60 2023-09-10T00:13:10.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb677fe640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 0x7fbb6c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb740833c0 con 0x7fbb8015db60 2023-09-10T00:13:10.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 -- start start 2023-09-10T00:13:10.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 0x7f4a2c085420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c0c44a0 0x7f4a2c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 0x7f4a2c167550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c20ec20 con 0x7f4a2c1670d0 2023-09-10T00:13:10.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c4e60 con 0x7f4a2c0c44a0 2023-09-10T00:13:10.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f4a3415c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0c2f30 con 0x7f4a1800d870 2023-09-10T00:13:10.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6558024440 con 0x7f65680aba00 2023-09-10T00:13:10.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fdd5800f520 con 0x7fdd700c8600 2023-09-10T00:13:10.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.050+0000 7fdd6cff9640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 0x7fdd50068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7fdd6f7fe640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 0x7fdd50068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f6564ff9640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 0x7f6554068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6558083f20 con 0x7f65680aba00 2023-09-10T00:13:10.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7fbb7effd640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 0x7fbb6c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a31ef8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 0x7f4a2c085420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a31ef8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 0x7f4a2c085420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:56068/0 (socket says 172.21.15.84:56068) 2023-09-10T00:13:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a31ef8640 1 -- 172.21.15.84:0/2285311728 learned_addr learned my addr 172.21.15.84:0/2285311728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7fbb7effd640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 0x7fbb6c0680b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000bc00 tx=0x7fbb7000b390 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f6567fff640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 0x7f6554068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a316f7640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c0c44a0 0x7f4a2c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 0x7f4a2c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 -- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 msgr2=0x7f4a2c085420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 0x7f4a2c085420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 -- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c0c44a0 msgr2=0x7f4a2c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c0c44a0 0x7f4a2c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 -- 172.21.15.84:0/2285311728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c167a90 con 0x7f4a2c1670d0 2023-09-10T00:13:10.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f4a326f9640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 0x7f4a2c167550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c070b60 tx=0x7f4a24004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f6567fff640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 0x7f6554068010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f655c0af000 tx=0x7f655c019610 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7fdd6f7fe640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 0x7fdd50068030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000a790 tx=0x7fdd60008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd58055800 con 0x7fdd700c8600 2023-09-10T00:13:10.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.054+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0338050c60 con 0x7f03480aba00 2023-09-10T00:13:10.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.058+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8f280515d0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.062+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240a5aa0 con 0x7f4a2c1670d0 2023-09-10T00:13:10.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.062+0000 7f4a3415c640 1 -- 172.21.15.84:0/2285311728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c167d20 con 0x7f4a2c1670d0 2023-09-10T00:13:10.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.062+0000 7f4a3415c640 1 -- 172.21.15.84:0/2285311728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c1682e0 con 0x7f4a2c1670d0 2023-09-10T00:13:10.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.062+0000 7f4a3415c640 1 -- 172.21.15.84:0/2285311728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c073390 con 0x7f4a2c1670d0 2023-09-10T00:13:10.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.062+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f65580515f0 con 0x7f65680aba00 2023-09-10T00:13:10.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbb74050b40 con 0x7fbb8015db60 2023-09-10T00:13:10.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fdd58051440 con 0x7fdd700c8600 2023-09-10T00:13:10.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a24006120 con 0x7f4a2c1670d0 2023-09-10T00:13:10.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240a5aa0 con 0x7f4a2c1670d0 2023-09-10T00:13:10.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.070+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4a24006290 con 0x7f4a2c1670d0 2023-09-10T00:13:10.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.070+0000 7f4a227fc640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 0x7f4a100680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.070+0000 7f4a31ef8640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 0x7f4a100680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.070+0000 7f4a31ef8640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 0x7f4a100680d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005e10 tx=0x7f4a280091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.070+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a240ef7d0 con 0x7f4a2c1670d0 2023-09-10T00:13:10.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3112126438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 msgr2=0x7f7a640c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.066+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3112126438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640c8f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7a6406b190 tx=0x7f7a60020760 comp rx=0 tx=0).stop 2023-09-10T00:13:10.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4a240ec2a0 con 0x7f4a2c1670d0 2023-09-10T00:13:10.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3112126438 shutdown_connections 2023-09-10T00:13:10.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3112126438 >> v2:172.21.15.100:3300/0 conn(0x7f7a640c7260 0x7f7a640c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3112126438 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3112126438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640c8f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3112126438 >> 172.21.15.84:0/3112126438 conn(0x7f7a640af490 msgr2=0x7f7a640af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3112126438 shutdown_connections 2023-09-10T00:13:10.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3112126438 wait complete. 2023-09-10T00:13:10.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 Processor -- start 2023-09-10T00:13:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.074+0000 7f7a6b4f8640 1 -- start start 2023-09-10T00:13:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6a4f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6a4f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46320/0 (socket says 172.21.15.84:46320) 2023-09-10T00:13:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406d700 con 0x7f7a640c6e80 2023-09-10T00:13:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6406bfd0 con 0x7f7a640c7260 2023-09-10T00:13:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6b4f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a640854e0 con 0x7f7a640c9ac0 2023-09-10T00:13:10.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6acf7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:43752/0 (socket says 172.21.15.84:43752) 2023-09-10T00:13:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 -- 172.21.15.84:0/3451937907 learned_addr learned my addr 172.21.15.84:0/3451937907 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 -- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 msgr2=0x7f7a640cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 -- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 msgr2=0x7f7a640ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 -- 172.21.15.84:0/3451937907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600104d0 con 0x7f7a640c7260 2023-09-10T00:13:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a6acf7640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T00:13:10.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.078+0000 7f7a69cf5640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e770 tx=0x7f7a5400ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400ccc0 con 0x7f7a640c7260 2023-09-10T00:13:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6406c220 con 0x7f7a640c7260 2023-09-10T00:13:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a64085a20 con 0x7f7a640c7260 2023-09-10T00:13:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a5400ee80 con 0x7f7a640c7260 2023-09-10T00:13:10.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54010690 con 0x7f7a640c7260 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a6a4f6640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c005260 con 0x7f7a640c7260 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7a540107f0 con 0x7f7a640c7260 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 0x7f7a48068000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.082+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a54014070 con 0x7f7a640c7260 2023-09-10T00:13:10.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.086+0000 7f7a6a4f6640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 0x7f7a48068000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.086+0000 7f7a6a4f6640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 0x7f7a48068000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b2000 tx=0x7f7a6001d500 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.094+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7a540516c0 con 0x7f7a640c7260 2023-09-10T00:13:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.338+0000 7fde5da44640 1 -- 172.21.15.84:0/3499697210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fde38005510 con 0x7fde580ca8b0 2023-09-10T00:13:10.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.338+0000 7fde3ffff640 1 -- 172.21.15.84:0/3499697210 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde48051650 con 0x7fde580ca8b0 2023-09-10T00:13:10.341 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 msgr2=0x7fde400681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 0x7fde400681d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0af000 tx=0x7fde4c01b110 comp rx=0 tx=0).stop 2023-09-10T00:13:10.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 msgr2=0x7fde580af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde4800e7a0 tx=0x7fde4800ec60 comp rx=0 tx=0).stop 2023-09-10T00:13:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 shutdown_connections 2023-09-10T00:13:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fde40065d10 0x7fde400681d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde580aff30 0x7fde580c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde580ca8b0 0x7fde580af9f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 --2- 172.21.15.84:0/3499697210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde580c7380 0x7fde580ab6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 >> 172.21.15.84:0/3499697210 conn(0x7fde580cc4e0 msgr2=0x7fde580abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 shutdown_connections 2023-09-10T00:13:10.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.342+0000 7fde3dffb640 1 -- 172.21.15.84:0/3499697210 wait complete. 2023-09-10T00:13:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.358+0000 7f8f366fe640 1 -- 172.21.15.84:0/1666961658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8f100050d0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.358+0000 7f8f2cff9640 1 -- 172.21.15.84:0/1666961658 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f28054bf0 con 0x7f8f300ca0c0 2023-09-10T00:13:10.363 INFO:teuthology.orchestra.run.smithi084.stdout:64424509450 2023-09-10T00:13:10.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.362+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 msgr2=0x7f8f18069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.362+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 0x7f8f18069a60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f24001980 tx=0x7f8f2400a8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.362+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 msgr2=0x7f8f300afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.362+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f300b3720 tx=0x7f8f280092a0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2023-09-10T00:13:10.369 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 shutdown_connections 2023-09-10T00:13:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8f180675a0 0x7f8f18069a60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8f300ca0c0 0x7f8f300afc90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8f300b1440 0x7f8f300c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 --2- 172.21.15.84:0/1666961658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f301f7e10 0x7f8f300b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 >> 172.21.15.84:0/1666961658 conn(0x7f8f300d0b30 msgr2=0x7f8f300b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03300057e0 con 0x7f03480aba00 2023-09-10T00:13:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f033e7fc640 1 -- 172.21.15.84:0/3384233270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0338054280 con 0x7f03480aba00 2023-09-10T00:13:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 shutdown_connections 2023-09-10T00:13:10.373 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f8f167fc640 1 -- 172.21.15.84:0/1666961658 wait complete. 2023-09-10T00:13:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 msgr2=0x7f032c068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 0x7f032c068030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f03440af000 tx=0x7f034401b070 comp rx=0 tx=0).stop 2023-09-10T00:13:10.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 msgr2=0x7f03480c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.366+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c3610 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f033800b460 tx=0x7f033800b920 comp rx=0 tx=0).stop 2023-09-10T00:13:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 shutdown_connections 2023-09-10T00:13:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f032c065b70 0x7f032c068030 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03480c8dc0 0x7f034815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03480aba00 0x7f03480c3610 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f033800b460 tx=0x7f033800b920 comp rx=0 tx=0).stop 2023-09-10T00:13:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 --2- 172.21.15.84:0/3384233270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0348069fa0 0x7f03480c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.370+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 >> 172.21.15.84:0/3384233270 conn(0x7f03480af490 msgr2=0x7f03480c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 shutdown_connections 2023-09-10T00:13:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7f034efdc640 1 -- 172.21.15.84:0/3384233270 wait complete. 2023-09-10T00:13:10.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd540050d0 con 0x7fdd700c8600 2023-09-10T00:13:10.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd6cff9640 1 -- 172.21.15.84:0/3939571926 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd58054a60 con 0x7fdd700c8600 2023-09-10T00:13:10.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb600050d0 con 0x7fbb8015db60 2023-09-10T00:13:10.379 INFO:teuthology.orchestra.run.smithi084.stdout:64424509452 2023-09-10T00:13:10.379 INFO:teuthology.orchestra.run.smithi084.stdout:60129542156 2023-09-10T00:13:10.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fbb677fe640 1 -- 172.21.15.84:0/2392876300 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb74054160 con 0x7fbb8015db60 2023-09-10T00:13:10.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6568156380 con 0x7f65680aba00 2023-09-10T00:13:10.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 msgr2=0x7fdd50068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 0x7fdd50068030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000a790 tx=0x7fdd60008040 comp rx=0 tx=0).stop 2023-09-10T00:13:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 msgr2=0x7fdd700c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b4d0 tx=0x7fdd5800b990 comp rx=0 tx=0).stop 2023-09-10T00:13:10.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.374+0000 7f6564ff9640 1 -- 172.21.15.84:0/346437701 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6568156380 con 0x7f65680aba00 2023-09-10T00:13:10.382 INFO:teuthology.orchestra.run.smithi084.stdout:64424509452 2023-09-10T00:13:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 shutdown_connections 2023-09-10T00:13:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdd50065b70 0x7fdd50068030 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd7015abf0 0x7fdd700c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd700c8600 0x7fdd700c5fb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 --2- 172.21.15.84:0/3939571926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd7006d570 0x7fdd7014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 >> 172.21.15.84:0/3939571926 conn(0x7fdd700c9100 msgr2=0x7fdd700c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 msgr2=0x7fbb6c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 0x7fbb6c0680b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000bc00 tx=0x7fbb7000b390 comp rx=0 tx=0).stop 2023-09-10T00:13:10.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 msgr2=0x7fbb800a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 0x7fbb800a5e40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400b3e0 tx=0x7fbb7400b8a0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 shutdown_connections 2023-09-10T00:13:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbb6c065bf0 0x7fbb6c0680b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb8015db60 0x7fbb800a5e40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb8015ebf0 0x7fbb8015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/2392876300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbb8006d390 0x7fbb80200a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 >> 172.21.15.84:0/2392876300 conn(0x7fbb800ca0a0 msgr2=0x7fbb800c3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 shutdown_connections 2023-09-10T00:13:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fbb7ffff640 1 -- 172.21.15.84:0/2392876300 wait complete. 2023-09-10T00:13:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 shutdown_connections 2023-09-10T00:13:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7fdd75b4e640 1 -- 172.21.15.84:0/3939571926 wait complete. 2023-09-10T00:13:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 msgr2=0x7f6554068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f4a3415c640 1 -- 172.21.15.84:0/2285311728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4a2c0af080 con 0x7f4a2c1670d0 2023-09-10T00:13:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 0x7f6554068010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f655c0af000 tx=0x7f655c019610 comp rx=0 tx=0).stop 2023-09-10T00:13:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 msgr2=0x7f656815b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f655800b3f0 tx=0x7f655800b8b0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 shutdown_connections 2023-09-10T00:13:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6554065b50 0x7f6554068010 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f655c0af000 tx=0x7f655c019610 comp rx=0 tx=0).stop 2023-09-10T00:13:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f65680c8dc0 0x7f656815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65680aba00 0x7f656815b040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 --2- 172.21.15.84:0/346437701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6568069fa0 0x7f6568151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f4a227fc640 1 -- 172.21.15.84:0/2285311728 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a240ec440 con 0x7f4a2c1670d0 2023-09-10T00:13:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.378+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 >> 172.21.15.84:0/346437701 conn(0x7f65680af490 msgr2=0x7f656806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.393 INFO:teuthology.orchestra.run.smithi084.stdout:64424509452 2023-09-10T00:13:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 msgr2=0x7f4a100680d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 0x7f4a100680d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4a28005e10 tx=0x7f4a280091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 msgr2=0x7f4a2c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 shutdown_connections 2023-09-10T00:13:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f656d164640 1 -- 172.21.15.84:0/346437701 wait complete. 2023-09-10T00:13:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 0x7f4a2c167550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c070b60 tx=0x7f4a24004fd0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 shutdown_connections 2023-09-10T00:13:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4a10065c10 0x7f4a100680d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4a2c1670d0 0x7f4a2c167550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a2c0c44a0 0x7f4a2c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.382+0000 7f4a0ffff640 1 --2- 172.21.15.84:0/2285311728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a1800d870 0x7f4a2c085420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.386+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 >> 172.21.15.84:0/2285311728 conn(0x7f4a2c0c9100 msgr2=0x7f4a2c0cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.386+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 shutdown_connections 2023-09-10T00:13:10.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.386+0000 7f4a0ffff640 1 -- 172.21.15.84:0/2285311728 wait complete. 2023-09-10T00:13:10.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.4 2023-09-10T00:13:10.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7a4c0057e0 con 0x7f7a640c7260 2023-09-10T00:13:10.400 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a5affd640 1 -- 172.21.15.84:0/3451937907 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a54054ce0 con 0x7f7a640c7260 2023-09-10T00:13:10.401 INFO:teuthology.orchestra.run.smithi084.stdout:60129542155 2023-09-10T00:13:10.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 msgr2=0x7f7a48068000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 0x7f7a48068000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b2000 tx=0x7f7a6001d500 comp rx=0 tx=0).stop 2023-09-10T00:13:10.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 msgr2=0x7f7a64084ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e770 tx=0x7f7a5400ec30 comp rx=0 tx=0).stop 2023-09-10T00:13:10.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 shutdown_connections 2023-09-10T00:13:10.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7a48065b40 0x7f7a48068000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7a640c9ac0 0x7f7a640cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a640c7260 0x7f7a64084ba0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 --2- 172.21.15.84:0/3451937907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7a640c6e80 0x7f7a640ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 >> 172.21.15.84:0/3451937907 conn(0x7f7a640af490 msgr2=0x7f7a6408be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 shutdown_connections 2023-09-10T00:13:10.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.398+0000 7f7a6b4f8640 1 -- 172.21.15.84:0/3451937907 wait complete. 2023-09-10T00:13:10.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.0 2023-09-10T00:13:10.411 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2023-09-10T00:13:10.413 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.414 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.2 2023-09-10T00:13:10.414 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.7 2023-09-10T00:13:10.416 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.6 2023-09-10T00:13:10.419 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-09-10T00:13:10.424 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:10.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-10T00:13:10.424 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:13:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- 172.21.15.84:0/2311075125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e015ab80 msgr2=0x7ff7e00cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 --2- 172.21.15.84:0/2311075125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e015ab80 0x7ff7e00cbb20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009840 tx=0x7ff7d001eff0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- 172.21.15.84:0/2311075125 shutdown_connections 2023-09-10T00:13:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 --2- 172.21.15.84:0/2311075125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e00afba0 0x7ff7e00cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 --2- 172.21.15.84:0/2311075125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e015ab80 0x7ff7e00cbb20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- 172.21.15.84:0/2311075125 >> 172.21.15.84:0/2311075125 conn(0x7ff7e00b25b0 msgr2=0x7ff7e00b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- 172.21.15.84:0/2311075125 shutdown_connections 2023-09-10T00:13:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- 172.21.15.84:0/2311075125 wait complete. 2023-09-10T00:13:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 Processor -- start 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.566+0000 7ff7e540b640 1 -- start start 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 0x7ff7e01f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e015ab80 0x7ff7e01f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01e5ec0 con 0x7ff7e015af60 2023-09-10T00:13:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01e3360 con 0x7ff7e00afba0 2023-09-10T00:13:10.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01e3620 con 0x7ff7e015ab80 2023-09-10T00:13:10.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46324/0 (socket says 172.21.15.84:46324) 2023-09-10T00:13:10.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 -- 172.21.15.84:0/1951890329 learned_addr learned my addr 172.21.15.84:0/1951890329 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7de7fc640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e015ab80 0x7ff7e01f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7deffd640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 0x7ff7e01f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 -- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e015ab80 msgr2=0x7ff7e01f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e015ab80 0x7ff7e01f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 -- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 msgr2=0x7ff7e01f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 0x7ff7e01f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 -- 172.21.15.84:0/1951890329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00094a0 con 0x7ff7e015af60 2023-09-10T00:13:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7deffd640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 0x7ff7e01f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7df7fe640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800eb20 tx=0x7ff7d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8004b30 con 0x7ff7e015af60 2023-09-10T00:13:10.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7d8004cb0 con 0x7ff7e015af60 2023-09-10T00:13:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e01e3900 con 0x7ff7e015af60 2023-09-10T00:13:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8005280 con 0x7ff7e015af60 2023-09-10T00:13:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e01e3ec0 con 0x7ff7e015af60 2023-09-10T00:13:10.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e01e40b0 con 0x7ff7e015af60 2023-09-10T00:13:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff7d80053e0 con 0x7ff7e015af60 2023-09-10T00:13:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 0x7ff7cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff7d8014070 con 0x7ff7e015af60 2023-09-10T00:13:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7deffd640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 0x7ff7cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.570+0000 7ff7deffd640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 0x7ff7cc067fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00b2000 tx=0x7ff7d001d830 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.574+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff7d8051a70 con 0x7ff7e015af60 2023-09-10T00:13:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.714+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7e006c610 con 0x7ff7cc065b20 2023-09-10T00:13:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.738+0000 7ff7c77fe640 1 -- 172.21.15.84:0/1951890329 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345238 (secure 0 0 0) 0x7ff7e006c610 con 0x7ff7cc065b20 2023-09-10T00:13:10.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:10.746 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:13:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 msgr2=0x7ff7cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 0x7ff7cc067fe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00b2000 tx=0x7ff7d001d830 comp rx=0 tx=0).stop 2023-09-10T00:13:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 msgr2=0x7ff7e01e5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7d800eb20 tx=0x7ff7d800c2d0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 shutdown_connections 2023-09-10T00:13:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7cc065b20 0x7ff7cc067fe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7e015af60 0x7ff7e01e5170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7e015ab80 0x7ff7e01f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 --2- 172.21.15.84:0/1951890329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7e00afba0 0x7ff7e01f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 >> 172.21.15.84:0/1951890329 conn(0x7ff7e00b25b0 msgr2=0x7ff7e00c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 shutdown_connections 2023-09-10T00:13:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.742+0000 7ff7e540b640 1 -- 172.21.15.84:0/1951890329 wait complete. 2023-09-10T00:13:10.761 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-09-10T00:13:09.818959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3416064,"data_stored":2057454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004904"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782159+0000","last_change":"2023-09-10T00:12:41.509675+0000","last_active":"2023-09-10T00:12:47.782159+0000","last_peered":"2023-09-10T00:12:47.782159+0000","last_clean":"2023-09-10T00:12:47.782159+0000","last_became_active":"2023-09-10T00:12:41.509279+0000","last_became_peered":"2023-09-10T00:12:41.509279+0000","last_unstale":"2023-09-10T00:12:47.782159+0000","last_undegraded":"2023-09-10T00:12:47.782159+0000","last_fullsized":"2023-09-10T00:12:47.782159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783838+0000","last_change":"2023-09-10T00:12:42.539901+0000","last_active":"2023-09-10T00:12:47.783838+0000","last_peered":"2023-09-10T00:12:47.783838+0000","last_clean":"2023-09-10T00:12:47.783838+0000","last_became_active":"2023-09-10T00:12:42.539648+0000","last_became_peered":"2023-09-10T00:12:42.539648+0000","last_unstale":"2023-09-10T00:12:47.783838+0000","last_undegraded":"2023-09-10T00:12:47.783838+0000","last_fullsized":"2023-09-10T00:12:47.783838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577941+0000","last_change":"2023-09-10T00:12:47.443681+0000","last_active":"2023-09-10T00:12:48.577941+0000","last_peered":"2023-09-10T00:12:48.577941+0000","last_clean":"2023-09-10T00:12:48.577941+0000","last_became_active":"2023-09-10T00:12:47.442588+0000","last_became_peered":"2023-09-10T00:12:47.442588+0000","last_unstale":"2023-09-10T00:12:48.577941+0000","last_undegraded":"2023-09-10T00:12:48.577941+0000","last_fullsized":"2023-09-10T00:12:48.577941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:30:17.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784136+0000","last_change":"2023-09-10T00:12:41.502405+0000","last_active":"2023-09-10T00:12:47.784136+0000","last_peered":"2023-09-10T00:12:47.784136+0000","last_clean":"2023-09-10T00:12:47.784136+0000","last_became_active":"2023-09-10T00:12:41.502081+0000","last_became_peered":"2023-09-10T00:12:41.502081+0000","last_unstale":"2023-09-10T00:12:47.784136+0000","last_undegraded":"2023-09-10T00:12:47.784136+0000","last_fullsized":"2023-09-10T00:12:47.784136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781838+0000","last_change":"2023-09-10T00:12:42.550279+0000","last_active":"2023-09-10T00:12:47.781838+0000","last_peered":"2023-09-10T00:12:47.781838+0000","last_clean":"2023-09-10T00:12:47.781838+0000","last_became_active":"2023-09-10T00:12:42.549968+0000","last_became_peered":"2023-09-10T00:12:42.549968+0000","last_unstale":"2023-09-10T00:12:47.781838+0000","last_undegraded":"2023-09-10T00:12:47.781838+0000","last_fullsized":"2023-09-10T00:12:47.781838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581814+0000","last_change":"2023-09-10T00:12:46.587407+0000","last_active":"2023-09-10T00:12:48.581814+0000","last_peered":"2023-09-10T00:12:48.581814+0000","last_clean":"2023-09-10T00:12:48.581814+0000","last_became_active":"2023-09-10T00:12:46.585950+0000","last_became_peered":"2023-09-10T00:12:46.585950+0000","last_unstale":"2023-09-10T00:12:48.581814+0000","last_undegraded":"2023-09-10T00:12:48.581814+0000","last_fullsized":"2023-09-10T00:12:48.581814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:31.560504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783664+0000","last_change":"2023-09-10T00:12:41.527986+0000","last_active":"2023-09-10T00:12:47.783664+0000","last_peered":"2023-09-10T00:12:47.783664+0000","last_clean":"2023-09-10T00:12:47.783664+0000","last_became_active":"2023-09-10T00:12:41.527417+0000","last_became_peered":"2023-09-10T00:12:41.527417+0000","last_unstale":"2023-09-10T00:12:47.783664+0000","last_undegraded":"2023-09-10T00:12:47.783664+0000","last_fullsized":"2023-09-10T00:12:47.783664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781841+0000","last_change":"2023-09-10T00:12:42.549603+0000","last_active":"2023-09-10T00:12:47.781841+0000","last_peered":"2023-09-10T00:12:47.781841+0000","last_clean":"2023-09-10T00:12:47.781841+0000","last_became_active":"2023-09-10T00:12:42.549082+0000","last_became_peered":"2023-09-10T00:12:42.549082+0000","last_unstale":"2023-09-10T00:12:47.781841+0000","last_undegraded":"2023-09-10T00:12:47.781841+0000","last_fullsized":"2023-09-10T00:12:47.781841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583016+0000","last_change":"2023-09-10T00:12:46.598936+0000","last_active":"2023-09-10T00:12:48.583016+0000","last_peered":"2023-09-10T00:12:48.583016+0000","last_clean":"2023-09-10T00:12:48.583016+0000","last_became_active":"2023-09-10T00:12:46.595513+0000","last_became_peered":"2023-09-10T00:12:46.595513+0000","last_unstale":"2023-09-10T00:12:48.583016+0000","last_undegraded":"2023-09-10T00:12:48.583016+0000","last_fullsized":"2023-09-10T00:12:48.583016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783420+0000","last_change":"2023-09-10T00:12:41.528161+0000","last_active":"2023-09-10T00:12:47.783420+0000","last_peered":"2023-09-10T00:12:47.783420+0000","last_clean":"2023-09-10T00:12:47.783420+0000","last_became_active":"2023-09-10T00:12:41.527502+0000","last_became_peered":"2023-09-10T00:12:41.527502+0000","last_unstale":"2023-09-10T00:12:47.783420+0000","last_undegraded":"2023-09-10T00:12:47.783420+0000","last_fullsized":"2023-09-10T00:12:47.783420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782651+0000","last_change":"2023-09-10T00:12:42.540628+0000","last_active":"2023-09-10T00:12:47.782651+0000","last_peered":"2023-09-10T00:12:47.782651+0000","last_clean":"2023-09-10T00:12:47.782651+0000","last_became_active":"2023-09-10T00:12:42.539869+0000","last_became_peered":"2023-09-10T00:12:42.539869+0000","last_unstale":"2023-09-10T00:12:47.782651+0000","last_undegraded":"2023-09-10T00:12:47.782651+0000","last_fullsized":"2023-09-10T00:12:47.782651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582233+0000","last_change":"2023-09-10T00:12:46.591413+0000","last_active":"2023-09-10T00:12:48.582233+0000","last_peered":"2023-09-10T00:12:48.582233+0000","last_clean":"2023-09-10T00:12:48.582233+0000","last_became_active":"2023-09-10T00:12:46.590270+0000","last_became_peered":"2023-09-10T00:12:46.590270+0000","last_unstale":"2023-09-10T00:12:48.582233+0000","last_undegraded":"2023-09-10T00:12:48.582233+0000","last_fullsized":"2023-09-10T00:12:48.582233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:43:11.882300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581794+0000","last_change":"2023-09-10T00:12:42.507279+0000","last_active":"2023-09-10T00:12:47.581794+0000","last_peered":"2023-09-10T00:12:47.581794+0000","last_clean":"2023-09-10T00:12:47.581794+0000","last_became_active":"2023-09-10T00:12:42.506014+0000","last_became_peered":"2023-09-10T00:12:42.506014+0000","last_unstale":"2023-09-10T00:12:47.581794+0000","last_undegraded":"2023-09-10T00:12:47.581794+0000","last_fullsized":"2023-09-10T00:12:47.581794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783530+0000","last_change":"2023-09-10T00:12:41.530493+0000","last_active":"2023-09-10T00:12:47.783530+0000","last_peered":"2023-09-10T00:12:47.783530+0000","last_clean":"2023-09-10T00:12:47.783530+0000","last_became_active":"2023-09-10T00:12:41.529930+0000","last_became_peered":"2023-09-10T00:12:41.529930+0000","last_unstale":"2023-09-10T00:12:47.783530+0000","last_undegraded":"2023-09-10T00:12:47.783530+0000","last_fullsized":"2023-09-10T00:12:47.783530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584979+0000","last_change":"2023-09-10T00:12:46.585841+0000","last_active":"2023-09-10T00:12:48.584979+0000","last_peered":"2023-09-10T00:12:48.584979+0000","last_clean":"2023-09-10T00:12:48.584979+0000","last_became_active":"2023-09-10T00:12:46.584664+0000","last_became_peered":"2023-09-10T00:12:46.584664+0000","last_unstale":"2023-09-10T00:12:48.584979+0000","last_undegraded":"2023-09-10T00:12:48.584979+0000","last_fullsized":"2023-09-10T00:12:48.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783202+0000","last_change":"2023-09-10T00:12:42.503145+0000","last_active":"2023-09-10T00:12:47.783202+0000","last_peered":"2023-09-10T00:12:47.783202+0000","last_clean":"2023-09-10T00:12:47.783202+0000","last_became_active":"2023-09-10T00:12:42.502860+0000","last_became_peered":"2023-09-10T00:12:42.502860+0000","last_unstale":"2023-09-10T00:12:47.783202+0000","last_undegraded":"2023-09-10T00:12:47.783202+0000","last_fullsized":"2023-09-10T00:12:47.783202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615505+0000","last_change":"2023-09-10T00:12:41.495145+0000","last_active":"2023-09-10T00:12:47.615505+0000","last_peered":"2023-09-10T00:12:47.615505+0000","last_clean":"2023-09-10T00:12:47.615505+0000","last_became_active":"2023-09-10T00:12:41.494723+0000","last_became_peered":"2023-09-10T00:12:41.494723+0000","last_unstale":"2023-09-10T00:12:47.615505+0000","last_undegraded":"2023-09-10T00:12:47.615505+0000","last_fullsized":"2023-09-10T00:12:47.615505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:28:44.771070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584304+0000","last_change":"2023-09-10T00:12:46.598895+0000","last_active":"2023-09-10T00:12:48.584304+0000","last_peered":"2023-09-10T00:12:48.584304+0000","last_clean":"2023-09-10T00:12:48.584304+0000","last_became_active":"2023-09-10T00:12:46.597512+0000","last_became_peered":"2023-09-10T00:12:46.597512+0000","last_unstale":"2023-09-10T00:12:48.584304+0000","last_undegraded":"2023-09-10T00:12:48.584304+0000","last_fullsized":"2023-09-10T00:12:48.584304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782945+0000","last_change":"2023-09-10T00:12:42.506592+0000","last_active":"2023-09-10T00:12:47.782945+0000","last_peered":"2023-09-10T00:12:47.782945+0000","last_clean":"2023-09-10T00:12:47.782945+0000","last_became_active":"2023-09-10T00:12:42.498699+0000","last_became_peered":"2023-09-10T00:12:42.498699+0000","last_unstale":"2023-09-10T00:12:47.782945+0000","last_undegraded":"2023-09-10T00:12:47.782945+0000","last_fullsized":"2023-09-10T00:12:47.782945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614899+0000","last_change":"2023-09-10T00:12:41.511349+0000","last_active":"2023-09-10T00:12:47.614899+0000","last_peered":"2023-09-10T00:12:47.614899+0000","last_clean":"2023-09-10T00:12:47.614899+0000","last_became_active":"2023-09-10T00:12:41.511068+0000","last_became_peered":"2023-09-10T00:12:41.511068+0000","last_unstale":"2023-09-10T00:12:47.614899+0000","last_undegraded":"2023-09-10T00:12:47.614899+0000","last_fullsized":"2023-09-10T00:12:47.614899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:15.836419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224891+0000","last_change":"2023-09-10T00:12:47.444639+0000","last_active":"2023-09-10T00:12:49.224891+0000","last_peered":"2023-09-10T00:12:49.224891+0000","last_clean":"2023-09-10T00:12:49.224891+0000","last_became_active":"2023-09-10T00:12:47.443285+0000","last_became_peered":"2023-09-10T00:12:47.443285+0000","last_unstale":"2023-09-10T00:12:49.224891+0000","last_undegraded":"2023-09-10T00:12:49.224891+0000","last_fullsized":"2023-09-10T00:12:49.224891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:23.785184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580956+0000","last_change":"2023-09-10T00:12:42.502827+0000","last_active":"2023-09-10T00:12:47.580956+0000","last_peered":"2023-09-10T00:12:47.580956+0000","last_clean":"2023-09-10T00:12:47.580956+0000","last_became_active":"2023-09-10T00:12:42.498059+0000","last_became_peered":"2023-09-10T00:12:42.498059+0000","last_unstale":"2023-09-10T00:12:47.580956+0000","last_undegraded":"2023-09-10T00:12:47.580956+0000","last_fullsized":"2023-09-10T00:12:47.580956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:30.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782172+0000","last_change":"2023-09-10T00:12:41.522787+0000","last_active":"2023-09-10T00:12:47.782172+0000","last_peered":"2023-09-10T00:12:47.782172+0000","last_clean":"2023-09-10T00:12:47.782172+0000","last_became_active":"2023-09-10T00:12:41.521261+0000","last_became_peered":"2023-09-10T00:12:41.521261+0000","last_unstale":"2023-09-10T00:12:47.782172+0000","last_undegraded":"2023-09-10T00:12:47.782172+0000","last_fullsized":"2023-09-10T00:12:47.782172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:04:32.449308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584798+0000","last_change":"2023-09-10T00:12:46.594098+0000","last_active":"2023-09-10T00:12:48.584798+0000","last_peered":"2023-09-10T00:12:48.584798+0000","last_clean":"2023-09-10T00:12:48.584798+0000","last_became_active":"2023-09-10T00:12:46.592902+0000","last_became_peered":"2023-09-10T00:12:46.592902+0000","last_unstale":"2023-09-10T00:12:48.584798+0000","last_undegraded":"2023-09-10T00:12:48.584798+0000","last_fullsized":"2023-09-10T00:12:48.584798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781833+0000","last_change":"2023-09-10T00:12:42.494258+0000","last_active":"2023-09-10T00:12:47.781833+0000","last_peered":"2023-09-10T00:12:47.781833+0000","last_clean":"2023-09-10T00:12:47.781833+0000","last_became_active":"2023-09-10T00:12:42.493975+0000","last_became_peered":"2023-09-10T00:12:42.493975+0000","last_unstale":"2023-09-10T00:12:47.781833+0000","last_undegraded":"2023-09-10T00:12:47.781833+0000","last_fullsized":"2023-09-10T00:12:47.781833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583823+0000","last_change":"2023-09-10T00:12:41.507450+0000","last_active":"2023-09-10T00:12:47.583823+0000","last_peered":"2023-09-10T00:12:47.583823+0000","last_clean":"2023-09-10T00:12:47.583823+0000","last_became_active":"2023-09-10T00:12:41.506687+0000","last_became_peered":"2023-09-10T00:12:41.506687+0000","last_unstale":"2023-09-10T00:12:47.583823+0000","last_undegraded":"2023-09-10T00:12:47.583823+0000","last_fullsized":"2023-09-10T00:12:47.583823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582305+0000","last_change":"2023-09-10T00:12:47.439167+0000","last_active":"2023-09-10T00:12:48.582305+0000","last_peered":"2023-09-10T00:12:48.582305+0000","last_clean":"2023-09-10T00:12:48.582305+0000","last_became_active":"2023-09-10T00:12:47.438136+0000","last_became_peered":"2023-09-10T00:12:47.438136+0000","last_unstale":"2023-09-10T00:12:48.582305+0000","last_undegraded":"2023-09-10T00:12:48.582305+0000","last_fullsized":"2023-09-10T00:12:48.582305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:39:24.652596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784017+0000","last_change":"2023-09-10T00:12:42.505311+0000","last_active":"2023-09-10T00:12:47.784017+0000","last_peered":"2023-09-10T00:12:47.784017+0000","last_clean":"2023-09-10T00:12:47.784017+0000","last_became_active":"2023-09-10T00:12:42.504994+0000","last_became_peered":"2023-09-10T00:12:42.504994+0000","last_unstale":"2023-09-10T00:12:47.784017+0000","last_undegraded":"2023-09-10T00:12:47.784017+0000","last_fullsized":"2023-09-10T00:12:47.784017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615569+0000","last_change":"2023-09-10T00:12:41.511281+0000","last_active":"2023-09-10T00:12:47.615569+0000","last_peered":"2023-09-10T00:12:47.615569+0000","last_clean":"2023-09-10T00:12:47.615569+0000","last_became_active":"2023-09-10T00:12:41.510955+0000","last_became_peered":"2023-09-10T00:12:41.510955+0000","last_unstale":"2023-09-10T00:12:47.615569+0000","last_undegraded":"2023-09-10T00:12:47.615569+0000","last_fullsized":"2023-09-10T00:12:47.615569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:04:20.102763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577831+0000","last_change":"2023-09-10T00:12:47.439819+0000","last_active":"2023-09-10T00:12:48.577831+0000","last_peered":"2023-09-10T00:12:48.577831+0000","last_clean":"2023-09-10T00:12:48.577831+0000","last_became_active":"2023-09-10T00:12:47.438387+0000","last_became_peered":"2023-09-10T00:12:47.438387+0000","last_unstale":"2023-09-10T00:12:48.577831+0000","last_undegraded":"2023-09-10T00:12:48.577831+0000","last_fullsized":"2023-09-10T00:12:48.577831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:19:55.443215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615124+0000","last_change":"2023-09-10T00:12:42.505051+0000","last_active":"2023-09-10T00:12:47.615124+0000","last_peered":"2023-09-10T00:12:47.615124+0000","last_clean":"2023-09-10T00:12:47.615124+0000","last_became_active":"2023-09-10T00:12:42.503680+0000","last_became_peered":"2023-09-10T00:12:42.503680+0000","last_unstale":"2023-09-10T00:12:47.615124+0000","last_undegraded":"2023-09-10T00:12:47.615124+0000","last_fullsized":"2023-09-10T00:12:47.615124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:32.318944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:41.530921+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:41.529005+0000","last_became_peered":"2023-09-10T00:12:41.529005+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:39.114481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222557+0000","last_change":"2023-09-10T00:12:47.432879+0000","last_active":"2023-09-10T00:12:49.222557+0000","last_peered":"2023-09-10T00:12:49.222557+0000","last_clean":"2023-09-10T00:12:49.222557+0000","last_became_active":"2023-09-10T00:12:47.431809+0000","last_became_peered":"2023-09-10T00:12:47.431809+0000","last_unstale":"2023-09-10T00:12:49.222557+0000","last_undegraded":"2023-09-10T00:12:49.222557+0000","last_fullsized":"2023-09-10T00:12:49.222557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782710+0000","last_change":"2023-09-10T00:12:42.539827+0000","last_active":"2023-09-10T00:12:47.782710+0000","last_peered":"2023-09-10T00:12:47.782710+0000","last_clean":"2023-09-10T00:12:47.782710+0000","last_became_active":"2023-09-10T00:12:42.537005+0000","last_became_peered":"2023-09-10T00:12:42.537005+0000","last_unstale":"2023-09-10T00:12:47.782710+0000","last_undegraded":"2023-09-10T00:12:47.782710+0000","last_fullsized":"2023-09-10T00:12:47.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615250+0000","last_change":"2023-09-10T00:12:41.502711+0000","last_active":"2023-09-10T00:12:47.615250+0000","last_peered":"2023-09-10T00:12:47.615250+0000","last_clean":"2023-09-10T00:12:47.615250+0000","last_became_active":"2023-09-10T00:12:41.501978+0000","last_became_peered":"2023-09-10T00:12:41.501978+0000","last_unstale":"2023-09-10T00:12:47.615250+0000","last_undegraded":"2023-09-10T00:12:47.615250+0000","last_fullsized":"2023-09-10T00:12:47.615250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:02:42.904824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223956+0000","last_change":"2023-09-10T00:12:46.590131+0000","last_active":"2023-09-10T00:12:49.223956+0000","last_peered":"2023-09-10T00:12:49.223956+0000","last_clean":"2023-09-10T00:12:49.223956+0000","last_became_active":"2023-09-10T00:12:46.589585+0000","last_became_peered":"2023-09-10T00:12:46.589585+0000","last_unstale":"2023-09-10T00:12:49.223956+0000","last_undegraded":"2023-09-10T00:12:49.223956+0000","last_fullsized":"2023-09-10T00:12:49.223956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:27:21.324259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581586+0000","last_change":"2023-09-10T00:12:42.487629+0000","last_active":"2023-09-10T00:12:47.581586+0000","last_peered":"2023-09-10T00:12:47.581586+0000","last_clean":"2023-09-10T00:12:47.581586+0000","last_became_active":"2023-09-10T00:12:42.486705+0000","last_became_peered":"2023-09-10T00:12:42.486705+0000","last_unstale":"2023-09-10T00:12:47.581586+0000","last_undegraded":"2023-09-10T00:12:47.581586+0000","last_fullsized":"2023-09-10T00:12:47.581586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:34:10.530303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782116+0000","last_change":"2023-09-10T00:12:41.524050+0000","last_active":"2023-09-10T00:12:47.782116+0000","last_peered":"2023-09-10T00:12:47.782116+0000","last_clean":"2023-09-10T00:12:47.782116+0000","last_became_active":"2023-09-10T00:12:41.523285+0000","last_became_peered":"2023-09-10T00:12:41.523285+0000","last_unstale":"2023-09-10T00:12:47.782116+0000","last_undegraded":"2023-09-10T00:12:47.782116+0000","last_fullsized":"2023-09-10T00:12:47.782116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224831+0000","last_change":"2023-09-10T00:12:46.591434+0000","last_active":"2023-09-10T00:12:49.224831+0000","last_peered":"2023-09-10T00:12:49.224831+0000","last_clean":"2023-09-10T00:12:49.224831+0000","last_became_active":"2023-09-10T00:12:46.590715+0000","last_became_peered":"2023-09-10T00:12:46.590715+0000","last_unstale":"2023-09-10T00:12:49.224831+0000","last_undegraded":"2023-09-10T00:12:49.224831+0000","last_fullsized":"2023-09-10T00:12:49.224831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:01:46.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615490+0000","last_change":"2023-09-10T00:12:42.497905+0000","last_active":"2023-09-10T00:12:47.615490+0000","last_peered":"2023-09-10T00:12:47.615490+0000","last_clean":"2023-09-10T00:12:47.615490+0000","last_became_active":"2023-09-10T00:12:42.497598+0000","last_became_peered":"2023-09-10T00:12:42.497598+0000","last_unstale":"2023-09-10T00:12:47.615490+0000","last_undegraded":"2023-09-10T00:12:47.615490+0000","last_fullsized":"2023-09-10T00:12:47.615490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:39:55.974777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577625+0000","last_change":"2023-09-10T00:12:41.498033+0000","last_active":"2023-09-10T00:12:47.577625+0000","last_peered":"2023-09-10T00:12:47.577625+0000","last_clean":"2023-09-10T00:12:47.577625+0000","last_became_active":"2023-09-10T00:12:41.497632+0000","last_became_peered":"2023-09-10T00:12:41.497632+0000","last_unstale":"2023-09-10T00:12:47.577625+0000","last_undegraded":"2023-09-10T00:12:47.577625+0000","last_fullsized":"2023-09-10T00:12:47.577625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:53:47.827726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224987+0000","last_change":"2023-09-10T00:12:46.589989+0000","last_active":"2023-09-10T00:12:49.224987+0000","last_peered":"2023-09-10T00:12:49.224987+0000","last_clean":"2023-09-10T00:12:49.224987+0000","last_became_active":"2023-09-10T00:12:46.589560+0000","last_became_peered":"2023-09-10T00:12:46.589560+0000","last_unstale":"2023-09-10T00:12:49.224987+0000","last_undegraded":"2023-09-10T00:12:49.224987+0000","last_fullsized":"2023-09-10T00:12:49.224987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:23:04.922319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780468+0000","last_change":"2023-09-10T00:12:42.492499+0000","last_active":"2023-09-10T00:12:47.780468+0000","last_peered":"2023-09-10T00:12:47.780468+0000","last_clean":"2023-09-10T00:12:47.780468+0000","last_became_active":"2023-09-10T00:12:42.492155+0000","last_became_peered":"2023-09-10T00:12:42.492155+0000","last_unstale":"2023-09-10T00:12:47.780468+0000","last_undegraded":"2023-09-10T00:12:47.780468+0000","last_fullsized":"2023-09-10T00:12:47.780468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:01.022446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782334+0000","last_change":"2023-09-10T00:12:41.523334+0000","last_active":"2023-09-10T00:12:47.782334+0000","last_peered":"2023-09-10T00:12:47.782334+0000","last_clean":"2023-09-10T00:12:47.782334+0000","last_became_active":"2023-09-10T00:12:41.522077+0000","last_became_peered":"2023-09-10T00:12:41.522077+0000","last_unstale":"2023-09-10T00:12:47.782334+0000","last_undegraded":"2023-09-10T00:12:47.782334+0000","last_fullsized":"2023-09-10T00:12:47.782334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:45:56.684537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223676+0000","last_change":"2023-09-10T00:12:47.432900+0000","last_active":"2023-09-10T00:12:49.223676+0000","last_peered":"2023-09-10T00:12:49.223676+0000","last_clean":"2023-09-10T00:12:49.223676+0000","last_became_active":"2023-09-10T00:12:47.431680+0000","last_became_peered":"2023-09-10T00:12:47.431680+0000","last_unstale":"2023-09-10T00:12:49.223676+0000","last_undegraded":"2023-09-10T00:12:49.223676+0000","last_fullsized":"2023-09-10T00:12:49.223676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782928+0000","last_change":"2023-09-10T00:12:42.550864+0000","last_active":"2023-09-10T00:12:47.782928+0000","last_peered":"2023-09-10T00:12:47.782928+0000","last_clean":"2023-09-10T00:12:47.782928+0000","last_became_active":"2023-09-10T00:12:42.550585+0000","last_became_peered":"2023-09-10T00:12:42.550585+0000","last_unstale":"2023-09-10T00:12:47.782928+0000","last_undegraded":"2023-09-10T00:12:47.782928+0000","last_fullsized":"2023-09-10T00:12:47.782928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781180+0000","last_change":"2023-09-10T00:12:41.519797+0000","last_active":"2023-09-10T00:12:47.781180+0000","last_peered":"2023-09-10T00:12:47.781180+0000","last_clean":"2023-09-10T00:12:47.781180+0000","last_became_active":"2023-09-10T00:12:41.519164+0000","last_became_peered":"2023-09-10T00:12:41.519164+0000","last_unstale":"2023-09-10T00:12:47.781180+0000","last_undegraded":"2023-09-10T00:12:47.781180+0000","last_fullsized":"2023-09-10T00:12:47.781180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782450+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:12:47.782450+0000","last_peered":"2023-09-10T00:12:47.782450+0000","last_clean":"2023-09-10T00:12:47.782450+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:12:47.782450+0000","last_undegraded":"2023-09-10T00:12:47.782450+0000","last_fullsized":"2023-09-10T00:12:47.782450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584664+0000","last_change":"2023-09-10T00:12:47.439252+0000","last_active":"2023-09-10T00:12:48.584664+0000","last_peered":"2023-09-10T00:12:48.584664+0000","last_clean":"2023-09-10T00:12:48.584664+0000","last_became_active":"2023-09-10T00:12:47.438174+0000","last_became_peered":"2023-09-10T00:12:47.438174+0000","last_unstale":"2023-09-10T00:12:48.584664+0000","last_undegraded":"2023-09-10T00:12:48.584664+0000","last_fullsized":"2023-09-10T00:12:48.584664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:57.581942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783443+0000","last_change":"2023-09-10T00:12:42.551864+0000","last_active":"2023-09-10T00:12:47.783443+0000","last_peered":"2023-09-10T00:12:47.783443+0000","last_clean":"2023-09-10T00:12:47.783443+0000","last_became_active":"2023-09-10T00:12:42.551345+0000","last_became_peered":"2023-09-10T00:12:42.551345+0000","last_unstale":"2023-09-10T00:12:47.783443+0000","last_undegraded":"2023-09-10T00:12:47.783443+0000","last_fullsized":"2023-09-10T00:12:47.783443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578183+0000","last_change":"2023-09-10T00:12:41.516689+0000","last_active":"2023-09-10T00:12:47.578183+0000","last_peered":"2023-09-10T00:12:47.578183+0000","last_clean":"2023-09-10T00:12:47.578183+0000","last_became_active":"2023-09-10T00:12:41.516069+0000","last_became_peered":"2023-09-10T00:12:41.516069+0000","last_unstale":"2023-09-10T00:12:47.578183+0000","last_undegraded":"2023-09-10T00:12:47.578183+0000","last_fullsized":"2023-09-10T00:12:47.578183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:22:16.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582898+0000","last_change":"2023-09-10T00:12:47.431597+0000","last_active":"2023-09-10T00:12:48.582898+0000","last_peered":"2023-09-10T00:12:48.582898+0000","last_clean":"2023-09-10T00:12:48.582898+0000","last_became_active":"2023-09-10T00:12:47.430655+0000","last_became_peered":"2023-09-10T00:12:47.430655+0000","last_unstale":"2023-09-10T00:12:48.582898+0000","last_undegraded":"2023-09-10T00:12:48.582898+0000","last_fullsized":"2023-09-10T00:12:48.582898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:33:42.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782062+0000","last_change":"2023-09-10T00:12:42.541778+0000","last_active":"2023-09-10T00:12:47.782062+0000","last_peered":"2023-09-10T00:12:47.782062+0000","last_clean":"2023-09-10T00:12:47.782062+0000","last_became_active":"2023-09-10T00:12:42.541049+0000","last_became_peered":"2023-09-10T00:12:42.541049+0000","last_unstale":"2023-09-10T00:12:47.782062+0000","last_undegraded":"2023-09-10T00:12:47.782062+0000","last_fullsized":"2023-09-10T00:12:47.782062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615672+0000","last_change":"2023-09-10T00:12:41.509830+0000","last_active":"2023-09-10T00:12:47.615672+0000","last_peered":"2023-09-10T00:12:47.615672+0000","last_clean":"2023-09-10T00:12:47.615672+0000","last_became_active":"2023-09-10T00:12:41.509495+0000","last_became_peered":"2023-09-10T00:12:41.509495+0000","last_unstale":"2023-09-10T00:12:47.615672+0000","last_undegraded":"2023-09-10T00:12:47.615672+0000","last_fullsized":"2023-09-10T00:12:47.615672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:44:59.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223136+0000","last_change":"2023-09-10T00:12:46.595012+0000","last_active":"2023-09-10T00:12:49.223136+0000","last_peered":"2023-09-10T00:12:49.223136+0000","last_clean":"2023-09-10T00:12:49.223136+0000","last_became_active":"2023-09-10T00:12:46.594222+0000","last_became_peered":"2023-09-10T00:12:46.594222+0000","last_unstale":"2023-09-10T00:12:49.223136+0000","last_undegraded":"2023-09-10T00:12:49.223136+0000","last_fullsized":"2023-09-10T00:12:49.223136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784267+0000","last_change":"2023-09-10T00:12:42.546647+0000","last_active":"2023-09-10T00:12:47.784267+0000","last_peered":"2023-09-10T00:12:47.784267+0000","last_clean":"2023-09-10T00:12:47.784267+0000","last_became_active":"2023-09-10T00:12:42.546180+0000","last_became_peered":"2023-09-10T00:12:42.546180+0000","last_unstale":"2023-09-10T00:12:47.784267+0000","last_undegraded":"2023-09-10T00:12:47.784267+0000","last_fullsized":"2023-09-10T00:12:47.784267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578028+0000","last_change":"2023-09-10T00:12:41.498190+0000","last_active":"2023-09-10T00:12:47.578028+0000","last_peered":"2023-09-10T00:12:47.578028+0000","last_clean":"2023-09-10T00:12:47.578028+0000","last_became_active":"2023-09-10T00:12:41.497767+0000","last_became_peered":"2023-09-10T00:12:41.497767+0000","last_unstale":"2023-09-10T00:12:47.578028+0000","last_undegraded":"2023-09-10T00:12:47.578028+0000","last_fullsized":"2023-09-10T00:12:47.578028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:26:08.442308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222434+0000","last_change":"2023-09-10T00:12:47.432026+0000","last_active":"2023-09-10T00:12:49.222434+0000","last_peered":"2023-09-10T00:12:49.222434+0000","last_clean":"2023-09-10T00:12:49.222434+0000","last_became_active":"2023-09-10T00:12:47.430924+0000","last_became_peered":"2023-09-10T00:12:47.430924+0000","last_unstale":"2023-09-10T00:12:49.222434+0000","last_undegraded":"2023-09-10T00:12:49.222434+0000","last_fullsized":"2023-09-10T00:12:49.222434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783979+0000","last_change":"2023-09-10T00:12:42.541280+0000","last_active":"2023-09-10T00:12:47.783979+0000","last_peered":"2023-09-10T00:12:47.783979+0000","last_clean":"2023-09-10T00:12:47.783979+0000","last_became_active":"2023-09-10T00:12:42.533762+0000","last_became_peered":"2023-09-10T00:12:42.533762+0000","last_unstale":"2023-09-10T00:12:47.783979+0000","last_undegraded":"2023-09-10T00:12:47.783979+0000","last_fullsized":"2023-09-10T00:12:47.783979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581569+0000","last_change":"2023-09-10T00:12:41.503433+0000","last_active":"2023-09-10T00:12:47.581569+0000","last_peered":"2023-09-10T00:12:47.581569+0000","last_clean":"2023-09-10T00:12:47.581569+0000","last_became_active":"2023-09-10T00:12:41.502639+0000","last_became_peered":"2023-09-10T00:12:41.502639+0000","last_unstale":"2023-09-10T00:12:47.581569+0000","last_undegraded":"2023-09-10T00:12:47.581569+0000","last_fullsized":"2023-09-10T00:12:47.581569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:28:54.792772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581399+0000","last_change":"2023-09-10T00:12:46.602461+0000","last_active":"2023-09-10T00:12:48.581399+0000","last_peered":"2023-09-10T00:12:48.581399+0000","last_clean":"2023-09-10T00:12:48.581399+0000","last_became_active":"2023-09-10T00:12:46.601011+0000","last_became_peered":"2023-09-10T00:12:46.601011+0000","last_unstale":"2023-09-10T00:12:48.581399+0000","last_undegraded":"2023-09-10T00:12:48.581399+0000","last_fullsized":"2023-09-10T00:12:48.581399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782746+0000","last_change":"2023-09-10T00:12:42.518701+0000","last_active":"2023-09-10T00:12:47.782746+0000","last_peered":"2023-09-10T00:12:47.782746+0000","last_clean":"2023-09-10T00:12:47.782746+0000","last_became_active":"2023-09-10T00:12:42.517943+0000","last_became_peered":"2023-09-10T00:12:42.517943+0000","last_unstale":"2023-09-10T00:12:47.782746+0000","last_undegraded":"2023-09-10T00:12:47.782746+0000","last_fullsized":"2023-09-10T00:12:47.782746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577561+0000","last_change":"2023-09-10T00:12:41.496219+0000","last_active":"2023-09-10T00:12:47.577561+0000","last_peered":"2023-09-10T00:12:47.577561+0000","last_clean":"2023-09-10T00:12:47.577561+0000","last_became_active":"2023-09-10T00:12:41.495862+0000","last_became_peered":"2023-09-10T00:12:41.495862+0000","last_unstale":"2023-09-10T00:12:47.577561+0000","last_undegraded":"2023-09-10T00:12:47.577561+0000","last_fullsized":"2023-09-10T00:12:47.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:56:10.667850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223317+0000","last_change":"2023-09-10T00:12:46.592307+0000","last_active":"2023-09-10T00:12:49.223317+0000","last_peered":"2023-09-10T00:12:49.223317+0000","last_clean":"2023-09-10T00:12:49.223317+0000","last_became_active":"2023-09-10T00:12:46.591133+0000","last_became_peered":"2023-09-10T00:12:46.591133+0000","last_unstale":"2023-09-10T00:12:49.223317+0000","last_undegraded":"2023-09-10T00:12:49.223317+0000","last_fullsized":"2023-09-10T00:12:49.223317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580013+0000","last_change":"2023-09-10T00:12:42.524709+0000","last_active":"2023-09-10T00:12:47.580013+0000","last_peered":"2023-09-10T00:12:47.580013+0000","last_clean":"2023-09-10T00:12:47.580013+0000","last_became_active":"2023-09-10T00:12:42.505826+0000","last_became_peered":"2023-09-10T00:12:42.505826+0000","last_unstale":"2023-09-10T00:12:47.580013+0000","last_undegraded":"2023-09-10T00:12:47.580013+0000","last_fullsized":"2023-09-10T00:12:47.580013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579962+0000","last_change":"2023-09-10T00:12:41.495448+0000","last_active":"2023-09-10T00:12:47.579962+0000","last_peered":"2023-09-10T00:12:47.579962+0000","last_clean":"2023-09-10T00:12:47.579962+0000","last_became_active":"2023-09-10T00:12:41.494697+0000","last_became_peered":"2023-09-10T00:12:41.494697+0000","last_unstale":"2023-09-10T00:12:47.579962+0000","last_undegraded":"2023-09-10T00:12:47.579962+0000","last_fullsized":"2023-09-10T00:12:47.579962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:21:19.631538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579415+0000","last_change":"2023-09-10T00:12:47.439992+0000","last_active":"2023-09-10T00:12:48.579415+0000","last_peered":"2023-09-10T00:12:48.579415+0000","last_clean":"2023-09-10T00:12:48.579415+0000","last_became_active":"2023-09-10T00:12:47.438590+0000","last_became_peered":"2023-09-10T00:12:47.438590+0000","last_unstale":"2023-09-10T00:12:48.579415+0000","last_undegraded":"2023-09-10T00:12:48.579415+0000","last_fullsized":"2023-09-10T00:12:48.579415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:09:09.398224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783239+0000","last_change":"2023-09-10T00:12:42.541600+0000","last_active":"2023-09-10T00:12:47.783239+0000","last_peered":"2023-09-10T00:12:47.783239+0000","last_clean":"2023-09-10T00:12:47.783239+0000","last_became_active":"2023-09-10T00:12:42.533858+0000","last_became_peered":"2023-09-10T00:12:42.533858+0000","last_unstale":"2023-09-10T00:12:47.783239+0000","last_undegraded":"2023-09-10T00:12:47.783239+0000","last_fullsized":"2023-09-10T00:12:47.783239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781900+0000","last_change":"2023-09-10T00:12:41.523860+0000","last_active":"2023-09-10T00:12:47.781900+0000","last_peered":"2023-09-10T00:12:47.781900+0000","last_clean":"2023-09-10T00:12:47.781900+0000","last_became_active":"2023-09-10T00:12:41.522192+0000","last_became_peered":"2023-09-10T00:12:41.522192+0000","last_unstale":"2023-09-10T00:12:47.781900+0000","last_undegraded":"2023-09-10T00:12:47.781900+0000","last_fullsized":"2023-09-10T00:12:47.781900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:29.890350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578583+0000","last_change":"2023-09-10T00:12:47.432628+0000","last_active":"2023-09-10T00:12:48.578583+0000","last_peered":"2023-09-10T00:12:48.578583+0000","last_clean":"2023-09-10T00:12:48.578583+0000","last_became_active":"2023-09-10T00:12:47.431415+0000","last_became_peered":"2023-09-10T00:12:47.431415+0000","last_unstale":"2023-09-10T00:12:48.578583+0000","last_undegraded":"2023-09-10T00:12:48.578583+0000","last_fullsized":"2023-09-10T00:12:48.578583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:30:23.542385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780877+0000","last_change":"2023-09-10T00:12:42.514023+0000","last_active":"2023-09-10T00:12:47.780877+0000","last_peered":"2023-09-10T00:12:47.780877+0000","last_clean":"2023-09-10T00:12:47.780877+0000","last_became_active":"2023-09-10T00:12:42.513715+0000","last_became_peered":"2023-09-10T00:12:42.513715+0000","last_unstale":"2023-09-10T00:12:47.780877+0000","last_undegraded":"2023-09-10T00:12:47.780877+0000","last_fullsized":"2023-09-10T00:12:47.780877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781349+0000","last_change":"2023-09-10T00:12:41.501329+0000","last_active":"2023-09-10T00:12:47.781349+0000","last_peered":"2023-09-10T00:12:47.781349+0000","last_clean":"2023-09-10T00:12:47.781349+0000","last_became_active":"2023-09-10T00:12:41.500908+0000","last_became_peered":"2023-09-10T00:12:41.500908+0000","last_unstale":"2023-09-10T00:12:47.781349+0000","last_undegraded":"2023-09-10T00:12:47.781349+0000","last_fullsized":"2023-09-10T00:12:47.781349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:42.290409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223679+0000","last_change":"2023-09-10T00:12:47.439596+0000","last_active":"2023-09-10T00:12:49.223679+0000","last_peered":"2023-09-10T00:12:49.223679+0000","last_clean":"2023-09-10T00:12:49.223679+0000","last_became_active":"2023-09-10T00:12:47.438423+0000","last_became_peered":"2023-09-10T00:12:47.438423+0000","last_unstale":"2023-09-10T00:12:49.223679+0000","last_undegraded":"2023-09-10T00:12:49.223679+0000","last_fullsized":"2023-09-10T00:12:49.223679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783453+0000","last_change":"2023-09-10T00:12:42.518431+0000","last_active":"2023-09-10T00:12:47.783453+0000","last_peered":"2023-09-10T00:12:47.783453+0000","last_clean":"2023-09-10T00:12:47.783453+0000","last_became_active":"2023-09-10T00:12:42.515011+0000","last_became_peered":"2023-09-10T00:12:42.515011+0000","last_unstale":"2023-09-10T00:12:47.783453+0000","last_undegraded":"2023-09-10T00:12:47.783453+0000","last_fullsized":"2023-09-10T00:12:47.783453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:52.647101+0000","last_change":"2023-09-10T00:12:41.501247+0000","last_active":"2023-09-10T00:12:52.647101+0000","last_peered":"2023-09-10T00:12:52.647101+0000","last_clean":"2023-09-10T00:12:52.647101+0000","last_became_active":"2023-09-10T00:12:41.500391+0000","last_became_peered":"2023-09-10T00:12:41.500391+0000","last_unstale":"2023-09-10T00:12:52.647101+0000","last_undegraded":"2023-09-10T00:12:52.647101+0000","last_fullsized":"2023-09-10T00:12:52.647101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224306+0000","last_change":"2023-09-10T00:12:46.591484+0000","last_active":"2023-09-10T00:12:49.224306+0000","last_peered":"2023-09-10T00:12:49.224306+0000","last_clean":"2023-09-10T00:12:49.224306+0000","last_became_active":"2023-09-10T00:12:46.590895+0000","last_became_peered":"2023-09-10T00:12:46.590895+0000","last_unstale":"2023-09-10T00:12:49.224306+0000","last_undegraded":"2023-09-10T00:12:49.224306+0000","last_fullsized":"2023-09-10T00:12:49.224306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:50:45.730271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581291+0000","last_change":"2023-09-10T00:12:42.521690+0000","last_active":"2023-09-10T00:12:47.581291+0000","last_peered":"2023-09-10T00:12:47.581291+0000","last_clean":"2023-09-10T00:12:47.581291+0000","last_became_active":"2023-09-10T00:12:42.520931+0000","last_became_peered":"2023-09-10T00:12:42.520931+0000","last_unstale":"2023-09-10T00:12:47.581291+0000","last_undegraded":"2023-09-10T00:12:47.581291+0000","last_fullsized":"2023-09-10T00:12:47.581291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:03.905490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615500+0000","last_change":"2023-09-10T00:12:41.527727+0000","last_active":"2023-09-10T00:12:47.615500+0000","last_peered":"2023-09-10T00:12:47.615500+0000","last_clean":"2023-09-10T00:12:47.615500+0000","last_became_active":"2023-09-10T00:12:41.527495+0000","last_became_peered":"2023-09-10T00:12:41.527495+0000","last_unstale":"2023-09-10T00:12:47.615500+0000","last_undegraded":"2023-09-10T00:12:47.615500+0000","last_fullsized":"2023-09-10T00:12:47.615500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:41.673766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583605+0000","last_change":"2023-09-10T00:12:46.593774+0000","last_active":"2023-09-10T00:12:48.583605+0000","last_peered":"2023-09-10T00:12:48.583605+0000","last_clean":"2023-09-10T00:12:48.583605+0000","last_became_active":"2023-09-10T00:12:46.592641+0000","last_became_peered":"2023-09-10T00:12:46.592641+0000","last_unstale":"2023-09-10T00:12:48.583605+0000","last_undegraded":"2023-09-10T00:12:48.583605+0000","last_fullsized":"2023-09-10T00:12:48.583605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781921+0000","last_change":"2023-09-10T00:12:42.541125+0000","last_active":"2023-09-10T00:12:47.781921+0000","last_peered":"2023-09-10T00:12:47.781921+0000","last_clean":"2023-09-10T00:12:47.781921+0000","last_became_active":"2023-09-10T00:12:42.540816+0000","last_became_peered":"2023-09-10T00:12:42.540816+0000","last_unstale":"2023-09-10T00:12:47.781921+0000","last_undegraded":"2023-09-10T00:12:47.781921+0000","last_fullsized":"2023-09-10T00:12:47.781921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781459+0000","last_change":"2023-09-10T00:12:41.525602+0000","last_active":"2023-09-10T00:12:47.781459+0000","last_peered":"2023-09-10T00:12:47.781459+0000","last_clean":"2023-09-10T00:12:47.781459+0000","last_became_active":"2023-09-10T00:12:41.524971+0000","last_became_peered":"2023-09-10T00:12:41.524971+0000","last_unstale":"2023-09-10T00:12:47.781459+0000","last_undegraded":"2023-09-10T00:12:47.781459+0000","last_fullsized":"2023-09-10T00:12:47.781459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578028+0000","last_change":"2023-09-10T00:12:46.590880+0000","last_active":"2023-09-10T00:12:48.578028+0000","last_peered":"2023-09-10T00:12:48.578028+0000","last_clean":"2023-09-10T00:12:48.578028+0000","last_became_active":"2023-09-10T00:12:46.590393+0000","last_became_peered":"2023-09-10T00:12:46.590393+0000","last_unstale":"2023-09-10T00:12:48.578028+0000","last_undegraded":"2023-09-10T00:12:48.578028+0000","last_fullsized":"2023-09-10T00:12:48.578028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:26.815586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781335+0000","last_change":"2023-09-10T00:12:42.546455+0000","last_active":"2023-09-10T00:12:47.781335+0000","last_peered":"2023-09-10T00:12:47.781335+0000","last_clean":"2023-09-10T00:12:47.781335+0000","last_became_active":"2023-09-10T00:12:42.545882+0000","last_became_peered":"2023-09-10T00:12:42.545882+0000","last_unstale":"2023-09-10T00:12:47.781335+0000","last_undegraded":"2023-09-10T00:12:47.781335+0000","last_fullsized":"2023-09-10T00:12:47.781335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583657+0000","last_change":"2023-09-10T00:12:41.526211+0000","last_active":"2023-09-10T00:12:47.583657+0000","last_peered":"2023-09-10T00:12:47.583657+0000","last_clean":"2023-09-10T00:12:47.583657+0000","last_became_active":"2023-09-10T00:12:41.525658+0000","last_became_peered":"2023-09-10T00:12:41.525658+0000","last_unstale":"2023-09-10T00:12:47.583657+0000","last_undegraded":"2023-09-10T00:12:47.583657+0000","last_fullsized":"2023-09-10T00:12:47.583657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578029+0000","last_change":"2023-09-10T00:12:47.440422+0000","last_active":"2023-09-10T00:12:48.578029+0000","last_peered":"2023-09-10T00:12:48.578029+0000","last_clean":"2023-09-10T00:12:48.578029+0000","last_became_active":"2023-09-10T00:12:47.438490+0000","last_became_peered":"2023-09-10T00:12:47.438490+0000","last_unstale":"2023-09-10T00:12:48.578029+0000","last_undegraded":"2023-09-10T00:12:48.578029+0000","last_fullsized":"2023-09-10T00:12:48.578029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:42:20.520101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222944+0000","last_change":"2023-09-10T00:12:47.440252+0000","last_active":"2023-09-10T00:12:49.222944+0000","last_peered":"2023-09-10T00:12:49.222944+0000","last_clean":"2023-09-10T00:12:49.222944+0000","last_became_active":"2023-09-10T00:12:47.438785+0000","last_became_peered":"2023-09-10T00:12:47.438785+0000","last_unstale":"2023-09-10T00:12:49.222944+0000","last_undegraded":"2023-09-10T00:12:49.222944+0000","last_fullsized":"2023-09-10T00:12:49.222944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614683+0000","last_change":"2023-09-10T00:12:42.503107+0000","last_active":"2023-09-10T00:12:47.614683+0000","last_peered":"2023-09-10T00:12:47.614683+0000","last_clean":"2023-09-10T00:12:47.614683+0000","last_became_active":"2023-09-10T00:12:42.502824+0000","last_became_peered":"2023-09-10T00:12:42.502824+0000","last_unstale":"2023-09-10T00:12:47.614683+0000","last_undegraded":"2023-09-10T00:12:47.614683+0000","last_fullsized":"2023-09-10T00:12:47.614683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:12:53.862661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781222+0000","last_change":"2023-09-10T00:12:41.530180+0000","last_active":"2023-09-10T00:12:47.781222+0000","last_peered":"2023-09-10T00:12:47.781222+0000","last_clean":"2023-09-10T00:12:47.781222+0000","last_became_active":"2023-09-10T00:12:41.529649+0000","last_became_peered":"2023-09-10T00:12:41.529649+0000","last_unstale":"2023-09-10T00:12:47.781222+0000","last_undegraded":"2023-09-10T00:12:47.781222+0000","last_fullsized":"2023-09-10T00:12:47.781222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:46.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.586697+0000","last_change":"2023-09-10T00:12:46.606697+0000","last_active":"2023-09-10T00:12:48.586697+0000","last_peered":"2023-09-10T00:12:48.586697+0000","last_clean":"2023-09-10T00:12:48.586697+0000","last_became_active":"2023-09-10T00:12:46.605416+0000","last_became_peered":"2023-09-10T00:12:46.605416+0000","last_unstale":"2023-09-10T00:12:48.586697+0000","last_undegraded":"2023-09-10T00:12:48.586697+0000","last_fullsized":"2023-09-10T00:12:48.586697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782768+0000","last_change":"2023-09-10T00:12:42.504040+0000","last_active":"2023-09-10T00:12:47.782768+0000","last_peered":"2023-09-10T00:12:47.782768+0000","last_clean":"2023-09-10T00:12:47.782768+0000","last_became_active":"2023-09-10T00:12:42.497706+0000","last_became_peered":"2023-09-10T00:12:42.497706+0000","last_unstale":"2023-09-10T00:12:47.782768+0000","last_undegraded":"2023-09-10T00:12:47.782768+0000","last_fullsized":"2023-09-10T00:12:47.782768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782782+0000","last_change":"2023-09-10T00:12:41.507432+0000","last_active":"2023-09-10T00:12:47.782782+0000","last_peered":"2023-09-10T00:12:47.782782+0000","last_clean":"2023-09-10T00:12:47.782782+0000","last_became_active":"2023-09-10T00:12:41.507133+0000","last_became_peered":"2023-09-10T00:12:41.507133+0000","last_unstale":"2023-09-10T00:12:47.782782+0000","last_undegraded":"2023-09-10T00:12:47.782782+0000","last_fullsized":"2023-09-10T00:12:47.782782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582295+0000","last_change":"2023-09-10T00:12:41.503643+0000","last_active":"2023-09-10T00:12:47.582295+0000","last_peered":"2023-09-10T00:12:47.582295+0000","last_clean":"2023-09-10T00:12:47.582295+0000","last_became_active":"2023-09-10T00:12:41.502542+0000","last_became_peered":"2023-09-10T00:12:41.502542+0000","last_unstale":"2023-09-10T00:12:47.582295+0000","last_undegraded":"2023-09-10T00:12:47.582295+0000","last_fullsized":"2023-09-10T00:12:47.582295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781211+0000","last_change":"2023-09-10T00:12:42.496774+0000","last_active":"2023-09-10T00:12:47.781211+0000","last_peered":"2023-09-10T00:12:47.781211+0000","last_clean":"2023-09-10T00:12:47.781211+0000","last_became_active":"2023-09-10T00:12:42.496456+0000","last_became_peered":"2023-09-10T00:12:42.496456+0000","last_unstale":"2023-09-10T00:12:47.781211+0000","last_undegraded":"2023-09-10T00:12:47.781211+0000","last_fullsized":"2023-09-10T00:12:47.781211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.221683+0000","last_change":"2023-09-10T00:12:46.594913+0000","last_active":"2023-09-10T00:12:49.221683+0000","last_peered":"2023-09-10T00:12:49.221683+0000","last_clean":"2023-09-10T00:12:49.221683+0000","last_became_active":"2023-09-10T00:12:46.594488+0000","last_became_peered":"2023-09-10T00:12:46.594488+0000","last_unstale":"2023-09-10T00:12:49.221683+0000","last_undegraded":"2023-09-10T00:12:49.221683+0000","last_fullsized":"2023-09-10T00:12:49.221683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:35.215018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783437+0000","last_change":"2023-09-10T00:12:41.507753+0000","last_active":"2023-09-10T00:12:47.783437+0000","last_peered":"2023-09-10T00:12:47.783437+0000","last_clean":"2023-09-10T00:12:47.783437+0000","last_became_active":"2023-09-10T00:12:41.507335+0000","last_became_peered":"2023-09-10T00:12:41.507335+0000","last_unstale":"2023-09-10T00:12:47.783437+0000","last_undegraded":"2023-09-10T00:12:47.783437+0000","last_fullsized":"2023-09-10T00:12:47.783437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580684+0000","last_change":"2023-09-10T00:12:42.501100+0000","last_active":"2023-09-10T00:12:47.580684+0000","last_peered":"2023-09-10T00:12:47.580684+0000","last_clean":"2023-09-10T00:12:47.580684+0000","last_became_active":"2023-09-10T00:12:42.500331+0000","last_became_peered":"2023-09-10T00:12:42.500331+0000","last_unstale":"2023-09-10T00:12:47.580684+0000","last_undegraded":"2023-09-10T00:12:47.580684+0000","last_fullsized":"2023-09-10T00:12:47.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:55.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579211+0000","last_change":"2023-09-10T00:12:46.577981+0000","last_active":"2023-09-10T00:12:48.579211+0000","last_peered":"2023-09-10T00:12:48.579211+0000","last_clean":"2023-09-10T00:12:48.579211+0000","last_became_active":"2023-09-10T00:12:46.577624+0000","last_became_peered":"2023-09-10T00:12:46.577624+0000","last_unstale":"2023-09-10T00:12:48.579211+0000","last_undegraded":"2023-09-10T00:12:48.579211+0000","last_fullsized":"2023-09-10T00:12:48.579211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:03:59.306486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579555+0000","last_change":"2023-09-10T00:12:42.523920+0000","last_active":"2023-09-10T00:12:47.579555+0000","last_peered":"2023-09-10T00:12:47.579555+0000","last_clean":"2023-09-10T00:12:47.579555+0000","last_became_active":"2023-09-10T00:12:42.523139+0000","last_became_peered":"2023-09-10T00:12:42.523139+0000","last_unstale":"2023-09-10T00:12:47.579555+0000","last_undegraded":"2023-09-10T00:12:47.579555+0000","last_fullsized":"2023-09-10T00:12:47.579555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577535+0000","last_change":"2023-09-10T00:12:42.541910+0000","last_active":"2023-09-10T00:12:47.577535+0000","last_peered":"2023-09-10T00:12:47.577535+0000","last_clean":"2023-09-10T00:12:47.577535+0000","last_became_active":"2023-09-10T00:12:42.541606+0000","last_became_peered":"2023-09-10T00:12:42.541606+0000","last_unstale":"2023-09-10T00:12:47.577535+0000","last_undegraded":"2023-09-10T00:12:47.577535+0000","last_fullsized":"2023-09-10T00:12:47.577535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:50.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781888+0000","last_change":"2023-09-10T00:12:42.520562+0000","last_active":"2023-09-10T00:12:47.781888+0000","last_peered":"2023-09-10T00:12:47.781888+0000","last_clean":"2023-09-10T00:12:47.781888+0000","last_became_active":"2023-09-10T00:12:42.509305+0000","last_became_peered":"2023-09-10T00:12:42.509305+0000","last_unstale":"2023-09-10T00:12:47.781888+0000","last_undegraded":"2023-09-10T00:12:47.781888+0000","last_fullsized":"2023-09-10T00:12:47.781888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781110+0000","last_change":"2023-09-10T00:12:42.503904+0000","last_active":"2023-09-10T00:12:47.781110+0000","last_peered":"2023-09-10T00:12:47.781110+0000","last_clean":"2023-09-10T00:12:47.781110+0000","last_became_active":"2023-09-10T00:12:42.503477+0000","last_became_peered":"2023-09-10T00:12:42.503477+0000","last_unstale":"2023-09-10T00:12:47.781110+0000","last_undegraded":"2023-09-10T00:12:47.781110+0000","last_fullsized":"2023-09-10T00:12:47.781110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783728+0000","last_change":"2023-09-10T00:12:42.506439+0000","last_active":"2023-09-10T00:12:47.783728+0000","last_peered":"2023-09-10T00:12:47.783728+0000","last_clean":"2023-09-10T00:12:47.783728+0000","last_became_active":"2023-09-10T00:12:42.504454+0000","last_became_peered":"2023-09-10T00:12:42.504454+0000","last_unstale":"2023-09-10T00:12:47.783728+0000","last_undegraded":"2023-09-10T00:12:47.783728+0000","last_fullsized":"2023-09-10T00:12:47.783728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615152+0000","last_change":"2023-09-10T00:12:42.503158+0000","last_active":"2023-09-10T00:12:47.615152+0000","last_peered":"2023-09-10T00:12:47.615152+0000","last_clean":"2023-09-10T00:12:47.615152+0000","last_became_active":"2023-09-10T00:12:42.502881+0000","last_became_peered":"2023-09-10T00:12:42.502881+0000","last_unstale":"2023-09-10T00:12:47.615152+0000","last_undegraded":"2023-09-10T00:12:47.615152+0000","last_fullsized":"2023-09-10T00:12:47.615152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:31.129379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583567+0000","last_change":"2023-09-10T00:12:42.526817+0000","last_active":"2023-09-10T00:12:47.583567+0000","last_peered":"2023-09-10T00:12:47.583567+0000","last_clean":"2023-09-10T00:12:47.583567+0000","last_became_active":"2023-09-10T00:12:42.525834+0000","last_became_peered":"2023-09-10T00:12:42.525834+0000","last_unstale":"2023-09-10T00:12:47.583567+0000","last_undegraded":"2023-09-10T00:12:47.583567+0000","last_fullsized":"2023-09-10T00:12:47.583567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783919+0000","last_change":"2023-09-10T00:12:42.503440+0000","last_active":"2023-09-10T00:12:47.783919+0000","last_peered":"2023-09-10T00:12:47.783919+0000","last_clean":"2023-09-10T00:12:47.783919+0000","last_became_active":"2023-09-10T00:12:42.503128+0000","last_became_peered":"2023-09-10T00:12:42.503128+0000","last_unstale":"2023-09-10T00:12:47.783919+0000","last_undegraded":"2023-09-10T00:12:47.783919+0000","last_fullsized":"2023-09-10T00:12:47.783919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780980+0000","last_change":"2023-09-10T00:12:42.549808+0000","last_active":"2023-09-10T00:12:47.780980+0000","last_peered":"2023-09-10T00:12:47.780980+0000","last_clean":"2023-09-10T00:12:47.780980+0000","last_became_active":"2023-09-10T00:12:42.549085+0000","last_became_peered":"2023-09-10T00:12:42.549085+0000","last_unstale":"2023-09-10T00:12:47.780980+0000","last_undegraded":"2023-09-10T00:12:47.780980+0000","last_fullsized":"2023-09-10T00:12:47.780980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782646+0000","last_change":"2023-09-10T00:12:42.502195+0000","last_active":"2023-09-10T00:12:47.782646+0000","last_peered":"2023-09-10T00:12:47.782646+0000","last_clean":"2023-09-10T00:12:47.782646+0000","last_became_active":"2023-09-10T00:12:42.501637+0000","last_became_peered":"2023-09-10T00:12:42.501637+0000","last_unstale":"2023-09-10T00:12:47.782646+0000","last_undegraded":"2023-09-10T00:12:47.782646+0000","last_fullsized":"2023-09-10T00:12:47.782646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781670+0000","last_change":"2023-09-10T00:12:42.532920+0000","last_active":"2023-09-10T00:12:47.781670+0000","last_peered":"2023-09-10T00:12:47.781670+0000","last_clean":"2023-09-10T00:12:47.781670+0000","last_became_active":"2023-09-10T00:12:42.532282+0000","last_became_peered":"2023-09-10T00:12:42.532282+0000","last_unstale":"2023-09-10T00:12:47.781670+0000","last_undegraded":"2023-09-10T00:12:47.781670+0000","last_fullsized":"2023-09-10T00:12:47.781670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780619+0000","last_change":"2023-09-10T00:12:42.502049+0000","last_active":"2023-09-10T00:12:47.780619+0000","last_peered":"2023-09-10T00:12:47.780619+0000","last_clean":"2023-09-10T00:12:47.780619+0000","last_became_active":"2023-09-10T00:12:42.501720+0000","last_became_peered":"2023-09-10T00:12:42.501720+0000","last_unstale":"2023-09-10T00:12:47.780619+0000","last_undegraded":"2023-09-10T00:12:47.780619+0000","last_fullsized":"2023-09-10T00:12:47.780619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582329+0000","last_change":"2023-09-10T00:12:42.527735+0000","last_active":"2023-09-10T00:12:47.582329+0000","last_peered":"2023-09-10T00:12:47.582329+0000","last_clean":"2023-09-10T00:12:47.582329+0000","last_became_active":"2023-09-10T00:12:42.526982+0000","last_became_peered":"2023-09-10T00:12:42.526982+0000","last_unstale":"2023-09-10T00:12:47.582329+0000","last_undegraded":"2023-09-10T00:12:47.582329+0000","last_fullsized":"2023-09-10T00:12:47.582329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:42.530154+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:42.529662+0000","last_became_peered":"2023-09-10T00:12:42.529662+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578018+0000","last_change":"2023-09-10T00:12:42.539691+0000","last_active":"2023-09-10T00:12:47.578018+0000","last_peered":"2023-09-10T00:12:47.578018+0000","last_clean":"2023-09-10T00:12:47.578018+0000","last_became_active":"2023-09-10T00:12:42.539317+0000","last_became_peered":"2023-09-10T00:12:42.539317+0000","last_unstale":"2023-09-10T00:12:47.578018+0000","last_undegraded":"2023-09-10T00:12:47.578018+0000","last_fullsized":"2023-09-10T00:12:47.578018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:16.849606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782318+0000","last_change":"2023-09-10T00:12:42.559699+0000","last_active":"2023-09-10T00:12:47.782318+0000","last_peered":"2023-09-10T00:12:47.782318+0000","last_clean":"2023-09-10T00:12:47.782318+0000","last_became_active":"2023-09-10T00:12:42.559176+0000","last_became_peered":"2023-09-10T00:12:42.559176+0000","last_unstale":"2023-09-10T00:12:47.782318+0000","last_undegraded":"2023-09-10T00:12:47.782318+0000","last_fullsized":"2023-09-10T00:12:47.782318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:22:14.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780714+0000","last_change":"2023-09-10T00:12:42.550456+0000","last_active":"2023-09-10T00:12:47.780714+0000","last_peered":"2023-09-10T00:12:47.780714+0000","last_clean":"2023-09-10T00:12:47.780714+0000","last_became_active":"2023-09-10T00:12:42.549896+0000","last_became_peered":"2023-09-10T00:12:42.549896+0000","last_unstale":"2023-09-10T00:12:47.780714+0000","last_undegraded":"2023-09-10T00:12:47.780714+0000","last_fullsized":"2023-09-10T00:12:47.780714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614735+0000","last_change":"2023-09-10T00:12:42.505565+0000","last_active":"2023-09-10T00:12:47.614735+0000","last_peered":"2023-09-10T00:12:47.614735+0000","last_clean":"2023-09-10T00:12:47.614735+0000","last_became_active":"2023-09-10T00:12:42.504834+0000","last_became_peered":"2023-09-10T00:12:42.504834+0000","last_unstale":"2023-09-10T00:12:47.614735+0000","last_undegraded":"2023-09-10T00:12:47.614735+0000","last_fullsized":"2023-09-10T00:12:47.614735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:06:02.585817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780755+0000","last_change":"2023-09-10T00:12:42.497048+0000","last_active":"2023-09-10T00:12:47.780755+0000","last_peered":"2023-09-10T00:12:47.780755+0000","last_clean":"2023-09-10T00:12:47.780755+0000","last_became_active":"2023-09-10T00:12:42.496135+0000","last_became_peered":"2023-09-10T00:12:42.496135+0000","last_unstale":"2023-09-10T00:12:47.780755+0000","last_undegraded":"2023-09-10T00:12:47.780755+0000","last_fullsized":"2023-09-10T00:12:47.780755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:31:37.425124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783142+0000","last_change":"2023-09-10T00:12:42.539859+0000","last_active":"2023-09-10T00:12:47.783142+0000","last_peered":"2023-09-10T00:12:47.783142+0000","last_clean":"2023-09-10T00:12:47.783142+0000","last_became_active":"2023-09-10T00:12:42.539545+0000","last_became_peered":"2023-09-10T00:12:42.539545+0000","last_unstale":"2023-09-10T00:12:47.783142+0000","last_undegraded":"2023-09-10T00:12:47.783142+0000","last_fullsized":"2023-09-10T00:12:47.783142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581017+0000","last_change":"2023-09-10T00:12:42.528935+0000","last_active":"2023-09-10T00:12:47.581017+0000","last_peered":"2023-09-10T00:12:47.581017+0000","last_clean":"2023-09-10T00:12:47.581017+0000","last_became_active":"2023-09-10T00:12:42.528159+0000","last_became_peered":"2023-09-10T00:12:42.528159+0000","last_unstale":"2023-09-10T00:12:47.581017+0000","last_undegraded":"2023-09-10T00:12:47.581017+0000","last_fullsized":"2023-09-10T00:12:47.581017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:43.303596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582968+0000","last_change":"2023-09-10T00:12:42.553610+0000","last_active":"2023-09-10T00:12:47.582968+0000","last_peered":"2023-09-10T00:12:47.582968+0000","last_clean":"2023-09-10T00:12:47.582968+0000","last_became_active":"2023-09-10T00:12:42.553091+0000","last_became_peered":"2023-09-10T00:12:42.553091+0000","last_unstale":"2023-09-10T00:12:47.582968+0000","last_undegraded":"2023-09-10T00:12:47.582968+0000","last_fullsized":"2023-09-10T00:12:47.582968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583568+0000","last_change":"2023-09-10T00:12:42.549380+0000","last_active":"2023-09-10T00:12:47.583568+0000","last_peered":"2023-09-10T00:12:47.583568+0000","last_clean":"2023-09-10T00:12:47.583568+0000","last_became_active":"2023-09-10T00:12:42.548763+0000","last_became_peered":"2023-09-10T00:12:42.548763+0000","last_unstale":"2023-09-10T00:12:47.583568+0000","last_undegraded":"2023-09-10T00:12:47.583568+0000","last_fullsized":"2023-09-10T00:12:47.583568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784264+0000","last_change":"2023-09-10T00:12:42.551603+0000","last_active":"2023-09-10T00:12:47.784264+0000","last_peered":"2023-09-10T00:12:47.784264+0000","last_clean":"2023-09-10T00:12:47.784264+0000","last_became_active":"2023-09-10T00:12:42.551111+0000","last_became_peered":"2023-09-10T00:12:42.551111+0000","last_unstale":"2023-09-10T00:12:47.784264+0000","last_undegraded":"2023-09-10T00:12:47.784264+0000","last_fullsized":"2023-09-10T00:12:47.784264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782492+0000","last_change":"2023-09-10T00:12:42.551120+0000","last_active":"2023-09-10T00:12:47.782492+0000","last_peered":"2023-09-10T00:12:47.782492+0000","last_clean":"2023-09-10T00:12:47.782492+0000","last_became_active":"2023-09-10T00:12:42.550803+0000","last_became_peered":"2023-09-10T00:12:42.550803+0000","last_unstale":"2023-09-10T00:12:47.782492+0000","last_undegraded":"2023-09-10T00:12:47.782492+0000","last_fullsized":"2023-09-10T00:12:47.782492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781988+0000","last_change":"2023-09-10T00:12:42.515188+0000","last_active":"2023-09-10T00:12:47.781988+0000","last_peered":"2023-09-10T00:12:47.781988+0000","last_clean":"2023-09-10T00:12:47.781988+0000","last_became_active":"2023-09-10T00:12:42.514135+0000","last_became_peered":"2023-09-10T00:12:42.514135+0000","last_unstale":"2023-09-10T00:12:47.781988+0000","last_undegraded":"2023-09-10T00:12:47.781988+0000","last_fullsized":"2023-09-10T00:12:47.781988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781647+0000","last_change":"2023-09-10T00:12:42.542532+0000","last_active":"2023-09-10T00:12:47.781647+0000","last_peered":"2023-09-10T00:12:47.781647+0000","last_clean":"2023-09-10T00:12:47.781647+0000","last_became_active":"2023-09-10T00:12:42.536897+0000","last_became_peered":"2023-09-10T00:12:42.536897+0000","last_unstale":"2023-09-10T00:12:47.781647+0000","last_undegraded":"2023-09-10T00:12:47.781647+0000","last_fullsized":"2023-09-10T00:12:47.781647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782937+0000","last_change":"2023-09-10T00:12:42.519515+0000","last_active":"2023-09-10T00:12:47.782937+0000","last_peered":"2023-09-10T00:12:47.782937+0000","last_clean":"2023-09-10T00:12:47.782937+0000","last_became_active":"2023-09-10T00:12:42.518734+0000","last_became_peered":"2023-09-10T00:12:42.518734+0000","last_unstale":"2023-09-10T00:12:47.782937+0000","last_undegraded":"2023-09-10T00:12:47.782937+0000","last_fullsized":"2023-09-10T00:12:47.782937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781617+0000","last_change":"2023-09-10T00:12:42.548980+0000","last_active":"2023-09-10T00:12:47.781617+0000","last_peered":"2023-09-10T00:12:47.781617+0000","last_clean":"2023-09-10T00:12:47.781617+0000","last_became_active":"2023-09-10T00:12:42.548305+0000","last_became_peered":"2023-09-10T00:12:42.548305+0000","last_unstale":"2023-09-10T00:12:47.781617+0000","last_undegraded":"2023-09-10T00:12:47.781617+0000","last_fullsized":"2023-09-10T00:12:47.781617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781352+0000","last_change":"2023-09-10T00:12:42.498654+0000","last_active":"2023-09-10T00:12:47.781352+0000","last_peered":"2023-09-10T00:12:47.781352+0000","last_clean":"2023-09-10T00:12:47.781352+0000","last_became_active":"2023-09-10T00:12:42.498336+0000","last_became_peered":"2023-09-10T00:12:42.498336+0000","last_unstale":"2023-09-10T00:12:47.781352+0000","last_undegraded":"2023-09-10T00:12:47.781352+0000","last_fullsized":"2023-09-10T00:12:47.781352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615376+0000","last_change":"2023-09-10T00:12:42.496796+0000","last_active":"2023-09-10T00:12:47.615376+0000","last_peered":"2023-09-10T00:12:47.615376+0000","last_clean":"2023-09-10T00:12:47.615376+0000","last_became_active":"2023-09-10T00:12:42.496366+0000","last_became_peered":"2023-09-10T00:12:42.496366+0000","last_unstale":"2023-09-10T00:12:47.615376+0000","last_undegraded":"2023-09-10T00:12:47.615376+0000","last_fullsized":"2023-09-10T00:12:47.615376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:56.597066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784129+0000","last_change":"2023-09-10T00:12:42.545759+0000","last_active":"2023-09-10T00:12:47.784129+0000","last_peered":"2023-09-10T00:12:47.784129+0000","last_clean":"2023-09-10T00:12:47.784129+0000","last_became_active":"2023-09-10T00:12:42.545347+0000","last_became_peered":"2023-09-10T00:12:42.545347+0000","last_unstale":"2023-09-10T00:12:47.784129+0000","last_undegraded":"2023-09-10T00:12:47.784129+0000","last_fullsized":"2023-09-10T00:12:47.784129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":699380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":699436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:13:10.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:13:10.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- 172.21.15.84:0/3820810372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 msgr2=0x7f160806b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 --2- 172.21.15.84:0/3820810372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160806b1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1600009bc0 tx=0x7f160001cb50 comp rx=0 tx=0).stop 2023-09-10T00:13:10.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- 172.21.15.84:0/3820810372 shutdown_connections 2023-09-10T00:13:10.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 --2- 172.21.15.84:0/3820810372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160806b1c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- 172.21.15.84:0/3820810372 >> 172.21.15.84:0/3820810372 conn(0x7f16080ca240 msgr2=0x7f16080ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- 172.21.15.84:0/3820810372 shutdown_connections 2023-09-10T00:13:10.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- 172.21.15.84:0/3820810372 wait complete. 2023-09-10T00:13:10.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 Processor -- start 2023-09-10T00:13:10.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- start start 2023-09-10T00:13:10.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 0x7f1608146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 0x7f16080c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080c69e0 con 0x7f160815c970 2023-09-10T00:13:10.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608147120 con 0x7f16080cd080 2023-09-10T00:13:10.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160e276640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16080c5940 con 0x7f160806cec0 2023-09-10T00:13:10.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46356/0 (socket says 172.21.15.84:46356) 2023-09-10T00:13:10.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 -- 172.21.15.84:0/4111075696 learned_addr learned my addr 172.21.15.84:0/4111075696 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:10.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 -- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 msgr2=0x7f1608146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f1607fff640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 0x7f1608146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f16077fe640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 0x7f16080c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 0x7f1608146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 -- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 msgr2=0x7f16080c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:10.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 0x7f16080c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:10.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 -- 172.21.15.84:0/4111075696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009820 con 0x7f160815c970 2023-09-10T00:13:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f1607fff640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 0x7f1608146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f16077fe640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 0x7f16080c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.922+0000 7f160c813640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f160001a780 tx=0x7f16000a5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600004240 con 0x7f160815c970 2023-09-10T00:13:10.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f16000043a0 con 0x7f160815c970 2023-09-10T00:13:10.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16080c5c20 con 0x7f160815c970 2023-09-10T00:13:10.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600004770 con 0x7f160815c970 2023-09-10T00:13:10.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16080c61e0 con 0x7f160815c970 2023-09-10T00:13:10.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608073400 con 0x7f160815c970 2023-09-10T00:13:10.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16000b4040 con 0x7f160815c970 2023-09-10T00:13:10.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 0x7f15f4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:10.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f160011e3b0 con 0x7f160815c970 2023-09-10T00:13:10.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1607fff640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 0x7f15f4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:10.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.926+0000 7f1607fff640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 0x7f15f4068010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0046c0 tx=0x7f15fc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:10.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:10.930+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f16000ebaa0 con 0x7f160815c970 2023-09-10T00:13:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.070+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f160806bbf0 con 0x7f15f4065b50 2023-09-10T00:13:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.090+0000 7f1604ff9640 1 -- 172.21.15.84:0/4111075696 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345238 (secure 0 0 0) 0x7f160806bbf0 con 0x7f15f4065b50 2023-09-10T00:13:11.097 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:13:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 msgr2=0x7f15f4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 0x7f15f4068010 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0046c0 tx=0x7f15fc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 msgr2=0x7f160815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f160001a780 tx=0x7f16000a5aa0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 shutdown_connections 2023-09-10T00:13:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15f4065b50 0x7f15f4068010 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f160815c970 0x7f160815a990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16080cd080 0x7f16080c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 --2- 172.21.15.84:0/4111075696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f160806cec0 0x7f1608146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 >> 172.21.15.84:0/4111075696 conn(0x7f16080ca240 msgr2=0x7f16080cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 shutdown_connections 2023-09-10T00:13:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.098+0000 7f160e276640 1 -- 172.21.15.84:0/4111075696 wait complete. 2023-09-10T00:13:11.116 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-09-10T00:13:09.818959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219516,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755204,"statfs":{"total":773094113280,"available":772869328896,"internally_reserved":0,"allocated":3416064,"data_stored":2057454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004904"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782159+0000","last_change":"2023-09-10T00:12:41.509675+0000","last_active":"2023-09-10T00:12:47.782159+0000","last_peered":"2023-09-10T00:12:47.782159+0000","last_clean":"2023-09-10T00:12:47.782159+0000","last_became_active":"2023-09-10T00:12:41.509279+0000","last_became_peered":"2023-09-10T00:12:41.509279+0000","last_unstale":"2023-09-10T00:12:47.782159+0000","last_undegraded":"2023-09-10T00:12:47.782159+0000","last_fullsized":"2023-09-10T00:12:47.782159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783838+0000","last_change":"2023-09-10T00:12:42.539901+0000","last_active":"2023-09-10T00:12:47.783838+0000","last_peered":"2023-09-10T00:12:47.783838+0000","last_clean":"2023-09-10T00:12:47.783838+0000","last_became_active":"2023-09-10T00:12:42.539648+0000","last_became_peered":"2023-09-10T00:12:42.539648+0000","last_unstale":"2023-09-10T00:12:47.783838+0000","last_undegraded":"2023-09-10T00:12:47.783838+0000","last_fullsized":"2023-09-10T00:12:47.783838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577941+0000","last_change":"2023-09-10T00:12:47.443681+0000","last_active":"2023-09-10T00:12:48.577941+0000","last_peered":"2023-09-10T00:12:48.577941+0000","last_clean":"2023-09-10T00:12:48.577941+0000","last_became_active":"2023-09-10T00:12:47.442588+0000","last_became_peered":"2023-09-10T00:12:47.442588+0000","last_unstale":"2023-09-10T00:12:48.577941+0000","last_undegraded":"2023-09-10T00:12:48.577941+0000","last_fullsized":"2023-09-10T00:12:48.577941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:30:17.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784136+0000","last_change":"2023-09-10T00:12:41.502405+0000","last_active":"2023-09-10T00:12:47.784136+0000","last_peered":"2023-09-10T00:12:47.784136+0000","last_clean":"2023-09-10T00:12:47.784136+0000","last_became_active":"2023-09-10T00:12:41.502081+0000","last_became_peered":"2023-09-10T00:12:41.502081+0000","last_unstale":"2023-09-10T00:12:47.784136+0000","last_undegraded":"2023-09-10T00:12:47.784136+0000","last_fullsized":"2023-09-10T00:12:47.784136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781838+0000","last_change":"2023-09-10T00:12:42.550279+0000","last_active":"2023-09-10T00:12:47.781838+0000","last_peered":"2023-09-10T00:12:47.781838+0000","last_clean":"2023-09-10T00:12:47.781838+0000","last_became_active":"2023-09-10T00:12:42.549968+0000","last_became_peered":"2023-09-10T00:12:42.549968+0000","last_unstale":"2023-09-10T00:12:47.781838+0000","last_undegraded":"2023-09-10T00:12:47.781838+0000","last_fullsized":"2023-09-10T00:12:47.781838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581814+0000","last_change":"2023-09-10T00:12:46.587407+0000","last_active":"2023-09-10T00:12:48.581814+0000","last_peered":"2023-09-10T00:12:48.581814+0000","last_clean":"2023-09-10T00:12:48.581814+0000","last_became_active":"2023-09-10T00:12:46.585950+0000","last_became_peered":"2023-09-10T00:12:46.585950+0000","last_unstale":"2023-09-10T00:12:48.581814+0000","last_undegraded":"2023-09-10T00:12:48.581814+0000","last_fullsized":"2023-09-10T00:12:48.581814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:31.560504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783664+0000","last_change":"2023-09-10T00:12:41.527986+0000","last_active":"2023-09-10T00:12:47.783664+0000","last_peered":"2023-09-10T00:12:47.783664+0000","last_clean":"2023-09-10T00:12:47.783664+0000","last_became_active":"2023-09-10T00:12:41.527417+0000","last_became_peered":"2023-09-10T00:12:41.527417+0000","last_unstale":"2023-09-10T00:12:47.783664+0000","last_undegraded":"2023-09-10T00:12:47.783664+0000","last_fullsized":"2023-09-10T00:12:47.783664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781841+0000","last_change":"2023-09-10T00:12:42.549603+0000","last_active":"2023-09-10T00:12:47.781841+0000","last_peered":"2023-09-10T00:12:47.781841+0000","last_clean":"2023-09-10T00:12:47.781841+0000","last_became_active":"2023-09-10T00:12:42.549082+0000","last_became_peered":"2023-09-10T00:12:42.549082+0000","last_unstale":"2023-09-10T00:12:47.781841+0000","last_undegraded":"2023-09-10T00:12:47.781841+0000","last_fullsized":"2023-09-10T00:12:47.781841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583016+0000","last_change":"2023-09-10T00:12:46.598936+0000","last_active":"2023-09-10T00:12:48.583016+0000","last_peered":"2023-09-10T00:12:48.583016+0000","last_clean":"2023-09-10T00:12:48.583016+0000","last_became_active":"2023-09-10T00:12:46.595513+0000","last_became_peered":"2023-09-10T00:12:46.595513+0000","last_unstale":"2023-09-10T00:12:48.583016+0000","last_undegraded":"2023-09-10T00:12:48.583016+0000","last_fullsized":"2023-09-10T00:12:48.583016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783420+0000","last_change":"2023-09-10T00:12:41.528161+0000","last_active":"2023-09-10T00:12:47.783420+0000","last_peered":"2023-09-10T00:12:47.783420+0000","last_clean":"2023-09-10T00:12:47.783420+0000","last_became_active":"2023-09-10T00:12:41.527502+0000","last_became_peered":"2023-09-10T00:12:41.527502+0000","last_unstale":"2023-09-10T00:12:47.783420+0000","last_undegraded":"2023-09-10T00:12:47.783420+0000","last_fullsized":"2023-09-10T00:12:47.783420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782651+0000","last_change":"2023-09-10T00:12:42.540628+0000","last_active":"2023-09-10T00:12:47.782651+0000","last_peered":"2023-09-10T00:12:47.782651+0000","last_clean":"2023-09-10T00:12:47.782651+0000","last_became_active":"2023-09-10T00:12:42.539869+0000","last_became_peered":"2023-09-10T00:12:42.539869+0000","last_unstale":"2023-09-10T00:12:47.782651+0000","last_undegraded":"2023-09-10T00:12:47.782651+0000","last_fullsized":"2023-09-10T00:12:47.782651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582233+0000","last_change":"2023-09-10T00:12:46.591413+0000","last_active":"2023-09-10T00:12:48.582233+0000","last_peered":"2023-09-10T00:12:48.582233+0000","last_clean":"2023-09-10T00:12:48.582233+0000","last_became_active":"2023-09-10T00:12:46.590270+0000","last_became_peered":"2023-09-10T00:12:46.590270+0000","last_unstale":"2023-09-10T00:12:48.582233+0000","last_undegraded":"2023-09-10T00:12:48.582233+0000","last_fullsized":"2023-09-10T00:12:48.582233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:43:11.882300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581794+0000","last_change":"2023-09-10T00:12:42.507279+0000","last_active":"2023-09-10T00:12:47.581794+0000","last_peered":"2023-09-10T00:12:47.581794+0000","last_clean":"2023-09-10T00:12:47.581794+0000","last_became_active":"2023-09-10T00:12:42.506014+0000","last_became_peered":"2023-09-10T00:12:42.506014+0000","last_unstale":"2023-09-10T00:12:47.581794+0000","last_undegraded":"2023-09-10T00:12:47.581794+0000","last_fullsized":"2023-09-10T00:12:47.581794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783530+0000","last_change":"2023-09-10T00:12:41.530493+0000","last_active":"2023-09-10T00:12:47.783530+0000","last_peered":"2023-09-10T00:12:47.783530+0000","last_clean":"2023-09-10T00:12:47.783530+0000","last_became_active":"2023-09-10T00:12:41.529930+0000","last_became_peered":"2023-09-10T00:12:41.529930+0000","last_unstale":"2023-09-10T00:12:47.783530+0000","last_undegraded":"2023-09-10T00:12:47.783530+0000","last_fullsized":"2023-09-10T00:12:47.783530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584979+0000","last_change":"2023-09-10T00:12:46.585841+0000","last_active":"2023-09-10T00:12:48.584979+0000","last_peered":"2023-09-10T00:12:48.584979+0000","last_clean":"2023-09-10T00:12:48.584979+0000","last_became_active":"2023-09-10T00:12:46.584664+0000","last_became_peered":"2023-09-10T00:12:46.584664+0000","last_unstale":"2023-09-10T00:12:48.584979+0000","last_undegraded":"2023-09-10T00:12:48.584979+0000","last_fullsized":"2023-09-10T00:12:48.584979+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783202+0000","last_change":"2023-09-10T00:12:42.503145+0000","last_active":"2023-09-10T00:12:47.783202+0000","last_peered":"2023-09-10T00:12:47.783202+0000","last_clean":"2023-09-10T00:12:47.783202+0000","last_became_active":"2023-09-10T00:12:42.502860+0000","last_became_peered":"2023-09-10T00:12:42.502860+0000","last_unstale":"2023-09-10T00:12:47.783202+0000","last_undegraded":"2023-09-10T00:12:47.783202+0000","last_fullsized":"2023-09-10T00:12:47.783202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615505+0000","last_change":"2023-09-10T00:12:41.495145+0000","last_active":"2023-09-10T00:12:47.615505+0000","last_peered":"2023-09-10T00:12:47.615505+0000","last_clean":"2023-09-10T00:12:47.615505+0000","last_became_active":"2023-09-10T00:12:41.494723+0000","last_became_peered":"2023-09-10T00:12:41.494723+0000","last_unstale":"2023-09-10T00:12:47.615505+0000","last_undegraded":"2023-09-10T00:12:47.615505+0000","last_fullsized":"2023-09-10T00:12:47.615505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:28:44.771070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584304+0000","last_change":"2023-09-10T00:12:46.598895+0000","last_active":"2023-09-10T00:12:48.584304+0000","last_peered":"2023-09-10T00:12:48.584304+0000","last_clean":"2023-09-10T00:12:48.584304+0000","last_became_active":"2023-09-10T00:12:46.597512+0000","last_became_peered":"2023-09-10T00:12:46.597512+0000","last_unstale":"2023-09-10T00:12:48.584304+0000","last_undegraded":"2023-09-10T00:12:48.584304+0000","last_fullsized":"2023-09-10T00:12:48.584304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782945+0000","last_change":"2023-09-10T00:12:42.506592+0000","last_active":"2023-09-10T00:12:47.782945+0000","last_peered":"2023-09-10T00:12:47.782945+0000","last_clean":"2023-09-10T00:12:47.782945+0000","last_became_active":"2023-09-10T00:12:42.498699+0000","last_became_peered":"2023-09-10T00:12:42.498699+0000","last_unstale":"2023-09-10T00:12:47.782945+0000","last_undegraded":"2023-09-10T00:12:47.782945+0000","last_fullsized":"2023-09-10T00:12:47.782945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614899+0000","last_change":"2023-09-10T00:12:41.511349+0000","last_active":"2023-09-10T00:12:47.614899+0000","last_peered":"2023-09-10T00:12:47.614899+0000","last_clean":"2023-09-10T00:12:47.614899+0000","last_became_active":"2023-09-10T00:12:41.511068+0000","last_became_peered":"2023-09-10T00:12:41.511068+0000","last_unstale":"2023-09-10T00:12:47.614899+0000","last_undegraded":"2023-09-10T00:12:47.614899+0000","last_fullsized":"2023-09-10T00:12:47.614899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:15.836419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224891+0000","last_change":"2023-09-10T00:12:47.444639+0000","last_active":"2023-09-10T00:12:49.224891+0000","last_peered":"2023-09-10T00:12:49.224891+0000","last_clean":"2023-09-10T00:12:49.224891+0000","last_became_active":"2023-09-10T00:12:47.443285+0000","last_became_peered":"2023-09-10T00:12:47.443285+0000","last_unstale":"2023-09-10T00:12:49.224891+0000","last_undegraded":"2023-09-10T00:12:49.224891+0000","last_fullsized":"2023-09-10T00:12:49.224891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:23.785184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580956+0000","last_change":"2023-09-10T00:12:42.502827+0000","last_active":"2023-09-10T00:12:47.580956+0000","last_peered":"2023-09-10T00:12:47.580956+0000","last_clean":"2023-09-10T00:12:47.580956+0000","last_became_active":"2023-09-10T00:12:42.498059+0000","last_became_peered":"2023-09-10T00:12:42.498059+0000","last_unstale":"2023-09-10T00:12:47.580956+0000","last_undegraded":"2023-09-10T00:12:47.580956+0000","last_fullsized":"2023-09-10T00:12:47.580956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:30.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782172+0000","last_change":"2023-09-10T00:12:41.522787+0000","last_active":"2023-09-10T00:12:47.782172+0000","last_peered":"2023-09-10T00:12:47.782172+0000","last_clean":"2023-09-10T00:12:47.782172+0000","last_became_active":"2023-09-10T00:12:41.521261+0000","last_became_peered":"2023-09-10T00:12:41.521261+0000","last_unstale":"2023-09-10T00:12:47.782172+0000","last_undegraded":"2023-09-10T00:12:47.782172+0000","last_fullsized":"2023-09-10T00:12:47.782172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:04:32.449308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584798+0000","last_change":"2023-09-10T00:12:46.594098+0000","last_active":"2023-09-10T00:12:48.584798+0000","last_peered":"2023-09-10T00:12:48.584798+0000","last_clean":"2023-09-10T00:12:48.584798+0000","last_became_active":"2023-09-10T00:12:46.592902+0000","last_became_peered":"2023-09-10T00:12:46.592902+0000","last_unstale":"2023-09-10T00:12:48.584798+0000","last_undegraded":"2023-09-10T00:12:48.584798+0000","last_fullsized":"2023-09-10T00:12:48.584798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781833+0000","last_change":"2023-09-10T00:12:42.494258+0000","last_active":"2023-09-10T00:12:47.781833+0000","last_peered":"2023-09-10T00:12:47.781833+0000","last_clean":"2023-09-10T00:12:47.781833+0000","last_became_active":"2023-09-10T00:12:42.493975+0000","last_became_peered":"2023-09-10T00:12:42.493975+0000","last_unstale":"2023-09-10T00:12:47.781833+0000","last_undegraded":"2023-09-10T00:12:47.781833+0000","last_fullsized":"2023-09-10T00:12:47.781833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:06.533952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583823+0000","last_change":"2023-09-10T00:12:41.507450+0000","last_active":"2023-09-10T00:12:47.583823+0000","last_peered":"2023-09-10T00:12:47.583823+0000","last_clean":"2023-09-10T00:12:47.583823+0000","last_became_active":"2023-09-10T00:12:41.506687+0000","last_became_peered":"2023-09-10T00:12:41.506687+0000","last_unstale":"2023-09-10T00:12:47.583823+0000","last_undegraded":"2023-09-10T00:12:47.583823+0000","last_fullsized":"2023-09-10T00:12:47.583823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582305+0000","last_change":"2023-09-10T00:12:47.439167+0000","last_active":"2023-09-10T00:12:48.582305+0000","last_peered":"2023-09-10T00:12:48.582305+0000","last_clean":"2023-09-10T00:12:48.582305+0000","last_became_active":"2023-09-10T00:12:47.438136+0000","last_became_peered":"2023-09-10T00:12:47.438136+0000","last_unstale":"2023-09-10T00:12:48.582305+0000","last_undegraded":"2023-09-10T00:12:48.582305+0000","last_fullsized":"2023-09-10T00:12:48.582305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:39:24.652596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784017+0000","last_change":"2023-09-10T00:12:42.505311+0000","last_active":"2023-09-10T00:12:47.784017+0000","last_peered":"2023-09-10T00:12:47.784017+0000","last_clean":"2023-09-10T00:12:47.784017+0000","last_became_active":"2023-09-10T00:12:42.504994+0000","last_became_peered":"2023-09-10T00:12:42.504994+0000","last_unstale":"2023-09-10T00:12:47.784017+0000","last_undegraded":"2023-09-10T00:12:47.784017+0000","last_fullsized":"2023-09-10T00:12:47.784017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615569+0000","last_change":"2023-09-10T00:12:41.511281+0000","last_active":"2023-09-10T00:12:47.615569+0000","last_peered":"2023-09-10T00:12:47.615569+0000","last_clean":"2023-09-10T00:12:47.615569+0000","last_became_active":"2023-09-10T00:12:41.510955+0000","last_became_peered":"2023-09-10T00:12:41.510955+0000","last_unstale":"2023-09-10T00:12:47.615569+0000","last_undegraded":"2023-09-10T00:12:47.615569+0000","last_fullsized":"2023-09-10T00:12:47.615569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:04:20.102763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.577831+0000","last_change":"2023-09-10T00:12:47.439819+0000","last_active":"2023-09-10T00:12:48.577831+0000","last_peered":"2023-09-10T00:12:48.577831+0000","last_clean":"2023-09-10T00:12:48.577831+0000","last_became_active":"2023-09-10T00:12:47.438387+0000","last_became_peered":"2023-09-10T00:12:47.438387+0000","last_unstale":"2023-09-10T00:12:48.577831+0000","last_undegraded":"2023-09-10T00:12:48.577831+0000","last_fullsized":"2023-09-10T00:12:48.577831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:19:55.443215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615124+0000","last_change":"2023-09-10T00:12:42.505051+0000","last_active":"2023-09-10T00:12:47.615124+0000","last_peered":"2023-09-10T00:12:47.615124+0000","last_clean":"2023-09-10T00:12:47.615124+0000","last_became_active":"2023-09-10T00:12:42.503680+0000","last_became_peered":"2023-09-10T00:12:42.503680+0000","last_unstale":"2023-09-10T00:12:47.615124+0000","last_undegraded":"2023-09-10T00:12:47.615124+0000","last_fullsized":"2023-09-10T00:12:47.615124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:32.318944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:41.530921+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:41.529005+0000","last_became_peered":"2023-09-10T00:12:41.529005+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:39.114481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222557+0000","last_change":"2023-09-10T00:12:47.432879+0000","last_active":"2023-09-10T00:12:49.222557+0000","last_peered":"2023-09-10T00:12:49.222557+0000","last_clean":"2023-09-10T00:12:49.222557+0000","last_became_active":"2023-09-10T00:12:47.431809+0000","last_became_peered":"2023-09-10T00:12:47.431809+0000","last_unstale":"2023-09-10T00:12:49.222557+0000","last_undegraded":"2023-09-10T00:12:49.222557+0000","last_fullsized":"2023-09-10T00:12:49.222557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:44:33.407034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782710+0000","last_change":"2023-09-10T00:12:42.539827+0000","last_active":"2023-09-10T00:12:47.782710+0000","last_peered":"2023-09-10T00:12:47.782710+0000","last_clean":"2023-09-10T00:12:47.782710+0000","last_became_active":"2023-09-10T00:12:42.537005+0000","last_became_peered":"2023-09-10T00:12:42.537005+0000","last_unstale":"2023-09-10T00:12:47.782710+0000","last_undegraded":"2023-09-10T00:12:47.782710+0000","last_fullsized":"2023-09-10T00:12:47.782710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615250+0000","last_change":"2023-09-10T00:12:41.502711+0000","last_active":"2023-09-10T00:12:47.615250+0000","last_peered":"2023-09-10T00:12:47.615250+0000","last_clean":"2023-09-10T00:12:47.615250+0000","last_became_active":"2023-09-10T00:12:41.501978+0000","last_became_peered":"2023-09-10T00:12:41.501978+0000","last_unstale":"2023-09-10T00:12:47.615250+0000","last_undegraded":"2023-09-10T00:12:47.615250+0000","last_fullsized":"2023-09-10T00:12:47.615250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:02:42.904824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223956+0000","last_change":"2023-09-10T00:12:46.590131+0000","last_active":"2023-09-10T00:12:49.223956+0000","last_peered":"2023-09-10T00:12:49.223956+0000","last_clean":"2023-09-10T00:12:49.223956+0000","last_became_active":"2023-09-10T00:12:46.589585+0000","last_became_peered":"2023-09-10T00:12:46.589585+0000","last_unstale":"2023-09-10T00:12:49.223956+0000","last_undegraded":"2023-09-10T00:12:49.223956+0000","last_fullsized":"2023-09-10T00:12:49.223956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:27:21.324259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581586+0000","last_change":"2023-09-10T00:12:42.487629+0000","last_active":"2023-09-10T00:12:47.581586+0000","last_peered":"2023-09-10T00:12:47.581586+0000","last_clean":"2023-09-10T00:12:47.581586+0000","last_became_active":"2023-09-10T00:12:42.486705+0000","last_became_peered":"2023-09-10T00:12:42.486705+0000","last_unstale":"2023-09-10T00:12:47.581586+0000","last_undegraded":"2023-09-10T00:12:47.581586+0000","last_fullsized":"2023-09-10T00:12:47.581586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:34:10.530303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782116+0000","last_change":"2023-09-10T00:12:41.524050+0000","last_active":"2023-09-10T00:12:47.782116+0000","last_peered":"2023-09-10T00:12:47.782116+0000","last_clean":"2023-09-10T00:12:47.782116+0000","last_became_active":"2023-09-10T00:12:41.523285+0000","last_became_peered":"2023-09-10T00:12:41.523285+0000","last_unstale":"2023-09-10T00:12:47.782116+0000","last_undegraded":"2023-09-10T00:12:47.782116+0000","last_fullsized":"2023-09-10T00:12:47.782116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224831+0000","last_change":"2023-09-10T00:12:46.591434+0000","last_active":"2023-09-10T00:12:49.224831+0000","last_peered":"2023-09-10T00:12:49.224831+0000","last_clean":"2023-09-10T00:12:49.224831+0000","last_became_active":"2023-09-10T00:12:46.590715+0000","last_became_peered":"2023-09-10T00:12:46.590715+0000","last_unstale":"2023-09-10T00:12:49.224831+0000","last_undegraded":"2023-09-10T00:12:49.224831+0000","last_fullsized":"2023-09-10T00:12:49.224831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:01:46.108256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615490+0000","last_change":"2023-09-10T00:12:42.497905+0000","last_active":"2023-09-10T00:12:47.615490+0000","last_peered":"2023-09-10T00:12:47.615490+0000","last_clean":"2023-09-10T00:12:47.615490+0000","last_became_active":"2023-09-10T00:12:42.497598+0000","last_became_peered":"2023-09-10T00:12:42.497598+0000","last_unstale":"2023-09-10T00:12:47.615490+0000","last_undegraded":"2023-09-10T00:12:47.615490+0000","last_fullsized":"2023-09-10T00:12:47.615490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:39:55.974777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577625+0000","last_change":"2023-09-10T00:12:41.498033+0000","last_active":"2023-09-10T00:12:47.577625+0000","last_peered":"2023-09-10T00:12:47.577625+0000","last_clean":"2023-09-10T00:12:47.577625+0000","last_became_active":"2023-09-10T00:12:41.497632+0000","last_became_peered":"2023-09-10T00:12:41.497632+0000","last_unstale":"2023-09-10T00:12:47.577625+0000","last_undegraded":"2023-09-10T00:12:47.577625+0000","last_fullsized":"2023-09-10T00:12:47.577625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:53:47.827726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224987+0000","last_change":"2023-09-10T00:12:46.589989+0000","last_active":"2023-09-10T00:12:49.224987+0000","last_peered":"2023-09-10T00:12:49.224987+0000","last_clean":"2023-09-10T00:12:49.224987+0000","last_became_active":"2023-09-10T00:12:46.589560+0000","last_became_peered":"2023-09-10T00:12:46.589560+0000","last_unstale":"2023-09-10T00:12:49.224987+0000","last_undegraded":"2023-09-10T00:12:49.224987+0000","last_fullsized":"2023-09-10T00:12:49.224987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:23:04.922319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780468+0000","last_change":"2023-09-10T00:12:42.492499+0000","last_active":"2023-09-10T00:12:47.780468+0000","last_peered":"2023-09-10T00:12:47.780468+0000","last_clean":"2023-09-10T00:12:47.780468+0000","last_became_active":"2023-09-10T00:12:42.492155+0000","last_became_peered":"2023-09-10T00:12:42.492155+0000","last_unstale":"2023-09-10T00:12:47.780468+0000","last_undegraded":"2023-09-10T00:12:47.780468+0000","last_fullsized":"2023-09-10T00:12:47.780468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:01.022446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782334+0000","last_change":"2023-09-10T00:12:41.523334+0000","last_active":"2023-09-10T00:12:47.782334+0000","last_peered":"2023-09-10T00:12:47.782334+0000","last_clean":"2023-09-10T00:12:47.782334+0000","last_became_active":"2023-09-10T00:12:41.522077+0000","last_became_peered":"2023-09-10T00:12:41.522077+0000","last_unstale":"2023-09-10T00:12:47.782334+0000","last_undegraded":"2023-09-10T00:12:47.782334+0000","last_fullsized":"2023-09-10T00:12:47.782334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:45:56.684537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223676+0000","last_change":"2023-09-10T00:12:47.432900+0000","last_active":"2023-09-10T00:12:49.223676+0000","last_peered":"2023-09-10T00:12:49.223676+0000","last_clean":"2023-09-10T00:12:49.223676+0000","last_became_active":"2023-09-10T00:12:47.431680+0000","last_became_peered":"2023-09-10T00:12:47.431680+0000","last_unstale":"2023-09-10T00:12:49.223676+0000","last_undegraded":"2023-09-10T00:12:49.223676+0000","last_fullsized":"2023-09-10T00:12:49.223676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:53.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782928+0000","last_change":"2023-09-10T00:12:42.550864+0000","last_active":"2023-09-10T00:12:47.782928+0000","last_peered":"2023-09-10T00:12:47.782928+0000","last_clean":"2023-09-10T00:12:47.782928+0000","last_became_active":"2023-09-10T00:12:42.550585+0000","last_became_peered":"2023-09-10T00:12:42.550585+0000","last_unstale":"2023-09-10T00:12:47.782928+0000","last_undegraded":"2023-09-10T00:12:47.782928+0000","last_fullsized":"2023-09-10T00:12:47.782928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781180+0000","last_change":"2023-09-10T00:12:41.519797+0000","last_active":"2023-09-10T00:12:47.781180+0000","last_peered":"2023-09-10T00:12:47.781180+0000","last_clean":"2023-09-10T00:12:47.781180+0000","last_became_active":"2023-09-10T00:12:41.519164+0000","last_became_peered":"2023-09-10T00:12:41.519164+0000","last_unstale":"2023-09-10T00:12:47.781180+0000","last_undegraded":"2023-09-10T00:12:47.781180+0000","last_fullsized":"2023-09-10T00:12:47.781180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782450+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:12:47.782450+0000","last_peered":"2023-09-10T00:12:47.782450+0000","last_clean":"2023-09-10T00:12:47.782450+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:12:47.782450+0000","last_undegraded":"2023-09-10T00:12:47.782450+0000","last_fullsized":"2023-09-10T00:12:47.782450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.584664+0000","last_change":"2023-09-10T00:12:47.439252+0000","last_active":"2023-09-10T00:12:48.584664+0000","last_peered":"2023-09-10T00:12:48.584664+0000","last_clean":"2023-09-10T00:12:48.584664+0000","last_became_active":"2023-09-10T00:12:47.438174+0000","last_became_peered":"2023-09-10T00:12:47.438174+0000","last_unstale":"2023-09-10T00:12:48.584664+0000","last_undegraded":"2023-09-10T00:12:48.584664+0000","last_fullsized":"2023-09-10T00:12:48.584664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:30:57.581942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783443+0000","last_change":"2023-09-10T00:12:42.551864+0000","last_active":"2023-09-10T00:12:47.783443+0000","last_peered":"2023-09-10T00:12:47.783443+0000","last_clean":"2023-09-10T00:12:47.783443+0000","last_became_active":"2023-09-10T00:12:42.551345+0000","last_became_peered":"2023-09-10T00:12:42.551345+0000","last_unstale":"2023-09-10T00:12:47.783443+0000","last_undegraded":"2023-09-10T00:12:47.783443+0000","last_fullsized":"2023-09-10T00:12:47.783443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:36:43.748204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578183+0000","last_change":"2023-09-10T00:12:41.516689+0000","last_active":"2023-09-10T00:12:47.578183+0000","last_peered":"2023-09-10T00:12:47.578183+0000","last_clean":"2023-09-10T00:12:47.578183+0000","last_became_active":"2023-09-10T00:12:41.516069+0000","last_became_peered":"2023-09-10T00:12:41.516069+0000","last_unstale":"2023-09-10T00:12:47.578183+0000","last_undegraded":"2023-09-10T00:12:47.578183+0000","last_fullsized":"2023-09-10T00:12:47.578183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:22:16.109534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.582898+0000","last_change":"2023-09-10T00:12:47.431597+0000","last_active":"2023-09-10T00:12:48.582898+0000","last_peered":"2023-09-10T00:12:48.582898+0000","last_clean":"2023-09-10T00:12:48.582898+0000","last_became_active":"2023-09-10T00:12:47.430655+0000","last_became_peered":"2023-09-10T00:12:47.430655+0000","last_unstale":"2023-09-10T00:12:48.582898+0000","last_undegraded":"2023-09-10T00:12:48.582898+0000","last_fullsized":"2023-09-10T00:12:48.582898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:33:42.114053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782062+0000","last_change":"2023-09-10T00:12:42.541778+0000","last_active":"2023-09-10T00:12:47.782062+0000","last_peered":"2023-09-10T00:12:47.782062+0000","last_clean":"2023-09-10T00:12:47.782062+0000","last_became_active":"2023-09-10T00:12:42.541049+0000","last_became_peered":"2023-09-10T00:12:42.541049+0000","last_unstale":"2023-09-10T00:12:47.782062+0000","last_undegraded":"2023-09-10T00:12:47.782062+0000","last_fullsized":"2023-09-10T00:12:47.782062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615672+0000","last_change":"2023-09-10T00:12:41.509830+0000","last_active":"2023-09-10T00:12:47.615672+0000","last_peered":"2023-09-10T00:12:47.615672+0000","last_clean":"2023-09-10T00:12:47.615672+0000","last_became_active":"2023-09-10T00:12:41.509495+0000","last_became_peered":"2023-09-10T00:12:41.509495+0000","last_unstale":"2023-09-10T00:12:47.615672+0000","last_undegraded":"2023-09-10T00:12:47.615672+0000","last_fullsized":"2023-09-10T00:12:47.615672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:44:59.635926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223136+0000","last_change":"2023-09-10T00:12:46.595012+0000","last_active":"2023-09-10T00:12:49.223136+0000","last_peered":"2023-09-10T00:12:49.223136+0000","last_clean":"2023-09-10T00:12:49.223136+0000","last_became_active":"2023-09-10T00:12:46.594222+0000","last_became_peered":"2023-09-10T00:12:46.594222+0000","last_unstale":"2023-09-10T00:12:49.223136+0000","last_undegraded":"2023-09-10T00:12:49.223136+0000","last_fullsized":"2023-09-10T00:12:49.223136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784267+0000","last_change":"2023-09-10T00:12:42.546647+0000","last_active":"2023-09-10T00:12:47.784267+0000","last_peered":"2023-09-10T00:12:47.784267+0000","last_clean":"2023-09-10T00:12:47.784267+0000","last_became_active":"2023-09-10T00:12:42.546180+0000","last_became_peered":"2023-09-10T00:12:42.546180+0000","last_unstale":"2023-09-10T00:12:47.784267+0000","last_undegraded":"2023-09-10T00:12:47.784267+0000","last_fullsized":"2023-09-10T00:12:47.784267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578028+0000","last_change":"2023-09-10T00:12:41.498190+0000","last_active":"2023-09-10T00:12:47.578028+0000","last_peered":"2023-09-10T00:12:47.578028+0000","last_clean":"2023-09-10T00:12:47.578028+0000","last_became_active":"2023-09-10T00:12:41.497767+0000","last_became_peered":"2023-09-10T00:12:41.497767+0000","last_unstale":"2023-09-10T00:12:47.578028+0000","last_undegraded":"2023-09-10T00:12:47.578028+0000","last_fullsized":"2023-09-10T00:12:47.578028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:26:08.442308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222434+0000","last_change":"2023-09-10T00:12:47.432026+0000","last_active":"2023-09-10T00:12:49.222434+0000","last_peered":"2023-09-10T00:12:49.222434+0000","last_clean":"2023-09-10T00:12:49.222434+0000","last_became_active":"2023-09-10T00:12:47.430924+0000","last_became_peered":"2023-09-10T00:12:47.430924+0000","last_unstale":"2023-09-10T00:12:49.222434+0000","last_undegraded":"2023-09-10T00:12:49.222434+0000","last_fullsized":"2023-09-10T00:12:49.222434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:00:59.475157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783979+0000","last_change":"2023-09-10T00:12:42.541280+0000","last_active":"2023-09-10T00:12:47.783979+0000","last_peered":"2023-09-10T00:12:47.783979+0000","last_clean":"2023-09-10T00:12:47.783979+0000","last_became_active":"2023-09-10T00:12:42.533762+0000","last_became_peered":"2023-09-10T00:12:42.533762+0000","last_unstale":"2023-09-10T00:12:47.783979+0000","last_undegraded":"2023-09-10T00:12:47.783979+0000","last_fullsized":"2023-09-10T00:12:47.783979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:29:01.364120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581569+0000","last_change":"2023-09-10T00:12:41.503433+0000","last_active":"2023-09-10T00:12:47.581569+0000","last_peered":"2023-09-10T00:12:47.581569+0000","last_clean":"2023-09-10T00:12:47.581569+0000","last_became_active":"2023-09-10T00:12:41.502639+0000","last_became_peered":"2023-09-10T00:12:41.502639+0000","last_unstale":"2023-09-10T00:12:47.581569+0000","last_undegraded":"2023-09-10T00:12:47.581569+0000","last_fullsized":"2023-09-10T00:12:47.581569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:28:54.792772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.581399+0000","last_change":"2023-09-10T00:12:46.602461+0000","last_active":"2023-09-10T00:12:48.581399+0000","last_peered":"2023-09-10T00:12:48.581399+0000","last_clean":"2023-09-10T00:12:48.581399+0000","last_became_active":"2023-09-10T00:12:46.601011+0000","last_became_peered":"2023-09-10T00:12:46.601011+0000","last_unstale":"2023-09-10T00:12:48.581399+0000","last_undegraded":"2023-09-10T00:12:48.581399+0000","last_fullsized":"2023-09-10T00:12:48.581399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782746+0000","last_change":"2023-09-10T00:12:42.518701+0000","last_active":"2023-09-10T00:12:47.782746+0000","last_peered":"2023-09-10T00:12:47.782746+0000","last_clean":"2023-09-10T00:12:47.782746+0000","last_became_active":"2023-09-10T00:12:42.517943+0000","last_became_peered":"2023-09-10T00:12:42.517943+0000","last_unstale":"2023-09-10T00:12:47.782746+0000","last_undegraded":"2023-09-10T00:12:47.782746+0000","last_fullsized":"2023-09-10T00:12:47.782746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577561+0000","last_change":"2023-09-10T00:12:41.496219+0000","last_active":"2023-09-10T00:12:47.577561+0000","last_peered":"2023-09-10T00:12:47.577561+0000","last_clean":"2023-09-10T00:12:47.577561+0000","last_became_active":"2023-09-10T00:12:41.495862+0000","last_became_peered":"2023-09-10T00:12:41.495862+0000","last_unstale":"2023-09-10T00:12:47.577561+0000","last_undegraded":"2023-09-10T00:12:47.577561+0000","last_fullsized":"2023-09-10T00:12:47.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:56:10.667850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223317+0000","last_change":"2023-09-10T00:12:46.592307+0000","last_active":"2023-09-10T00:12:49.223317+0000","last_peered":"2023-09-10T00:12:49.223317+0000","last_clean":"2023-09-10T00:12:49.223317+0000","last_became_active":"2023-09-10T00:12:46.591133+0000","last_became_peered":"2023-09-10T00:12:46.591133+0000","last_unstale":"2023-09-10T00:12:49.223317+0000","last_undegraded":"2023-09-10T00:12:49.223317+0000","last_fullsized":"2023-09-10T00:12:49.223317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580013+0000","last_change":"2023-09-10T00:12:42.524709+0000","last_active":"2023-09-10T00:12:47.580013+0000","last_peered":"2023-09-10T00:12:47.580013+0000","last_clean":"2023-09-10T00:12:47.580013+0000","last_became_active":"2023-09-10T00:12:42.505826+0000","last_became_peered":"2023-09-10T00:12:42.505826+0000","last_unstale":"2023-09-10T00:12:47.580013+0000","last_undegraded":"2023-09-10T00:12:47.580013+0000","last_fullsized":"2023-09-10T00:12:47.580013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579962+0000","last_change":"2023-09-10T00:12:41.495448+0000","last_active":"2023-09-10T00:12:47.579962+0000","last_peered":"2023-09-10T00:12:47.579962+0000","last_clean":"2023-09-10T00:12:47.579962+0000","last_became_active":"2023-09-10T00:12:41.494697+0000","last_became_peered":"2023-09-10T00:12:41.494697+0000","last_unstale":"2023-09-10T00:12:47.579962+0000","last_undegraded":"2023-09-10T00:12:47.579962+0000","last_fullsized":"2023-09-10T00:12:47.579962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:21:19.631538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579415+0000","last_change":"2023-09-10T00:12:47.439992+0000","last_active":"2023-09-10T00:12:48.579415+0000","last_peered":"2023-09-10T00:12:48.579415+0000","last_clean":"2023-09-10T00:12:48.579415+0000","last_became_active":"2023-09-10T00:12:47.438590+0000","last_became_peered":"2023-09-10T00:12:47.438590+0000","last_unstale":"2023-09-10T00:12:48.579415+0000","last_undegraded":"2023-09-10T00:12:48.579415+0000","last_fullsized":"2023-09-10T00:12:48.579415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:09:09.398224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783239+0000","last_change":"2023-09-10T00:12:42.541600+0000","last_active":"2023-09-10T00:12:47.783239+0000","last_peered":"2023-09-10T00:12:47.783239+0000","last_clean":"2023-09-10T00:12:47.783239+0000","last_became_active":"2023-09-10T00:12:42.533858+0000","last_became_peered":"2023-09-10T00:12:42.533858+0000","last_unstale":"2023-09-10T00:12:47.783239+0000","last_undegraded":"2023-09-10T00:12:47.783239+0000","last_fullsized":"2023-09-10T00:12:47.783239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781900+0000","last_change":"2023-09-10T00:12:41.523860+0000","last_active":"2023-09-10T00:12:47.781900+0000","last_peered":"2023-09-10T00:12:47.781900+0000","last_clean":"2023-09-10T00:12:47.781900+0000","last_became_active":"2023-09-10T00:12:41.522192+0000","last_became_peered":"2023-09-10T00:12:41.522192+0000","last_unstale":"2023-09-10T00:12:47.781900+0000","last_undegraded":"2023-09-10T00:12:47.781900+0000","last_fullsized":"2023-09-10T00:12:47.781900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:07:29.890350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578583+0000","last_change":"2023-09-10T00:12:47.432628+0000","last_active":"2023-09-10T00:12:48.578583+0000","last_peered":"2023-09-10T00:12:48.578583+0000","last_clean":"2023-09-10T00:12:48.578583+0000","last_became_active":"2023-09-10T00:12:47.431415+0000","last_became_peered":"2023-09-10T00:12:47.431415+0000","last_unstale":"2023-09-10T00:12:48.578583+0000","last_undegraded":"2023-09-10T00:12:48.578583+0000","last_fullsized":"2023-09-10T00:12:48.578583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:30:23.542385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780877+0000","last_change":"2023-09-10T00:12:42.514023+0000","last_active":"2023-09-10T00:12:47.780877+0000","last_peered":"2023-09-10T00:12:47.780877+0000","last_clean":"2023-09-10T00:12:47.780877+0000","last_became_active":"2023-09-10T00:12:42.513715+0000","last_became_peered":"2023-09-10T00:12:42.513715+0000","last_unstale":"2023-09-10T00:12:47.780877+0000","last_undegraded":"2023-09-10T00:12:47.780877+0000","last_fullsized":"2023-09-10T00:12:47.780877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781349+0000","last_change":"2023-09-10T00:12:41.501329+0000","last_active":"2023-09-10T00:12:47.781349+0000","last_peered":"2023-09-10T00:12:47.781349+0000","last_clean":"2023-09-10T00:12:47.781349+0000","last_became_active":"2023-09-10T00:12:41.500908+0000","last_became_peered":"2023-09-10T00:12:41.500908+0000","last_unstale":"2023-09-10T00:12:47.781349+0000","last_undegraded":"2023-09-10T00:12:47.781349+0000","last_fullsized":"2023-09-10T00:12:47.781349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:42.290409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.223679+0000","last_change":"2023-09-10T00:12:47.439596+0000","last_active":"2023-09-10T00:12:49.223679+0000","last_peered":"2023-09-10T00:12:49.223679+0000","last_clean":"2023-09-10T00:12:49.223679+0000","last_became_active":"2023-09-10T00:12:47.438423+0000","last_became_peered":"2023-09-10T00:12:47.438423+0000","last_unstale":"2023-09-10T00:12:49.223679+0000","last_undegraded":"2023-09-10T00:12:49.223679+0000","last_fullsized":"2023-09-10T00:12:49.223679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:51:19.057228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783453+0000","last_change":"2023-09-10T00:12:42.518431+0000","last_active":"2023-09-10T00:12:47.783453+0000","last_peered":"2023-09-10T00:12:47.783453+0000","last_clean":"2023-09-10T00:12:47.783453+0000","last_became_active":"2023-09-10T00:12:42.515011+0000","last_became_peered":"2023-09-10T00:12:42.515011+0000","last_unstale":"2023-09-10T00:12:47.783453+0000","last_undegraded":"2023-09-10T00:12:47.783453+0000","last_fullsized":"2023-09-10T00:12:47.783453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:52.647101+0000","last_change":"2023-09-10T00:12:41.501247+0000","last_active":"2023-09-10T00:12:52.647101+0000","last_peered":"2023-09-10T00:12:52.647101+0000","last_clean":"2023-09-10T00:12:52.647101+0000","last_became_active":"2023-09-10T00:12:41.500391+0000","last_became_peered":"2023-09-10T00:12:41.500391+0000","last_unstale":"2023-09-10T00:12:52.647101+0000","last_undegraded":"2023-09-10T00:12:52.647101+0000","last_fullsized":"2023-09-10T00:12:52.647101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.224306+0000","last_change":"2023-09-10T00:12:46.591484+0000","last_active":"2023-09-10T00:12:49.224306+0000","last_peered":"2023-09-10T00:12:49.224306+0000","last_clean":"2023-09-10T00:12:49.224306+0000","last_became_active":"2023-09-10T00:12:46.590895+0000","last_became_peered":"2023-09-10T00:12:46.590895+0000","last_unstale":"2023-09-10T00:12:49.224306+0000","last_undegraded":"2023-09-10T00:12:49.224306+0000","last_fullsized":"2023-09-10T00:12:49.224306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:50:45.730271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581291+0000","last_change":"2023-09-10T00:12:42.521690+0000","last_active":"2023-09-10T00:12:47.581291+0000","last_peered":"2023-09-10T00:12:47.581291+0000","last_clean":"2023-09-10T00:12:47.581291+0000","last_became_active":"2023-09-10T00:12:42.520931+0000","last_became_peered":"2023-09-10T00:12:42.520931+0000","last_unstale":"2023-09-10T00:12:47.581291+0000","last_undegraded":"2023-09-10T00:12:47.581291+0000","last_fullsized":"2023-09-10T00:12:47.581291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:03.905490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615500+0000","last_change":"2023-09-10T00:12:41.527727+0000","last_active":"2023-09-10T00:12:47.615500+0000","last_peered":"2023-09-10T00:12:47.615500+0000","last_clean":"2023-09-10T00:12:47.615500+0000","last_became_active":"2023-09-10T00:12:41.527495+0000","last_became_peered":"2023-09-10T00:12:41.527495+0000","last_unstale":"2023-09-10T00:12:47.615500+0000","last_undegraded":"2023-09-10T00:12:47.615500+0000","last_fullsized":"2023-09-10T00:12:47.615500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:41.673766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.583605+0000","last_change":"2023-09-10T00:12:46.593774+0000","last_active":"2023-09-10T00:12:48.583605+0000","last_peered":"2023-09-10T00:12:48.583605+0000","last_clean":"2023-09-10T00:12:48.583605+0000","last_became_active":"2023-09-10T00:12:46.592641+0000","last_became_peered":"2023-09-10T00:12:46.592641+0000","last_unstale":"2023-09-10T00:12:48.583605+0000","last_undegraded":"2023-09-10T00:12:48.583605+0000","last_fullsized":"2023-09-10T00:12:48.583605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781921+0000","last_change":"2023-09-10T00:12:42.541125+0000","last_active":"2023-09-10T00:12:47.781921+0000","last_peered":"2023-09-10T00:12:47.781921+0000","last_clean":"2023-09-10T00:12:47.781921+0000","last_became_active":"2023-09-10T00:12:42.540816+0000","last_became_peered":"2023-09-10T00:12:42.540816+0000","last_unstale":"2023-09-10T00:12:47.781921+0000","last_undegraded":"2023-09-10T00:12:47.781921+0000","last_fullsized":"2023-09-10T00:12:47.781921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781459+0000","last_change":"2023-09-10T00:12:41.525602+0000","last_active":"2023-09-10T00:12:47.781459+0000","last_peered":"2023-09-10T00:12:47.781459+0000","last_clean":"2023-09-10T00:12:47.781459+0000","last_became_active":"2023-09-10T00:12:41.524971+0000","last_became_peered":"2023-09-10T00:12:41.524971+0000","last_unstale":"2023-09-10T00:12:47.781459+0000","last_undegraded":"2023-09-10T00:12:47.781459+0000","last_fullsized":"2023-09-10T00:12:47.781459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:47:00.009259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578028+0000","last_change":"2023-09-10T00:12:46.590880+0000","last_active":"2023-09-10T00:12:48.578028+0000","last_peered":"2023-09-10T00:12:48.578028+0000","last_clean":"2023-09-10T00:12:48.578028+0000","last_became_active":"2023-09-10T00:12:46.590393+0000","last_became_peered":"2023-09-10T00:12:46.590393+0000","last_unstale":"2023-09-10T00:12:48.578028+0000","last_undegraded":"2023-09-10T00:12:48.578028+0000","last_fullsized":"2023-09-10T00:12:48.578028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:26.815586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781335+0000","last_change":"2023-09-10T00:12:42.546455+0000","last_active":"2023-09-10T00:12:47.781335+0000","last_peered":"2023-09-10T00:12:47.781335+0000","last_clean":"2023-09-10T00:12:47.781335+0000","last_became_active":"2023-09-10T00:12:42.545882+0000","last_became_peered":"2023-09-10T00:12:42.545882+0000","last_unstale":"2023-09-10T00:12:47.781335+0000","last_undegraded":"2023-09-10T00:12:47.781335+0000","last_fullsized":"2023-09-10T00:12:47.781335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583657+0000","last_change":"2023-09-10T00:12:41.526211+0000","last_active":"2023-09-10T00:12:47.583657+0000","last_peered":"2023-09-10T00:12:47.583657+0000","last_clean":"2023-09-10T00:12:47.583657+0000","last_became_active":"2023-09-10T00:12:41.525658+0000","last_became_peered":"2023-09-10T00:12:41.525658+0000","last_unstale":"2023-09-10T00:12:47.583657+0000","last_undegraded":"2023-09-10T00:12:47.583657+0000","last_fullsized":"2023-09-10T00:12:47.583657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:34:15.266440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.578029+0000","last_change":"2023-09-10T00:12:47.440422+0000","last_active":"2023-09-10T00:12:48.578029+0000","last_peered":"2023-09-10T00:12:48.578029+0000","last_clean":"2023-09-10T00:12:48.578029+0000","last_became_active":"2023-09-10T00:12:47.438490+0000","last_became_peered":"2023-09-10T00:12:47.438490+0000","last_unstale":"2023-09-10T00:12:48.578029+0000","last_undegraded":"2023-09-10T00:12:48.578029+0000","last_fullsized":"2023-09-10T00:12:48.578029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:42:20.520101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.222944+0000","last_change":"2023-09-10T00:12:47.440252+0000","last_active":"2023-09-10T00:12:49.222944+0000","last_peered":"2023-09-10T00:12:49.222944+0000","last_clean":"2023-09-10T00:12:49.222944+0000","last_became_active":"2023-09-10T00:12:47.438785+0000","last_became_peered":"2023-09-10T00:12:47.438785+0000","last_unstale":"2023-09-10T00:12:49.222944+0000","last_undegraded":"2023-09-10T00:12:49.222944+0000","last_fullsized":"2023-09-10T00:12:49.222944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:56:34.330724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614683+0000","last_change":"2023-09-10T00:12:42.503107+0000","last_active":"2023-09-10T00:12:47.614683+0000","last_peered":"2023-09-10T00:12:47.614683+0000","last_clean":"2023-09-10T00:12:47.614683+0000","last_became_active":"2023-09-10T00:12:42.502824+0000","last_became_peered":"2023-09-10T00:12:42.502824+0000","last_unstale":"2023-09-10T00:12:47.614683+0000","last_undegraded":"2023-09-10T00:12:47.614683+0000","last_fullsized":"2023-09-10T00:12:47.614683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:12:53.862661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781222+0000","last_change":"2023-09-10T00:12:41.530180+0000","last_active":"2023-09-10T00:12:47.781222+0000","last_peered":"2023-09-10T00:12:47.781222+0000","last_clean":"2023-09-10T00:12:47.781222+0000","last_became_active":"2023-09-10T00:12:41.529649+0000","last_became_peered":"2023-09-10T00:12:41.529649+0000","last_unstale":"2023-09-10T00:12:47.781222+0000","last_undegraded":"2023-09-10T00:12:47.781222+0000","last_fullsized":"2023-09-10T00:12:47.781222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:46.258434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.586697+0000","last_change":"2023-09-10T00:12:46.606697+0000","last_active":"2023-09-10T00:12:48.586697+0000","last_peered":"2023-09-10T00:12:48.586697+0000","last_clean":"2023-09-10T00:12:48.586697+0000","last_became_active":"2023-09-10T00:12:46.605416+0000","last_became_peered":"2023-09-10T00:12:46.605416+0000","last_unstale":"2023-09-10T00:12:48.586697+0000","last_undegraded":"2023-09-10T00:12:48.586697+0000","last_fullsized":"2023-09-10T00:12:48.586697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:17:55.579379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782768+0000","last_change":"2023-09-10T00:12:42.504040+0000","last_active":"2023-09-10T00:12:47.782768+0000","last_peered":"2023-09-10T00:12:47.782768+0000","last_clean":"2023-09-10T00:12:47.782768+0000","last_became_active":"2023-09-10T00:12:42.497706+0000","last_became_peered":"2023-09-10T00:12:42.497706+0000","last_unstale":"2023-09-10T00:12:47.782768+0000","last_undegraded":"2023-09-10T00:12:47.782768+0000","last_fullsized":"2023-09-10T00:12:47.782768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782782+0000","last_change":"2023-09-10T00:12:41.507432+0000","last_active":"2023-09-10T00:12:47.782782+0000","last_peered":"2023-09-10T00:12:47.782782+0000","last_clean":"2023-09-10T00:12:47.782782+0000","last_became_active":"2023-09-10T00:12:41.507133+0000","last_became_peered":"2023-09-10T00:12:41.507133+0000","last_unstale":"2023-09-10T00:12:47.782782+0000","last_undegraded":"2023-09-10T00:12:47.782782+0000","last_fullsized":"2023-09-10T00:12:47.782782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:19:26.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582295+0000","last_change":"2023-09-10T00:12:41.503643+0000","last_active":"2023-09-10T00:12:47.582295+0000","last_peered":"2023-09-10T00:12:47.582295+0000","last_clean":"2023-09-10T00:12:47.582295+0000","last_became_active":"2023-09-10T00:12:41.502542+0000","last_became_peered":"2023-09-10T00:12:41.502542+0000","last_unstale":"2023-09-10T00:12:47.582295+0000","last_undegraded":"2023-09-10T00:12:47.582295+0000","last_fullsized":"2023-09-10T00:12:47.582295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:54.744257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781211+0000","last_change":"2023-09-10T00:12:42.496774+0000","last_active":"2023-09-10T00:12:47.781211+0000","last_peered":"2023-09-10T00:12:47.781211+0000","last_clean":"2023-09-10T00:12:47.781211+0000","last_became_active":"2023-09-10T00:12:42.496456+0000","last_became_peered":"2023-09-10T00:12:42.496456+0000","last_unstale":"2023-09-10T00:12:47.781211+0000","last_undegraded":"2023-09-10T00:12:47.781211+0000","last_fullsized":"2023-09-10T00:12:47.781211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:49.221683+0000","last_change":"2023-09-10T00:12:46.594913+0000","last_active":"2023-09-10T00:12:49.221683+0000","last_peered":"2023-09-10T00:12:49.221683+0000","last_clean":"2023-09-10T00:12:49.221683+0000","last_became_active":"2023-09-10T00:12:46.594488+0000","last_became_peered":"2023-09-10T00:12:46.594488+0000","last_unstale":"2023-09-10T00:12:49.221683+0000","last_undegraded":"2023-09-10T00:12:49.221683+0000","last_fullsized":"2023-09-10T00:12:49.221683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:35.215018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783437+0000","last_change":"2023-09-10T00:12:41.507753+0000","last_active":"2023-09-10T00:12:47.783437+0000","last_peered":"2023-09-10T00:12:47.783437+0000","last_clean":"2023-09-10T00:12:47.783437+0000","last_became_active":"2023-09-10T00:12:41.507335+0000","last_became_peered":"2023-09-10T00:12:41.507335+0000","last_unstale":"2023-09-10T00:12:47.783437+0000","last_undegraded":"2023-09-10T00:12:47.783437+0000","last_fullsized":"2023-09-10T00:12:47.783437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:40.443879+0000","last_clean_scrub_stamp":"2023-09-10T00:12:40.443879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:26:02.892303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.580684+0000","last_change":"2023-09-10T00:12:42.501100+0000","last_active":"2023-09-10T00:12:47.580684+0000","last_peered":"2023-09-10T00:12:47.580684+0000","last_clean":"2023-09-10T00:12:47.580684+0000","last_became_active":"2023-09-10T00:12:42.500331+0000","last_became_peered":"2023-09-10T00:12:42.500331+0000","last_unstale":"2023-09-10T00:12:47.580684+0000","last_undegraded":"2023-09-10T00:12:47.580684+0000","last_fullsized":"2023-09-10T00:12:47.580684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:24:55.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-10T00:12:48.579211+0000","last_change":"2023-09-10T00:12:46.577981+0000","last_active":"2023-09-10T00:12:48.579211+0000","last_peered":"2023-09-10T00:12:48.579211+0000","last_clean":"2023-09-10T00:12:48.579211+0000","last_became_active":"2023-09-10T00:12:46.577624+0000","last_became_peered":"2023-09-10T00:12:46.577624+0000","last_unstale":"2023-09-10T00:12:48.579211+0000","last_undegraded":"2023-09-10T00:12:48.579211+0000","last_fullsized":"2023-09-10T00:12:48.579211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:45.542705+0000","last_clean_scrub_stamp":"2023-09-10T00:12:45.542705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:03:59.306486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.579555+0000","last_change":"2023-09-10T00:12:42.523920+0000","last_active":"2023-09-10T00:12:47.579555+0000","last_peered":"2023-09-10T00:12:47.579555+0000","last_clean":"2023-09-10T00:12:47.579555+0000","last_became_active":"2023-09-10T00:12:42.523139+0000","last_became_peered":"2023-09-10T00:12:42.523139+0000","last_unstale":"2023-09-10T00:12:47.579555+0000","last_undegraded":"2023-09-10T00:12:47.579555+0000","last_fullsized":"2023-09-10T00:12:47.579555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:51:40.127668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.577535+0000","last_change":"2023-09-10T00:12:42.541910+0000","last_active":"2023-09-10T00:12:47.577535+0000","last_peered":"2023-09-10T00:12:47.577535+0000","last_clean":"2023-09-10T00:12:47.577535+0000","last_became_active":"2023-09-10T00:12:42.541606+0000","last_became_peered":"2023-09-10T00:12:42.541606+0000","last_unstale":"2023-09-10T00:12:47.577535+0000","last_undegraded":"2023-09-10T00:12:47.577535+0000","last_fullsized":"2023-09-10T00:12:47.577535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:50.366068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781888+0000","last_change":"2023-09-10T00:12:42.520562+0000","last_active":"2023-09-10T00:12:47.781888+0000","last_peered":"2023-09-10T00:12:47.781888+0000","last_clean":"2023-09-10T00:12:47.781888+0000","last_became_active":"2023-09-10T00:12:42.509305+0000","last_became_peered":"2023-09-10T00:12:42.509305+0000","last_unstale":"2023-09-10T00:12:47.781888+0000","last_undegraded":"2023-09-10T00:12:47.781888+0000","last_fullsized":"2023-09-10T00:12:47.781888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781110+0000","last_change":"2023-09-10T00:12:42.503904+0000","last_active":"2023-09-10T00:12:47.781110+0000","last_peered":"2023-09-10T00:12:47.781110+0000","last_clean":"2023-09-10T00:12:47.781110+0000","last_became_active":"2023-09-10T00:12:42.503477+0000","last_became_peered":"2023-09-10T00:12:42.503477+0000","last_unstale":"2023-09-10T00:12:47.781110+0000","last_undegraded":"2023-09-10T00:12:47.781110+0000","last_fullsized":"2023-09-10T00:12:47.781110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783728+0000","last_change":"2023-09-10T00:12:42.506439+0000","last_active":"2023-09-10T00:12:47.783728+0000","last_peered":"2023-09-10T00:12:47.783728+0000","last_clean":"2023-09-10T00:12:47.783728+0000","last_became_active":"2023-09-10T00:12:42.504454+0000","last_became_peered":"2023-09-10T00:12:42.504454+0000","last_unstale":"2023-09-10T00:12:47.783728+0000","last_undegraded":"2023-09-10T00:12:47.783728+0000","last_fullsized":"2023-09-10T00:12:47.783728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:37:38.658838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615152+0000","last_change":"2023-09-10T00:12:42.503158+0000","last_active":"2023-09-10T00:12:47.615152+0000","last_peered":"2023-09-10T00:12:47.615152+0000","last_clean":"2023-09-10T00:12:47.615152+0000","last_became_active":"2023-09-10T00:12:42.502881+0000","last_became_peered":"2023-09-10T00:12:42.502881+0000","last_unstale":"2023-09-10T00:12:47.615152+0000","last_undegraded":"2023-09-10T00:12:47.615152+0000","last_fullsized":"2023-09-10T00:12:47.615152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:23:31.129379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583567+0000","last_change":"2023-09-10T00:12:42.526817+0000","last_active":"2023-09-10T00:12:47.583567+0000","last_peered":"2023-09-10T00:12:47.583567+0000","last_clean":"2023-09-10T00:12:47.583567+0000","last_became_active":"2023-09-10T00:12:42.525834+0000","last_became_peered":"2023-09-10T00:12:42.525834+0000","last_unstale":"2023-09-10T00:12:47.583567+0000","last_undegraded":"2023-09-10T00:12:47.583567+0000","last_fullsized":"2023-09-10T00:12:47.583567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783919+0000","last_change":"2023-09-10T00:12:42.503440+0000","last_active":"2023-09-10T00:12:47.783919+0000","last_peered":"2023-09-10T00:12:47.783919+0000","last_clean":"2023-09-10T00:12:47.783919+0000","last_became_active":"2023-09-10T00:12:42.503128+0000","last_became_peered":"2023-09-10T00:12:42.503128+0000","last_unstale":"2023-09-10T00:12:47.783919+0000","last_undegraded":"2023-09-10T00:12:47.783919+0000","last_fullsized":"2023-09-10T00:12:47.783919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780980+0000","last_change":"2023-09-10T00:12:42.549808+0000","last_active":"2023-09-10T00:12:47.780980+0000","last_peered":"2023-09-10T00:12:47.780980+0000","last_clean":"2023-09-10T00:12:47.780980+0000","last_became_active":"2023-09-10T00:12:42.549085+0000","last_became_peered":"2023-09-10T00:12:42.549085+0000","last_unstale":"2023-09-10T00:12:47.780980+0000","last_undegraded":"2023-09-10T00:12:47.780980+0000","last_fullsized":"2023-09-10T00:12:47.780980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:00:21.787776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782646+0000","last_change":"2023-09-10T00:12:42.502195+0000","last_active":"2023-09-10T00:12:47.782646+0000","last_peered":"2023-09-10T00:12:47.782646+0000","last_clean":"2023-09-10T00:12:47.782646+0000","last_became_active":"2023-09-10T00:12:42.501637+0000","last_became_peered":"2023-09-10T00:12:42.501637+0000","last_unstale":"2023-09-10T00:12:47.782646+0000","last_undegraded":"2023-09-10T00:12:47.782646+0000","last_fullsized":"2023-09-10T00:12:47.782646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:31:02.660097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781670+0000","last_change":"2023-09-10T00:12:42.532920+0000","last_active":"2023-09-10T00:12:47.781670+0000","last_peered":"2023-09-10T00:12:47.781670+0000","last_clean":"2023-09-10T00:12:47.781670+0000","last_became_active":"2023-09-10T00:12:42.532282+0000","last_became_peered":"2023-09-10T00:12:42.532282+0000","last_unstale":"2023-09-10T00:12:47.781670+0000","last_undegraded":"2023-09-10T00:12:47.781670+0000","last_fullsized":"2023-09-10T00:12:47.781670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780619+0000","last_change":"2023-09-10T00:12:42.502049+0000","last_active":"2023-09-10T00:12:47.780619+0000","last_peered":"2023-09-10T00:12:47.780619+0000","last_clean":"2023-09-10T00:12:47.780619+0000","last_became_active":"2023-09-10T00:12:42.501720+0000","last_became_peered":"2023-09-10T00:12:42.501720+0000","last_unstale":"2023-09-10T00:12:47.780619+0000","last_undegraded":"2023-09-10T00:12:47.780619+0000","last_fullsized":"2023-09-10T00:12:47.780619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582329+0000","last_change":"2023-09-10T00:12:42.527735+0000","last_active":"2023-09-10T00:12:47.582329+0000","last_peered":"2023-09-10T00:12:47.582329+0000","last_clean":"2023-09-10T00:12:47.582329+0000","last_became_active":"2023-09-10T00:12:42.526982+0000","last_became_peered":"2023-09-10T00:12:42.526982+0000","last_unstale":"2023-09-10T00:12:47.582329+0000","last_undegraded":"2023-09-10T00:12:47.582329+0000","last_fullsized":"2023-09-10T00:12:47.582329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783929+0000","last_change":"2023-09-10T00:12:42.530154+0000","last_active":"2023-09-10T00:12:47.783929+0000","last_peered":"2023-09-10T00:12:47.783929+0000","last_clean":"2023-09-10T00:12:47.783929+0000","last_became_active":"2023-09-10T00:12:42.529662+0000","last_became_peered":"2023-09-10T00:12:42.529662+0000","last_unstale":"2023-09-10T00:12:47.783929+0000","last_undegraded":"2023-09-10T00:12:47.783929+0000","last_fullsized":"2023-09-10T00:12:47.783929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:05:59.959751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.578018+0000","last_change":"2023-09-10T00:12:42.539691+0000","last_active":"2023-09-10T00:12:47.578018+0000","last_peered":"2023-09-10T00:12:47.578018+0000","last_clean":"2023-09-10T00:12:47.578018+0000","last_became_active":"2023-09-10T00:12:42.539317+0000","last_became_peered":"2023-09-10T00:12:42.539317+0000","last_unstale":"2023-09-10T00:12:47.578018+0000","last_undegraded":"2023-09-10T00:12:47.578018+0000","last_fullsized":"2023-09-10T00:12:47.578018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:16.849606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782318+0000","last_change":"2023-09-10T00:12:42.559699+0000","last_active":"2023-09-10T00:12:47.782318+0000","last_peered":"2023-09-10T00:12:47.782318+0000","last_clean":"2023-09-10T00:12:47.782318+0000","last_became_active":"2023-09-10T00:12:42.559176+0000","last_became_peered":"2023-09-10T00:12:42.559176+0000","last_unstale":"2023-09-10T00:12:47.782318+0000","last_undegraded":"2023-09-10T00:12:47.782318+0000","last_fullsized":"2023-09-10T00:12:47.782318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:22:14.308645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780714+0000","last_change":"2023-09-10T00:12:42.550456+0000","last_active":"2023-09-10T00:12:47.780714+0000","last_peered":"2023-09-10T00:12:47.780714+0000","last_clean":"2023-09-10T00:12:47.780714+0000","last_became_active":"2023-09-10T00:12:42.549896+0000","last_became_peered":"2023-09-10T00:12:42.549896+0000","last_unstale":"2023-09-10T00:12:47.780714+0000","last_undegraded":"2023-09-10T00:12:47.780714+0000","last_fullsized":"2023-09-10T00:12:47.780714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:39:30.335189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.614735+0000","last_change":"2023-09-10T00:12:42.505565+0000","last_active":"2023-09-10T00:12:47.614735+0000","last_peered":"2023-09-10T00:12:47.614735+0000","last_clean":"2023-09-10T00:12:47.614735+0000","last_became_active":"2023-09-10T00:12:42.504834+0000","last_became_peered":"2023-09-10T00:12:42.504834+0000","last_unstale":"2023-09-10T00:12:47.614735+0000","last_undegraded":"2023-09-10T00:12:47.614735+0000","last_fullsized":"2023-09-10T00:12:47.614735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:06:02.585817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.780755+0000","last_change":"2023-09-10T00:12:42.497048+0000","last_active":"2023-09-10T00:12:47.780755+0000","last_peered":"2023-09-10T00:12:47.780755+0000","last_clean":"2023-09-10T00:12:47.780755+0000","last_became_active":"2023-09-10T00:12:42.496135+0000","last_became_peered":"2023-09-10T00:12:42.496135+0000","last_unstale":"2023-09-10T00:12:47.780755+0000","last_undegraded":"2023-09-10T00:12:47.780755+0000","last_fullsized":"2023-09-10T00:12:47.780755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:31:37.425124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.783142+0000","last_change":"2023-09-10T00:12:42.539859+0000","last_active":"2023-09-10T00:12:47.783142+0000","last_peered":"2023-09-10T00:12:47.783142+0000","last_clean":"2023-09-10T00:12:47.783142+0000","last_became_active":"2023-09-10T00:12:42.539545+0000","last_became_peered":"2023-09-10T00:12:42.539545+0000","last_unstale":"2023-09-10T00:12:47.783142+0000","last_undegraded":"2023-09-10T00:12:47.783142+0000","last_fullsized":"2023-09-10T00:12:47.783142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.581017+0000","last_change":"2023-09-10T00:12:42.528935+0000","last_active":"2023-09-10T00:12:47.581017+0000","last_peered":"2023-09-10T00:12:47.581017+0000","last_clean":"2023-09-10T00:12:47.581017+0000","last_became_active":"2023-09-10T00:12:42.528159+0000","last_became_peered":"2023-09-10T00:12:42.528159+0000","last_unstale":"2023-09-10T00:12:47.581017+0000","last_undegraded":"2023-09-10T00:12:47.581017+0000","last_fullsized":"2023-09-10T00:12:47.581017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:28:43.303596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.582968+0000","last_change":"2023-09-10T00:12:42.553610+0000","last_active":"2023-09-10T00:12:47.582968+0000","last_peered":"2023-09-10T00:12:47.582968+0000","last_clean":"2023-09-10T00:12:47.582968+0000","last_became_active":"2023-09-10T00:12:42.553091+0000","last_became_peered":"2023-09-10T00:12:42.553091+0000","last_unstale":"2023-09-10T00:12:47.582968+0000","last_undegraded":"2023-09-10T00:12:47.582968+0000","last_fullsized":"2023-09-10T00:12:47.582968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:12:47.271621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.583568+0000","last_change":"2023-09-10T00:12:42.549380+0000","last_active":"2023-09-10T00:12:47.583568+0000","last_peered":"2023-09-10T00:12:47.583568+0000","last_clean":"2023-09-10T00:12:47.583568+0000","last_became_active":"2023-09-10T00:12:42.548763+0000","last_became_peered":"2023-09-10T00:12:42.548763+0000","last_unstale":"2023-09-10T00:12:47.583568+0000","last_undegraded":"2023-09-10T00:12:47.583568+0000","last_fullsized":"2023-09-10T00:12:47.583568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784264+0000","last_change":"2023-09-10T00:12:42.551603+0000","last_active":"2023-09-10T00:12:47.784264+0000","last_peered":"2023-09-10T00:12:47.784264+0000","last_clean":"2023-09-10T00:12:47.784264+0000","last_became_active":"2023-09-10T00:12:42.551111+0000","last_became_peered":"2023-09-10T00:12:42.551111+0000","last_unstale":"2023-09-10T00:12:47.784264+0000","last_undegraded":"2023-09-10T00:12:47.784264+0000","last_fullsized":"2023-09-10T00:12:47.784264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:04:32.071544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782492+0000","last_change":"2023-09-10T00:12:42.551120+0000","last_active":"2023-09-10T00:12:47.782492+0000","last_peered":"2023-09-10T00:12:47.782492+0000","last_clean":"2023-09-10T00:12:47.782492+0000","last_became_active":"2023-09-10T00:12:42.550803+0000","last_became_peered":"2023-09-10T00:12:42.550803+0000","last_unstale":"2023-09-10T00:12:47.782492+0000","last_undegraded":"2023-09-10T00:12:47.782492+0000","last_fullsized":"2023-09-10T00:12:47.782492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:05:14.376588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781988+0000","last_change":"2023-09-10T00:12:42.515188+0000","last_active":"2023-09-10T00:12:47.781988+0000","last_peered":"2023-09-10T00:12:47.781988+0000","last_clean":"2023-09-10T00:12:47.781988+0000","last_became_active":"2023-09-10T00:12:42.514135+0000","last_became_peered":"2023-09-10T00:12:42.514135+0000","last_unstale":"2023-09-10T00:12:47.781988+0000","last_undegraded":"2023-09-10T00:12:47.781988+0000","last_fullsized":"2023-09-10T00:12:47.781988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:48:01.730358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781647+0000","last_change":"2023-09-10T00:12:42.542532+0000","last_active":"2023-09-10T00:12:47.781647+0000","last_peered":"2023-09-10T00:12:47.781647+0000","last_clean":"2023-09-10T00:12:47.781647+0000","last_became_active":"2023-09-10T00:12:42.536897+0000","last_became_peered":"2023-09-10T00:12:42.536897+0000","last_unstale":"2023-09-10T00:12:47.781647+0000","last_undegraded":"2023-09-10T00:12:47.781647+0000","last_fullsized":"2023-09-10T00:12:47.781647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:17.736769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.782937+0000","last_change":"2023-09-10T00:12:42.519515+0000","last_active":"2023-09-10T00:12:47.782937+0000","last_peered":"2023-09-10T00:12:47.782937+0000","last_clean":"2023-09-10T00:12:47.782937+0000","last_became_active":"2023-09-10T00:12:42.518734+0000","last_became_peered":"2023-09-10T00:12:42.518734+0000","last_unstale":"2023-09-10T00:12:47.782937+0000","last_undegraded":"2023-09-10T00:12:47.782937+0000","last_fullsized":"2023-09-10T00:12:47.782937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781617+0000","last_change":"2023-09-10T00:12:42.548980+0000","last_active":"2023-09-10T00:12:47.781617+0000","last_peered":"2023-09-10T00:12:47.781617+0000","last_clean":"2023-09-10T00:12:47.781617+0000","last_became_active":"2023-09-10T00:12:42.548305+0000","last_became_peered":"2023-09-10T00:12:42.548305+0000","last_unstale":"2023-09-10T00:12:47.781617+0000","last_undegraded":"2023-09-10T00:12:47.781617+0000","last_fullsized":"2023-09-10T00:12:47.781617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:35:25.484961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.781352+0000","last_change":"2023-09-10T00:12:42.498654+0000","last_active":"2023-09-10T00:12:47.781352+0000","last_peered":"2023-09-10T00:12:47.781352+0000","last_clean":"2023-09-10T00:12:47.781352+0000","last_became_active":"2023-09-10T00:12:42.498336+0000","last_became_peered":"2023-09-10T00:12:42.498336+0000","last_unstale":"2023-09-10T00:12:47.781352+0000","last_undegraded":"2023-09-10T00:12:47.781352+0000","last_fullsized":"2023-09-10T00:12:47.781352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:53:13.947965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.615376+0000","last_change":"2023-09-10T00:12:42.496796+0000","last_active":"2023-09-10T00:12:47.615376+0000","last_peered":"2023-09-10T00:12:47.615376+0000","last_clean":"2023-09-10T00:12:47.615376+0000","last_became_active":"2023-09-10T00:12:42.496366+0000","last_became_peered":"2023-09-10T00:12:42.496366+0000","last_unstale":"2023-09-10T00:12:47.615376+0000","last_undegraded":"2023-09-10T00:12:47.615376+0000","last_fullsized":"2023-09-10T00:12:47.615376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:56.597066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-10T00:12:47.784129+0000","last_change":"2023-09-10T00:12:42.545759+0000","last_active":"2023-09-10T00:12:47.784129+0000","last_peered":"2023-09-10T00:12:47.784129+0000","last_clean":"2023-09-10T00:12:47.784129+0000","last_became_active":"2023-09-10T00:12:42.545347+0000","last_became_peered":"2023-09-10T00:12:42.545347+0000","last_unstale":"2023-09-10T00:12:47.784129+0000","last_undegraded":"2023-09-10T00:12:47.784129+0000","last_fullsized":"2023-09-10T00:12:47.784129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:41.457066+0000","last_clean_scrub_stamp":"2023-09-10T00:12:41.457066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:47:20.404235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":699380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":108520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":108556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":699436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:13:11.123 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-10T00:13:11.123 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-10T00:13:11.123 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-10T00:13:11.124 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-10T00:13:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- 172.21.15.84:0/2408555631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab80c7f40 msgr2=0x7f4ab80c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2408555631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab80c7f40 0x7f4ab80c6e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400a950 tx=0x7f4ab401db50 comp rx=0 tx=0).stop 2023-09-10T00:13:11.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- 172.21.15.84:0/2408555631 shutdown_connections 2023-09-10T00:13:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2408555631 >> v2:172.21.15.100:3300/0 conn(0x7f4ab8070a70 0x7f4ab80b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2408555631 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab80c7f40 0x7f4ab80c6e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- 172.21.15.84:0/2408555631 >> 172.21.15.84:0/2408555631 conn(0x7f4ab80cca70 msgr2=0x7f4ab80cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- 172.21.15.84:0/2408555631 shutdown_connections 2023-09-10T00:13:11.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- 172.21.15.84:0/2408555631 wait complete. 2023-09-10T00:13:11.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 Processor -- start 2023-09-10T00:13:11.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.266+0000 7f4abedb3640 1 -- start start 2023-09-10T00:13:11.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 0x7f4ab80c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ab80c7f40 0x7f4ab8160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c3020 con 0x7f4ab806bcf0 2023-09-10T00:13:11.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab8160dc0 con 0x7f4ab80c7f40 2023-09-10T00:13:11.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80c5c60 con 0x7f4ab8070a70 2023-09-10T00:13:11.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46366/0 (socket says 172.21.15.84:46366) 2023-09-10T00:13:11.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 -- 172.21.15.84:0/2689372649 learned_addr learned my addr 172.21.15.84:0/2689372649 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:11.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aaffff640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 0x7f4ab80c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abd350640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ab80c7f40 0x7f4ab8160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 -- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 msgr2=0x7f4ab80c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 0x7f4ab80c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 -- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ab80c7f40 msgr2=0x7f4ab8160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ab80c7f40 0x7f4ab8160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 -- 172.21.15.84:0/2689372649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab400a5b0 con 0x7f4ab806bcf0 2023-09-10T00:13:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aaffff640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 0x7f4ab80c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abcb4f640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ab401a760 tx=0x7f4ab40a68a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4003a10 con 0x7f4ab806bcf0 2023-09-10T00:13:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ab4003b70 con 0x7f4ab806bcf0 2023-09-10T00:13:11.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80c6630 con 0x7f4ab806bcf0 2023-09-10T00:13:11.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40ae440 con 0x7f4ab806bcf0 2023-09-10T00:13:11.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab81612f0 con 0x7f4ab806bcf0 2023-09-10T00:13:11.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab80712c0 con 0x7f4ab806bcf0 2023-09-10T00:13:11.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ab40b5040 con 0x7f4ab806bcf0 2023-09-10T00:13:11.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 0x7f4aa4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ab411df60 con 0x7f4ab806bcf0 2023-09-10T00:13:11.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aaffff640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 0x7f4aa4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.270+0000 7f4aaffff640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 0x7f4aa4067fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80c6840 tx=0x7f4aa8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.274+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ab40eb650 con 0x7f4ab806bcf0 2023-09-10T00:13:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.450+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4ab8073400 con 0x7f4ab806bcf0 2023-09-10T00:13:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4aad7fa640 1 -- 172.21.15.84:0/2689372649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4ab40a6b50 con 0x7f4ab806bcf0 2023-09-10T00:13:11.456 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:11.456 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-10T00:13:11.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 msgr2=0x7f4aa4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 0x7f4aa4067fe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80c6840 tx=0x7f4aa8009040 comp rx=0 tx=0).stop 2023-09-10T00:13:11.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 msgr2=0x7f4ab80c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ab401a760 tx=0x7f4ab40a68a0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 shutdown_connections 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4aa4065b20 0x7f4aa4067fe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ab80c7f40 0x7f4ab8160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ab8070a70 0x7f4ab80c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 --2- 172.21.15.84:0/2689372649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ab806bcf0 0x7f4ab80c2ae0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 >> 172.21.15.84:0/2689372649 conn(0x7f4ab80cca70 msgr2=0x7f4ab8151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 shutdown_connections 2023-09-10T00:13:11.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.454+0000 7f4abedb3640 1 -- 172.21.15.84:0/2689372649 wait complete. 2023-09-10T00:13:11.474 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-10T00:13:11.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:11.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 -- 172.21.15.84:0/2355129092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 msgr2=0x7faae00707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 --2- 172.21.15.84:0/2355129092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00707f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faae0070ee0 tx=0x7faad801ca10 comp rx=0 tx=0).stop 2023-09-10T00:13:11.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 -- 172.21.15.84:0/2355129092 shutdown_connections 2023-09-10T00:13:11.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 --2- 172.21.15.84:0/2355129092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00707f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 --2- 172.21.15.84:0/2355129092 >> v2:172.21.15.100:3300/0 conn(0x7faae0158210 0x7faae00c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 -- 172.21.15.84:0/2355129092 >> 172.21.15.84:0/2355129092 conn(0x7faae00cca70 msgr2=0x7faae00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 -- 172.21.15.84:0/2355129092 shutdown_connections 2023-09-10T00:13:11.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.582+0000 7faae50e4640 1 -- 172.21.15.84:0/2355129092 wait complete. 2023-09-10T00:13:11.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 Processor -- start 2023-09-10T00:13:11.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- start start 2023-09-10T00:13:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae00ade00 0x7faae0146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faae0158210 0x7faae00b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae0160ef0 con 0x7faae0070360 2023-09-10T00:13:11.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae00cbb70 con 0x7faae00ade00 2023-09-10T00:13:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae00c9620 con 0x7faae0158210 2023-09-10T00:13:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46378/0 (socket says 172.21.15.84:46378) 2023-09-10T00:13:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 -- 172.21.15.84:0/224927625 learned_addr learned my addr 172.21.15.84:0/224927625 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:11.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 -- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faae0158210 msgr2=0x7faae00b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faae0158210 0x7faae00b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 -- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae00ade00 msgr2=0x7faae0146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae00ade00 0x7faae0146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 -- 172.21.15.84:0/224927625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad8009820 con 0x7faae0070360 2023-09-10T00:13:11.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faaded9d640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faad000c480 tx=0x7faad000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0012830 con 0x7faae0070360 2023-09-10T00:13:11.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faad0012a80 con 0x7faae0070360 2023-09-10T00:13:11.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae00c9900 con 0x7faae0070360 2023-09-10T00:13:11.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad0011380 con 0x7faae0070360 2023-09-10T00:13:11.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae00c9ec0 con 0x7faae0070360 2023-09-10T00:13:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.586+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae00ca0e0 con 0x7faae0070360 2023-09-10T00:13:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.590+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7faad00114e0 con 0x7faae0070360 2023-09-10T00:13:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.590+0000 7faac77fe640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 0x7faacc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.590+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faad00836a0 con 0x7faae0070360 2023-09-10T00:13:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.590+0000 7faade59c640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 0x7faacc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.590+0000 7faade59c640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 0x7faacc067fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faae0156b10 tx=0x7faad4006c00 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.594+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7faad0050d90 con 0x7faae0070360 2023-09-10T00:13:11.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.734+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae00712c0 con 0x7faae0070360 2023-09-10T00:13:11.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.734+0000 7faac77fe640 1 -- 172.21.15.84:0/224927625 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7faad00543b0 con 0x7faae0070360 2023-09-10T00:13:11.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:11.739 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:11.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 msgr2=0x7faacc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 0x7faacc067fe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faae0156b10 tx=0x7faad4006c00 comp rx=0 tx=0).stop 2023-09-10T00:13:11.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 msgr2=0x7faae00cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faad000c480 tx=0x7faad000c940 comp rx=0 tx=0).stop 2023-09-10T00:13:11.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 shutdown_connections 2023-09-10T00:13:11.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7faacc065b20 0x7faacc067fe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faae0158210 0x7faae00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faae00ade00 0x7faae0146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 --2- 172.21.15.84:0/224927625 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faae0070360 0x7faae00cb630 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 >> 172.21.15.84:0/224927625 conn(0x7faae00cca70 msgr2=0x7faae0153670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 shutdown_connections 2023-09-10T00:13:11.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.738+0000 7faae50e4640 1 -- 172.21.15.84:0/224927625 wait complete. 2023-09-10T00:13:11.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:11.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:11.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/702043483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d0003980 msgr2=0x7fe8d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/702043483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d0003980 0x7fe8d0003da0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0005fd0 tx=0x7fe8e001cd80 comp rx=0 tx=0).stop 2023-09-10T00:13:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ea695640 1 -- 172.21.15.84:0/702043483 reap_dead start 2023-09-10T00:13:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/702043483 shutdown_connections 2023-09-10T00:13:11.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/702043483 >> 172.21.15.84:0/702043483 conn(0x7fe8e40cd570 msgr2=0x7fe8e40cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/702043483 shutdown_connections 2023-09-10T00:13:11.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/702043483 wait complete. 2023-09-10T00:13:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 Processor -- start 2023-09-10T00:13:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- start start 2023-09-10T00:13:11.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8d0003980 0x7fe8e414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41e5280 0x7fe8e41f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41e0070 con 0x7fe8e41e4e00 2023-09-10T00:13:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e414e520 con 0x7fe8e41e5280 2023-09-10T00:13:11.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e41e0280 con 0x7fe8d0003980 2023-09-10T00:13:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46388/0 (socket says 172.21.15.84:46388) 2023-09-10T00:13:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 -- 172.21.15.84:0/883760410 learned_addr learned my addr 172.21.15.84:0/883760410 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9e94640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8d0003980 0x7fe8e414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 -- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8d0003980 msgr2=0x7fe8e414dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8d0003980 0x7fe8e414dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 -- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41e5280 msgr2=0x7fe8e41f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41e5280 0x7fe8e41f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 -- 172.21.15.84:0/883760410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e41e0560 con 0x7fe8e41e4e00 2023-09-10T00:13:11.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8e9693640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d750 tx=0x7fe8d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4009c30 con 0x7fe8e41e4e00 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe8d400de60 con 0x7fe8e41e4e00 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e41e0840 con 0x7fe8e41e4e00 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4009ea0 con 0x7fe8e41e4e00 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e41e0e00 con 0x7fe8e41e4e00 2023-09-10T00:13:11.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.874+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e41e0fc0 con 0x7fe8e41e4e00 2023-09-10T00:13:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.878+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe8d4005260 con 0x7fe8e41e4e00 2023-09-10T00:13:11.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.878+0000 7fe8da7fc640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 0x7fe8c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.878+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe8d40837d0 con 0x7fe8e41e4e00 2023-09-10T00:13:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.878+0000 7fe8e9e94640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 0x7fe8c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.878+0000 7fe8e9e94640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 0x7fe8c8067fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00b0000 tx=0x7fe8e00a7040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:11.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:11.882+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe8d40548c0 con 0x7fe8e41e4e00 2023-09-10T00:13:12.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.022+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8e406c610 con 0x7fe8e41e4e00 2023-09-10T00:13:12.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.022+0000 7fe8da7fc640 1 -- 172.21.15.84:0/883760410 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8d40170a0 con 0x7fe8e41e4e00 2023-09-10T00:13:12.026 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 msgr2=0x7fe8c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 0x7fe8c8067fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00b0000 tx=0x7fe8e00a7040 comp rx=0 tx=0).stop 2023-09-10T00:13:12.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 msgr2=0x7fe8e41f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d750 tx=0x7fe8d400dc10 comp rx=0 tx=0).stop 2023-09-10T00:13:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 shutdown_connections 2023-09-10T00:13:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe8c8065b20 0x7fe8c8067fe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e41e5280 0x7fe8e41f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8e41e4e00 0x7fe8e41f4ae0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 --2- 172.21.15.84:0/883760410 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe8d0003980 0x7fe8e414dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 >> 172.21.15.84:0/883760410 conn(0x7fe8e40cd570 msgr2=0x7fe8e4159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 shutdown_connections 2023-09-10T00:13:12.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.026+0000 7fe8ec0f8640 1 -- 172.21.15.84:0/883760410 wait complete. 2023-09-10T00:13:12.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/3493395337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b7006fa60 msgr2=0x7f6b700ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- 172.21.15.84:0/3493395337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b7006fa60 0x7f6b700ca550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b7006de30 tx=0x7f6b6c01c840 comp rx=0 tx=0).stop 2023-09-10T00:13:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/3493395337 shutdown_connections 2023-09-10T00:13:12.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- 172.21.15.84:0/3493395337 >> v2:172.21.15.100:3300/0 conn(0x7f6b700af770 0x7f6b7006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- 172.21.15.84:0/3493395337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b7006fa60 0x7f6b700ca550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/3493395337 >> 172.21.15.84:0/3493395337 conn(0x7f6b700aec00 msgr2=0x7f6b700cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/3493395337 shutdown_connections 2023-09-10T00:13:12.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/3493395337 wait complete. 2023-09-10T00:13:12.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 Processor -- start 2023-09-10T00:13:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- start start 2023-09-10T00:13:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7006fa60 0x7f6b70156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6b700af770 0x7f6b7013d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7013ceb0 con 0x7f6b700cbd60 2023-09-10T00:13:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7013c5e0 con 0x7f6b7006fa60 2023-09-10T00:13:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7013f560 con 0x7f6b700af770 2023-09-10T00:13:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46406/0 (socket says 172.21.15.84:46406) 2023-09-10T00:13:12.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 -- 172.21.15.84:0/1031557828 learned_addr learned my addr 172.21.15.84:0/1031557828 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b74be8640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6b700af770 0x7f6b7013d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b753e9640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7006fa60 0x7f6b70156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 -- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6b700af770 msgr2=0x7f6b7013d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6b700af770 0x7f6b7013d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 -- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7006fa60 msgr2=0x7f6b70156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7006fa60 0x7f6b70156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 -- 172.21.15.84:0/1031557828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c009560 con 0x7f6b700cbd60 2023-09-10T00:13:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b75bea640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002240 tx=0x7f6b6800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003db0 con 0x7f6b700cbd60 2023-09-10T00:13:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b6800ce30 con 0x7f6b700cbd60 2023-09-10T00:13:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680052b0 con 0x7f6b700cbd60 2023-09-10T00:13:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7013e6f0 con 0x7f6b700cbd60 2023-09-10T00:13:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.166+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7013cad0 con 0x7f6b700cbd60 2023-09-10T00:13:12.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7013cff0 con 0x7f6b700cbd60 2023-09-10T00:13:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6b68005410 con 0x7f6b700cbd60 2023-09-10T00:13:12.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b65ffb640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 0x7f6b54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b68083020 con 0x7f6b700cbd60 2023-09-10T00:13:12.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b753e9640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 0x7f6b54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.170+0000 7f6b753e9640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 0x7f6b54067fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0af000 tx=0x7f6b6c01b080 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.174+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6b7013cff0 con 0x7f6b700cbd60 2023-09-10T00:13:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.318+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b7013cff0 con 0x7f6b700cbd60 2023-09-10T00:13:12.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b65ffb640 1 -- 172.21.15.84:0/1031557828 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b68017020 con 0x7f6b700cbd60 2023-09-10T00:13:12.324 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:12.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 msgr2=0x7f6b54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 0x7f6b54067fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0af000 tx=0x7f6b6c01b080 comp rx=0 tx=0).stop 2023-09-10T00:13:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 msgr2=0x7f6b7013dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b68002240 tx=0x7f6b6800cbe0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 shutdown_connections 2023-09-10T00:13:12.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6b54065b20 0x7f6b54067fe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b700cbd60 0x7f6b7013dd10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6b700af770 0x7f6b7013d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 --2- 172.21.15.84:0/1031557828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7006fa60 0x7f6b70156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 >> 172.21.15.84:0/1031557828 conn(0x7f6b700aec00 msgr2=0x7f6b700b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 shutdown_connections 2023-09-10T00:13:12.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.322+0000 7f6b7764d640 1 -- 172.21.15.84:0/1031557828 wait complete. 2023-09-10T00:13:12.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:12.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/718214857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb668004d10 msgr2=0x7fb668005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 --2- 172.21.15.84:0/718214857 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb668004d10 0x7fb668005190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb67400c610 tx=0x7fb67401d360 comp rx=0 tx=0).stop 2023-09-10T00:13:12.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6822e2640 1 -- 172.21.15.84:0/718214857 reap_dead start 2023-09-10T00:13:12.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/718214857 shutdown_connections 2023-09-10T00:13:12.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/718214857 >> 172.21.15.84:0/718214857 conn(0x7fb67c0cd4e0 msgr2=0x7fb67c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/718214857 shutdown_connections 2023-09-10T00:13:12.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/718214857 wait complete. 2023-09-10T00:13:12.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 Processor -- start 2023-09-10T00:13:12.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- start start 2023-09-10T00:13:12.459 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c1e6050 0x7fb67c1e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 0x7fb67c1e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15c390 con 0x7fb67c1e5c70 2023-09-10T00:13:12.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15c630 con 0x7fb67c1e6050 2023-09-10T00:13:12.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c1f1c20 con 0x7fb67c0ca860 2023-09-10T00:13:12.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46420/0 (socket says 172.21.15.84:46420) 2023-09-10T00:13:12.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 -- 172.21.15.84:0/76585165 learned_addr learned my addr 172.21.15.84:0/76585165 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:12.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6822e2640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 0x7fb67c1e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 -- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 msgr2=0x7fb67c1e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 0x7fb67c1e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 -- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c1e6050 msgr2=0x7fb67c1e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c1e6050 0x7fb67c1e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 -- 172.21.15.84:0/76585165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c1f1f00 con 0x7fb67c1e5c70 2023-09-10T00:13:12.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6822e2640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 0x7fb67c1e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:12.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb681ae1640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb67800d770 tx=0x7fb67800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678009c30 con 0x7fb67c1e5c70 2023-09-10T00:13:12.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb67800de80 con 0x7fb67c1e5c70 2023-09-10T00:13:12.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c1f21e0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780106a0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c1f49c0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.454+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c06c610 con 0x7fb67c1e5c70 2023-09-10T00:13:12.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.458+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb678010800 con 0x7fb67c1e5c70 2023-09-10T00:13:12.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.458+0000 7fb6727fc640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 0x7fb660067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.458+0000 7fb6812e0640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 0x7fb660067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.458+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb678083b00 con 0x7fb67c1e5c70 2023-09-10T00:13:12.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.458+0000 7fb6812e0640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 0x7fb660067fe0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb67c1e6490 tx=0x7fb66c009580 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.462+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb6780511f0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb67c1f23d0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb6727fc640 1 -- 172.21.15.84:0/76585165 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb67c1f23d0 con 0x7fb67c1e5c70 2023-09-10T00:13:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 msgr2=0x7fb660067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 0x7fb660067fe0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb67c1e6490 tx=0x7fb66c009580 comp rx=0 tx=0).stop 2023-09-10T00:13:12.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 msgr2=0x7fb67c1f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb67800d770 tx=0x7fb67800dc30 comp rx=0 tx=0).stop 2023-09-10T00:13:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.602+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 shutdown_connections 2023-09-10T00:13:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb660065b20 0x7fb660067fe0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb67c0ca860 0x7fb67c1e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb67c1e6050 0x7fb67c1e34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 --2- 172.21.15.84:0/76585165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb67c1e5c70 0x7fb67c1f13d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 >> 172.21.15.84:0/76585165 conn(0x7fb67c0cd4e0 msgr2=0x7fb67c150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 shutdown_connections 2023-09-10T00:13:12.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.606+0000 7fb683d45640 1 -- 172.21.15.84:0/76585165 wait complete. 2023-09-10T00:13:12.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 -- 172.21.15.84:0/1286334544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 msgr2=0x7f9df80ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 --2- 172.21.15.84:0/1286334544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df80ca550 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9df806de30 tx=0x7f9df401c870 comp rx=0 tx=0).stop 2023-09-10T00:13:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 -- 172.21.15.84:0/1286334544 shutdown_connections 2023-09-10T00:13:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 --2- 172.21.15.84:0/1286334544 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80cbd60 0x7f9df81591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 --2- 172.21.15.84:0/1286334544 >> v2:172.21.15.100:3300/0 conn(0x7f9df80af770 0x7f9df806fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 --2- 172.21.15.84:0/1286334544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df80ca550 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 -- 172.21.15.84:0/1286334544 >> 172.21.15.84:0/1286334544 conn(0x7f9df80aec00 msgr2=0x7f9df80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 -- 172.21.15.84:0/1286334544 shutdown_connections 2023-09-10T00:13:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.738+0000 7f9dfface640 1 -- 172.21.15.84:0/1286334544 wait complete. 2023-09-10T00:13:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 Processor -- start 2023-09-10T00:13:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- start start 2023-09-10T00:13:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80af770 0x7f9df8157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80cbd60 0x7f9df8157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80ad530 con 0x7f9df806fa60 2023-09-10T00:13:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80ac9b0 con 0x7f9df80cbd60 2023-09-10T00:13:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80acc90 con 0x7f9df80af770 2023-09-10T00:13:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46444/0 (socket says 172.21.15.84:46444) 2023-09-10T00:13:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 -- 172.21.15.84:0/77501003 learned_addr learned my addr 172.21.15.84:0/77501003 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd069640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80af770 0x7f9df8157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 -- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80af770 msgr2=0x7f9df8157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80af770 0x7f9df8157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 -- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80cbd60 msgr2=0x7f9df8157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80cbd60 0x7f9df8157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 -- 172.21.15.84:0/77501003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009560 con 0x7f9df806fa60 2023-09-10T00:13:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd86a640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c10 tx=0x7f9df4004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4005030 con 0x7f9df806fa60 2023-09-10T00:13:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9df4005280 con 0x7f9df806fa60 2023-09-10T00:13:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df80acf70 con 0x7f9df806fa60 2023-09-10T00:13:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4005690 con 0x7f9df806fa60 2023-09-10T00:13:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df8139c70 con 0x7f9df806fa60 2023-09-10T00:13:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df80713a0 con 0x7f9df806fa60 2023-09-10T00:13:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9df40b4070 con 0x7f9df806fa60 2023-09-10T00:13:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 0x7f9ddc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9df411d5d0 con 0x7f9df806fa60 2023-09-10T00:13:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.742+0000 7f9dfd069640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 0x7f9ddc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.746+0000 7f9dfd069640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 0x7f9ddc067fe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005950 tx=0x7f9de8005bd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.746+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9df40eacc0 con 0x7f9df806fa60 2023-09-10T00:13:12.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9df80cd400 con 0x7f9df806fa60 2023-09-10T00:13:12.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dee7fc640 1 -- 172.21.15.84:0/77501003 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9df40ee2e0 con 0x7f9df806fa60 2023-09-10T00:13:12.893 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 msgr2=0x7f9ddc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 0x7f9ddc067fe0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005950 tx=0x7f9de8005bd0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 msgr2=0x7f9df8139680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c10 tx=0x7f9df4004130 comp rx=0 tx=0).stop 2023-09-10T00:13:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 shutdown_connections 2023-09-10T00:13:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9ddc065b20 0x7f9ddc067fe0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9df80cbd60 0x7f9df8157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9df80af770 0x7f9df8157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 --2- 172.21.15.84:0/77501003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9df806fa60 0x7f9df8139680 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:12.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.890+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 >> 172.21.15.84:0/77501003 conn(0x7f9df80aec00 msgr2=0x7f9df81583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:12.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.894+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 shutdown_connections 2023-09-10T00:13:12.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:12.894+0000 7f9dfface640 1 -- 172.21.15.84:0/77501003 wait complete. 2023-09-10T00:13:12.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/1590197257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 msgr2=0x7fb3d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/1590197257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3d400b990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec001c00 tx=0x7fb3ec01c980 comp rx=0 tx=0).stop 2023-09-10T00:13:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/1590197257 shutdown_connections 2023-09-10T00:13:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/1590197257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3d400b990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/1590197257 >> 172.21.15.84:0/1590197257 conn(0x7fb3f40cca70 msgr2=0x7fb3f40cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/1590197257 shutdown_connections 2023-09-10T00:13:13.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/1590197257 wait complete. 2023-09-10T00:13:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 Processor -- start 2023-09-10T00:13:13.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- start start 2023-09-10T00:13:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 0x7fb3f4156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 0x7fb3f41f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41edd40 con 0x7fb3d4005190 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41ed4a0 con 0x7fb3f4151b80 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f41ed780 con 0x7fb3f4156890 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46474/0 (socket says 172.21.15.84:46474) 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 -- 172.21.15.84:0/2519191243 learned_addr learned my addr 172.21.15.84:0/2519191243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3ea7fc640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 0x7fb3f4156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f37fe640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 0x7fb3f41f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 -- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 msgr2=0x7fb3f41f0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 0x7fb3f41f0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 -- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 msgr2=0x7fb3f4156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 0x7fb3f4156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 -- 172.21.15.84:0/2519191243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f41eda60 con 0x7fb3d4005190 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f37fe640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 0x7fb3f41f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3ea7fc640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 0x7fb3f4156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f2ffd640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400d7b0 tx=0x7fb3e400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400de60 con 0x7fb3d4005190 2023-09-10T00:13:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb3e40052e0 con 0x7fb3d4005190 2023-09-10T00:13:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f41f0530 con 0x7fb3d4005190 2023-09-10T00:13:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400b920 con 0x7fb3d4005190 2023-09-10T00:13:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.034+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f41f0f90 con 0x7fb3d4005190 2023-09-10T00:13:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f41f0390 con 0x7fb3d4005190 2023-09-10T00:13:13.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb3e400ba80 con 0x7fb3d4005190 2023-09-10T00:13:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3ebfff640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 0x7fb3d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3e4083210 con 0x7fb3d4005190 2023-09-10T00:13:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3ea7fc640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 0x7fb3d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.038+0000 7fb3ea7fc640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 0x7fb3d8067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc005950 tx=0x7fb3dc00ede0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.042+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb3f41f0390 con 0x7fb3d4005190 2023-09-10T00:13:13.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.218+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3f41f0390 con 0x7fb3d4005190 2023-09-10T00:13:13.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.218+0000 7fb3ebfff640 1 -- 172.21.15.84:0/2519191243 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fb3f41f0390 con 0x7fb3d4005190 2023-09-10T00:13:13.222 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:13.223 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:13.223 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:13.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 msgr2=0x7fb3d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 0x7fb3d8067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc005950 tx=0x7fb3dc00ede0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 msgr2=0x7fb3f41ece10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400d7b0 tx=0x7fb3e400dc70 comp rx=0 tx=0).stop 2023-09-10T00:13:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 shutdown_connections 2023-09-10T00:13:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb3d8065b20 0x7fb3d8067fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3f4156890 0x7fb3f41f0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f4151b80 0x7fb3f4156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 --2- 172.21.15.84:0/2519191243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb3d4005190 0x7fb3f41ece10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 >> 172.21.15.84:0/2519191243 conn(0x7fb3f40cca70 msgr2=0x7fb3f40b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 shutdown_connections 2023-09-10T00:13:13.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.222+0000 7fb3f97ae640 1 -- 172.21.15.84:0/2519191243 wait complete. 2023-09-10T00:13:13.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:13.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 -- 172.21.15.84:0/4090488620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50500ade00 msgr2=0x7f505006a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 --2- 172.21.15.84:0/4090488620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50500ade00 0x7f505006a1c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5050070ee0 tx=0x7f504001c7e0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 -- 172.21.15.84:0/4090488620 shutdown_connections 2023-09-10T00:13:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 --2- 172.21.15.84:0/4090488620 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5050070360 0x7f50500707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 --2- 172.21.15.84:0/4090488620 >> v2:172.21.15.100:3300/0 conn(0x7f5050158210 0x7f50500c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 --2- 172.21.15.84:0/4090488620 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50500ade00 0x7f505006a1c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 -- 172.21.15.84:0/4090488620 >> 172.21.15.84:0/4090488620 conn(0x7f50500cca70 msgr2=0x7f50500cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 -- 172.21.15.84:0/4090488620 shutdown_connections 2023-09-10T00:13:13.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.354+0000 7f5055173640 1 -- 172.21.15.84:0/4090488620 wait complete. 2023-09-10T00:13:13.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 Processor -- start 2023-09-10T00:13:13.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- start start 2023-09-10T00:13:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50500ade00 0x7f50500c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5050158210 0x7f5050151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500c2c90 con 0x7f5050070360 2023-09-10T00:13:13.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505014a650 con 0x7f5050158210 2023-09-10T00:13:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50501f84b0 con 0x7f50500ade00 2023-09-10T00:13:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46486/0 (socket says 172.21.15.84:46486) 2023-09-10T00:13:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 -- 172.21.15.84:0/2922681400 learned_addr learned my addr 172.21.15.84:0/2922681400 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:13.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504f59e640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5050158210 0x7f5050151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 -- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50500ade00 msgr2=0x7f50500c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504e59c640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50500ade00 0x7f50500c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50500ade00 0x7f50500c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 -- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5050158210 msgr2=0x7f5050151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5050158210 0x7f5050151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 -- 172.21.15.84:0/2922681400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5040009560 con 0x7f5050070360 2023-09-10T00:13:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f504ed9d640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5040000c10 tx=0x7f50400040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040005030 con 0x7f5050070360 2023-09-10T00:13:13.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5040005280 con 0x7f5050070360 2023-09-10T00:13:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50500c3540 con 0x7f5050070360 2023-09-10T00:13:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040005630 con 0x7f5050070360 2023-09-10T00:13:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50500a9970 con 0x7f5050070360 2023-09-10T00:13:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505014c0c0 con 0x7f5050070360 2023-09-10T00:13:13.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.358+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f50400b4070 con 0x7f5050070360 2023-09-10T00:13:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.362+0000 7f50377fe640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 0x7f503c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.362+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f504011d500 con 0x7f5050070360 2023-09-10T00:13:13.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.362+0000 7f504e59c640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 0x7f503c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.362+0000 7f504e59c640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 0x7f503c068010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50501f7490 tx=0x7f5044008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.366+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f50400eab60 con 0x7f5050070360 2023-09-10T00:13:13.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.514+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50500712c0 con 0x7f5050070360 2023-09-10T00:13:13.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f50377fe640 1 -- 172.21.15.84:0/2922681400 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f50400ee180 con 0x7f5050070360 2023-09-10T00:13:13.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:13.521 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 msgr2=0x7f503c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 0x7f503c068010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f50501f7490 tx=0x7f5044008040 comp rx=0 tx=0).stop 2023-09-10T00:13:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 msgr2=0x7f50500c2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5040000c10 tx=0x7f50400040c0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 shutdown_connections 2023-09-10T00:13:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f503c065b50 0x7f503c068010 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5050158210 0x7f5050151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50500ade00 0x7f50500c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 --2- 172.21.15.84:0/2922681400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5050070360 0x7f50500c2750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 >> 172.21.15.84:0/2922681400 conn(0x7f50500cca70 msgr2=0x7f50500cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 shutdown_connections 2023-09-10T00:13:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.518+0000 7f5055173640 1 -- 172.21.15.84:0/2922681400 wait complete. 2023-09-10T00:13:13.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:13.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/3836270421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 msgr2=0x7f8a14003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 --2- 172.21.15.84:0/3836270421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a14003da0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009b60 tx=0x7f8a2401d200 comp rx=0 tx=0).stop 2023-09-10T00:13:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2ea98640 1 -- 172.21.15.84:0/3836270421 reap_dead start 2023-09-10T00:13:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/3836270421 shutdown_connections 2023-09-10T00:13:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/3836270421 >> 172.21.15.84:0/3836270421 conn(0x7f8a280aec00 msgr2=0x7f8a280cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/3836270421 shutdown_connections 2023-09-10T00:13:13.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/3836270421 wait complete. 2023-09-10T00:13:13.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 Processor -- start 2023-09-10T00:13:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- start start 2023-09-10T00:13:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a2806ba80 0x7f8a280a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a2814ce30 0x7f8a2813dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280aa420 con 0x7f8a14003980 2023-09-10T00:13:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a28140e20 con 0x7f8a2806ba80 2023-09-10T00:13:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a280aa6a0 con 0x7f8a2814ce30 2023-09-10T00:13:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46508/0 (socket says 172.21.15.84:46508) 2023-09-10T00:13:13.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 -- 172.21.15.84:0/4098485982 learned_addr learned my addr 172.21.15.84:0/4098485982 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2ea98640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a2814ce30 0x7f8a2813dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2da96640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a2806ba80 0x7f8a280a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 -- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a2814ce30 msgr2=0x7f8a2813dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a2814ce30 0x7f8a2813dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 -- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a2806ba80 msgr2=0x7f8a280a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a2806ba80 0x7f8a280a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 -- 172.21.15.84:0/4098485982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a280aa980 con 0x7f8a14003980 2023-09-10T00:13:13.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a2e297640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009a80 tx=0x7f8a24005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24004230 con 0x7f8a14003980 2023-09-10T00:13:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a24004480 con 0x7f8a14003980 2023-09-10T00:13:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a280aac60 con 0x7f8a14003980 2023-09-10T00:13:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24004930 con 0x7f8a14003980 2023-09-10T00:13:13.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.658+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2806bf00 con 0x7f8a14003980 2023-09-10T00:13:13.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a28140c80 con 0x7f8a14003980 2023-09-10T00:13:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8a240b3070 con 0x7f8a14003980 2023-09-10T00:13:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a1effd640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 0x7f8a0c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a2411e8a0 con 0x7f8a14003980 2023-09-10T00:13:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a2da96640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 0x7f8a0c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.662+0000 7f8a2da96640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 0x7f8a0c068010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009470 tx=0x7f8a180093c0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.666+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8a240ebf70 con 0x7f8a14003980 2023-09-10T00:13:13.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.806+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a28140c80 con 0x7f8a14003980 2023-09-10T00:13:13.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.806+0000 7f8a1effd640 1 -- 172.21.15.84:0/4098485982 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a28140c80 con 0x7f8a14003980 2023-09-10T00:13:13.810 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:13.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 msgr2=0x7f8a0c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 0x7f8a0c068010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009470 tx=0x7f8a180093c0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 msgr2=0x7f8a281f84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009a80 tx=0x7f8a24005540 comp rx=0 tx=0).stop 2023-09-10T00:13:13.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 shutdown_connections 2023-09-10T00:13:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a0c065b50 0x7f8a0c068010 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a2814ce30 0x7f8a2813dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a2806ba80 0x7f8a280a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 --2- 172.21.15.84:0/4098485982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8a14003980 0x7f8a281f84e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 >> 172.21.15.84:0/4098485982 conn(0x7f8a280aec00 msgr2=0x7f8a2813d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 shutdown_connections 2023-09-10T00:13:13.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.810+0000 7f8a304fb640 1 -- 172.21.15.84:0/4098485982 wait complete. 2023-09-10T00:13:13.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/3491841825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb00047d0 msgr2=0x7f2eb0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/3491841825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb00047d0 0x7f2eb0004c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c700 tx=0x7f2eb801c630 comp rx=0 tx=0).stop 2023-09-10T00:13:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/3491841825 shutdown_connections 2023-09-10T00:13:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/3491841825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2eb00047d0 0x7f2eb0004c50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/3491841825 >> 172.21.15.84:0/3491841825 conn(0x7f2ec80cb350 msgr2=0x7f2ec80cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:13.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/3491841825 shutdown_connections 2023-09-10T00:13:13.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/3491841825 wait complete. 2023-09-10T00:13:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 Processor -- start 2023-09-10T00:13:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- start start 2023-09-10T00:13:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eb00047d0 0x7f2ec81f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ec8142910 0x7f2ec8142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8142330 con 0x7f2ec8140910 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8142750 con 0x7f2eb00047d0 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec81432d0 con 0x7f2ec8142910 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46520/0 (socket says 172.21.15.84:46520) 2023-09-10T00:13:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 -- 172.21.15.84:0/1979033507 learned_addr learned my addr 172.21.15.84:0/1979033507 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec6d9d640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eb00047d0 0x7f2ec81f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec659c640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ec8142910 0x7f2ec8142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 -- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ec8142910 msgr2=0x7f2ec8142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ec8142910 0x7f2ec8142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 -- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eb00047d0 msgr2=0x7f2ec81f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eb00047d0 0x7f2ec81f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 -- 172.21.15.84:0/1979033507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec81f2540 con 0x7f2ec8140910 2023-09-10T00:13:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ec759e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80caf20 tx=0x7f2ec000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0018070 con 0x7f2ec8140910 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2ec0004b30 con 0x7f2ec8140910 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec81416b0 con 0x7f2ec8140910 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000b9c0 con 0x7f2ec8140910 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.950+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec8141c70 con 0x7f2ec8140910 2023-09-10T00:13:13.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8156070 con 0x7f2ec8140910 2023-09-10T00:13:13.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2ec000bb20 con 0x7f2ec8140910 2023-09-10T00:13:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2eaf7fe640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 0x7f2eb4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ec0083330 con 0x7f2ec8140910 2023-09-10T00:13:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2ec6d9d640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 0x7f2eb4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.954+0000 7f2ec6d9d640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 0x7f2eb4067fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0017b0 tx=0x7f2ebc001dd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:13.958+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2ec0050980 con 0x7f2ec8140910 2023-09-10T00:13:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.110+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ec8142470 con 0x7f2ec8140910 2023-09-10T00:13:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.110+0000 7f2eaf7fe640 1 -- 172.21.15.84:0/1979033507 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ec8142470 con 0x7f2ec8140910 2023-09-10T00:13:14.115 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:14.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 msgr2=0x7f2eb4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 0x7f2eb4067fe0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0017b0 tx=0x7f2ebc001dd0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 msgr2=0x7f2ec8140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80caf20 tx=0x7f2ec000dd10 comp rx=0 tx=0).stop 2023-09-10T00:13:14.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 shutdown_connections 2023-09-10T00:13:14.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2eb4065b20 0x7f2eb4067fe0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2ec8140910 0x7f2ec8140dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ec8142910 0x7f2ec8142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 --2- 172.21.15.84:0/1979033507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eb00047d0 0x7f2ec81f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 >> 172.21.15.84:0/1979033507 conn(0x7f2ec80cb350 msgr2=0x7f2ec815b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 shutdown_connections 2023-09-10T00:13:14.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.114+0000 7f2ecd07e640 1 -- 172.21.15.84:0/1979033507 wait complete. 2023-09-10T00:13:14.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:14.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/289489076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006fa60 msgr2=0x7f163006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- 172.21.15.84:0/289489076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006fa60 0x7f163006fe40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f163006b130 tx=0x7f162c01ccf0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/289489076 shutdown_connections 2023-09-10T00:13:14.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- 172.21.15.84:0/289489076 >> v2:172.21.15.100:3300/0 conn(0x7f1630158230 0x7f16300695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- 172.21.15.84:0/289489076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006fa60 0x7f163006fe40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/289489076 >> 172.21.15.84:0/289489076 conn(0x7f16300aec00 msgr2=0x7f16300cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/289489076 shutdown_connections 2023-09-10T00:13:14.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/289489076 wait complete. 2023-09-10T00:13:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 Processor -- start 2023-09-10T00:13:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- start start 2023-09-10T00:13:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f163006fa60 0x7f16301472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630158230 0x7f1630151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630156410 con 0x7f163006c280 2023-09-10T00:13:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16301477e0 con 0x7f1630158230 2023-09-10T00:13:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1630155790 con 0x7f163006fa60 2023-09-10T00:13:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46536/0 (socket says 172.21.15.84:46536) 2023-09-10T00:13:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 -- 172.21.15.84:0/1690750690 learned_addr learned my addr 172.21.15.84:0/1690750690 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 -- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f163006fa60 msgr2=0x7f16301472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163693d640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630158230 0x7f1630151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163593b640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f163006fa60 0x7f16301472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f163006fa60 0x7f16301472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 -- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630158230 msgr2=0x7f1630151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630158230 0x7f1630151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 -- 172.21.15.84:0/1690750690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c0098e0 con 0x7f163006c280 2023-09-10T00:13:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f163613c640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f162c009bd0 tx=0x7f162c003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0adab0 con 0x7f163006c280 2023-09-10T00:13:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f162c0add00 con 0x7f163006c280 2023-09-10T00:13:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1630155a70 con 0x7f163006c280 2023-09-10T00:13:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0041e0 con 0x7f163006c280 2023-09-10T00:13:14.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.262+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1630156030 con 0x7f163006c280 2023-09-10T00:13:14.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16300713a0 con 0x7f163006c280 2023-09-10T00:13:14.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f162c0b4040 con 0x7f163006c280 2023-09-10T00:13:14.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f1626ffd640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 0x7f1614068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f162c11e7e0 con 0x7f163006c280 2023-09-10T00:13:14.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f163593b640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 0x7f1614068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.266+0000 7f163593b640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 0x7f1614068010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1630066e40 tx=0x7f1620005bd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.270+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f162c0ebed0 con 0x7f163006c280 2023-09-10T00:13:14.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.414+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16300713a0 con 0x7f163006c280 2023-09-10T00:13:14.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.414+0000 7f1626ffd640 1 -- 172.21.15.84:0/1690750690 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f162c0b20a0 con 0x7f163006c280 2023-09-10T00:13:14.419 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:14.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 msgr2=0x7f1614068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 0x7f1614068010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1630066e40 tx=0x7f1620005bd0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 msgr2=0x7f163014cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f162c009bd0 tx=0x7f162c003d90 comp rx=0 tx=0).stop 2023-09-10T00:13:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 shutdown_connections 2023-09-10T00:13:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1614065b50 0x7f1614068010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1630158230 0x7f1630151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f163006fa60 0x7f16301472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 --2- 172.21.15.84:0/1690750690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f163006c280 0x7f163014cd30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 >> 172.21.15.84:0/1690750690 conn(0x7f16300aec00 msgr2=0x7f16300ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 shutdown_connections 2023-09-10T00:13:14.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.418+0000 7f16383a0640 1 -- 172.21.15.84:0/1690750690 wait complete. 2023-09-10T00:13:14.436 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/3391844474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e006d4d0 msgr2=0x7fd4e006bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 --2- 172.21.15.84:0/3391844474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e006d4d0 0x7fd4e006bb20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009900 tx=0x7fd4c801c7f0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.561 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/3391844474 shutdown_connections 2023-09-10T00:13:14.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 --2- 172.21.15.84:0/3391844474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e006d4d0 0x7fd4e006bb20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/3391844474 >> 172.21.15.84:0/3391844474 conn(0x7fd4e00af230 msgr2=0x7fd4e00af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/3391844474 shutdown_connections 2023-09-10T00:13:14.562 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/3391844474 wait complete. 2023-09-10T00:13:14.565 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 Processor -- start 2023-09-10T00:13:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- start start 2023-09-10T00:13:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4e006d4d0 0x7fd4e015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e015b4f0 0x7fd4e015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015d4f0 con 0x7fd4e01579d0 2023-09-10T00:13:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015c640 con 0x7fd4e015b4f0 2023-09-10T00:13:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015c8e0 con 0x7fd4e006d4d0 2023-09-10T00:13:14.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46544/0 (socket says 172.21.15.84:46544) 2023-09-10T00:13:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 -- 172.21.15.84:0/348318919 learned_addr learned my addr 172.21.15.84:0/348318919 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 -- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4e006d4d0 msgr2=0x7fd4e015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4de59c640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4e006d4d0 0x7fd4e015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4e006d4d0 0x7fd4e015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 -- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e015b4f0 msgr2=0x7fd4e015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ded9d640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e015b4f0 0x7fd4e015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e015b4f0 0x7fd4e015e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 -- 172.21.15.84:0/348318919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009560 con 0x7fd4e01579d0 2023-09-10T00:13:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4ddd9b640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8019400 tx=0x7fd4c80a5830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80043c0 con 0x7fd4e01579d0 2023-09-10T00:13:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd4c8005020 con 0x7fd4e01579d0 2023-09-10T00:13:14.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.558+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e015cbc0 con 0x7fd4e01579d0 2023-09-10T00:13:14.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8005410 con 0x7fd4e01579d0 2023-09-10T00:13:14.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e015d180 con 0x7fd4e01579d0 2023-09-10T00:13:14.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e006e0d0 con 0x7fd4e01579d0 2023-09-10T00:13:14.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd4c80b4070 con 0x7fd4e01579d0 2023-09-10T00:13:14.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 0x7fd4c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4c811d890 con 0x7fd4e01579d0 2023-09-10T00:13:14.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4de59c640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 0x7fd4c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.562+0000 7fd4de59c640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 0x7fd4c0067fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8003d60 tx=0x7fd4d8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.566+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd4c80eae60 con 0x7fd4e01579d0 2023-09-10T00:13:14.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.718+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd4e006e0d0 con 0x7fd4e01579d0 2023-09-10T00:13:14.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.718+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/348318919 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd4c80ee480 con 0x7fd4e01579d0 2023-09-10T00:13:14.722 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 msgr2=0x7fd4c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 0x7fd4c0067fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8003d60 tx=0x7fd4d8009040 comp rx=0 tx=0).stop 2023-09-10T00:13:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 msgr2=0x7fd4e015e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8019400 tx=0x7fd4c80a5830 comp rx=0 tx=0).stop 2023-09-10T00:13:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 shutdown_connections 2023-09-10T00:13:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd4c0065b20 0x7fd4c0067fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4e015b4f0 0x7fd4e015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4e01579d0 0x7fd4e015e180 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 --2- 172.21.15.84:0/348318919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd4e006d4d0 0x7fd4e015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 >> 172.21.15.84:0/348318919 conn(0x7fd4e00af230 msgr2=0x7fd4e006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 shutdown_connections 2023-09-10T00:13:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.722+0000 7fd4e489e640 1 -- 172.21.15.84:0/348318919 wait complete. 2023-09-10T00:13:14.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/39680425 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b00afba0 msgr2=0x7fd3b00cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/39680425 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b00afba0 0x7fd3b00cff90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8009c80 tx=0x7fd3a801f580 comp rx=0 tx=0).stop 2023-09-10T00:13:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/39680425 shutdown_connections 2023-09-10T00:13:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/39680425 >> v2:172.21.15.100:3300/0 conn(0x7fd3b015af60 0x7fd3b00cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/39680425 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b00afba0 0x7fd3b00cff90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/39680425 >> 172.21.15.84:0/39680425 conn(0x7fd3b00b25b0 msgr2=0x7fd3b00b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/39680425 shutdown_connections 2023-09-10T00:13:14.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/39680425 wait complete. 2023-09-10T00:13:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 Processor -- start 2023-09-10T00:13:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- start start 2023-09-10T00:13:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 0x7fd3b00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b015af60 0x7fd3b00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b01e40d0 con 0x7fd3b00afba0 2023-09-10T00:13:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b014c650 con 0x7fd3b015af60 2023-09-10T00:13:14.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b01e3490 con 0x7fd3b015ab80 2023-09-10T00:13:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46548/0 (socket says 172.21.15.84:46548) 2023-09-10T00:13:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 -- 172.21.15.84:0/3877819055 learned_addr learned my addr 172.21.15.84:0/3877819055 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:14.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3af7fe640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 0x7fd3b00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b4973640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b015af60 0x7fd3b00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 -- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 msgr2=0x7fd3b00c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 0x7fd3b00c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 -- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b015af60 msgr2=0x7fd3b00b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:14.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b015af60 0x7fd3b00b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 -- 172.21.15.84:0/3877819055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80098e0 con 0x7fd3b00afba0 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3af7fe640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 0x7fd3b00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3affff640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c500 tx=0x7fd3a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0005220 con 0x7fd3b00afba0 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd3a0005470 con 0x7fd3b00afba0 2023-09-10T00:13:14.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b01e3730 con 0x7fd3b00afba0 2023-09-10T00:13:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0007290 con 0x7fd3b00afba0 2023-09-10T00:13:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.858+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b01e3cf0 con 0x7fd3b00afba0 2023-09-10T00:13:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b01e4210 con 0x7fd3b00afba0 2023-09-10T00:13:14.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd3a00073f0 con 0x7fd3b00afba0 2023-09-10T00:13:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3acff9640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 0x7fd39c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:14.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3a0083180 con 0x7fd3b00afba0 2023-09-10T00:13:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3af7fe640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 0x7fd39c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.862+0000 7fd3af7fe640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 0x7fd39c067fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3b01f41c0 tx=0x7fd3a40091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:14.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:14.866+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd3b01e4210 con 0x7fd3b00afba0 2023-09-10T00:13:15.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b01e4210 con 0x7fd3b00afba0 2023-09-10T00:13:15.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3acff9640 1 -- 172.21.15.84:0/3877819055 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fd3b01e4210 con 0x7fd3b00afba0 2023-09-10T00:13:15.057 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:15.057 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:15.057 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 msgr2=0x7fd39c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 0x7fd39c067fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd3b01f41c0 tx=0x7fd3a40091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 msgr2=0x7fd3b014c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c500 tx=0x7fd3a000c9c0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 shutdown_connections 2023-09-10T00:13:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd39c065b20 0x7fd39c067fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b015af60 0x7fd3b00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3b015ab80 0x7fd3b00c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 --2- 172.21.15.84:0/3877819055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3b00afba0 0x7fd3b014c110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 >> 172.21.15.84:0/3877819055 conn(0x7fd3b00b25b0 msgr2=0x7fd3b015a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.054+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 shutdown_connections 2023-09-10T00:13:15.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.058+0000 7fd3b63d6640 1 -- 172.21.15.84:0/3877819055 wait complete. 2023-09-10T00:13:15.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:15.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- 172.21.15.84:0/337572591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 msgr2=0x7fab740047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 --2- 172.21.15.84:0/337572591 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab740047d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fab8400abf0 tx=0x7fab8401cd70 comp rx=0 tx=0).stop 2023-09-10T00:13:15.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab8eb31640 1 -- 172.21.15.84:0/337572591 reap_dead start 2023-09-10T00:13:15.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- 172.21.15.84:0/337572591 shutdown_connections 2023-09-10T00:13:15.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- 172.21.15.84:0/337572591 >> 172.21.15.84:0/337572591 conn(0x7fab880cca70 msgr2=0x7fab880cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:15.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- 172.21.15.84:0/337572591 shutdown_connections 2023-09-10T00:13:15.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- 172.21.15.84:0/337572591 wait complete. 2023-09-10T00:13:15.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 Processor -- start 2023-09-10T00:13:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- start start 2023-09-10T00:13:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab881efe10 0x7fab881e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 0x7fab881576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab88157c20 con 0x7fab74003f30 2023-09-10T00:13:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881df440 con 0x7fab881efe10 2023-09-10T00:13:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab90594640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab88159830 con 0x7fab88157260 2023-09-10T00:13:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab8e330640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab8e330640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46572/0 (socket says 172.21.15.84:46572) 2023-09-10T00:13:15.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.202+0000 7fab8e330640 1 -- 172.21.15.84:0/3883278926 learned_addr learned my addr 172.21.15.84:0/3883278926 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8eb31640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 0x7fab881576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8db2f640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab881efe10 0x7fab881e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 -- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 msgr2=0x7fab881576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 0x7fab881576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 -- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab881efe10 msgr2=0x7fab881e1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab881efe10 0x7fab881e1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 -- 172.21.15.84:0/3883278926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88159b10 con 0x7fab74003f30 2023-09-10T00:13:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8eb31640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 0x7fab881576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8e330640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab7800d610 tx=0x7fab7800dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:15.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab780062e0 con 0x7fab74003f30 2023-09-10T00:13:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fab78006530 con 0x7fab74003f30 2023-09-10T00:13:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab881df6e0 con 0x7fab74003f30 2023-09-10T00:13:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78003880 con 0x7fab74003f30 2023-09-10T00:13:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab881e2220 con 0x7fab74003f30 2023-09-10T00:13:15.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab880712c0 con 0x7fab74003f30 2023-09-10T00:13:15.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fab780039e0 con 0x7fab74003f30 2023-09-10T00:13:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 0x7fab6c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8db2f640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 0x7fab6c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fab78083e70 con 0x7fab74003f30 2023-09-10T00:13:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.206+0000 7fab8db2f640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 0x7fab6c068010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab840af000 tx=0x7fab84019b10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:15.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.210+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fab78051510 con 0x7fab74003f30 2023-09-10T00:13:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.366+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab88073400 con 0x7fab74003f30 2023-09-10T00:13:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab7effd640 1 -- 172.21.15.84:0/3883278926 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fab78014090 con 0x7fab74003f30 2023-09-10T00:13:15.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:15.372 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":26,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:12:48.572818+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:15.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 msgr2=0x7fab6c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 0x7fab6c068010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab840af000 tx=0x7fab84019b10 comp rx=0 tx=0).stop 2023-09-10T00:13:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 msgr2=0x7fab88159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab7800d610 tx=0x7fab7800dad0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 shutdown_connections 2023-09-10T00:13:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fab6c065b50 0x7fab6c068010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fab88157260 0x7fab881576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab881efe10 0x7fab881e1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 --2- 172.21.15.84:0/3883278926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fab74003f30 0x7fab88159250 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 >> 172.21.15.84:0/3883278926 conn(0x7fab880cca70 msgr2=0x7fab880afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 shutdown_connections 2023-09-10T00:13:15.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.370+0000 7fab90594640 1 -- 172.21.15.84:0/3883278926 wait complete. 2023-09-10T00:13:15.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 -- 172.21.15.84:0/4189664956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 msgr2=0x7f8e100b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4189664956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e100b2200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009900 tx=0x7f8e0c01c850 comp rx=0 tx=0).stop 2023-09-10T00:13:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 -- 172.21.15.84:0/4189664956 shutdown_connections 2023-09-10T00:13:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4189664956 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006d250 0x7f8e1015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4189664956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e100b2200 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 -- 172.21.15.84:0/4189664956 >> 172.21.15.84:0/4189664956 conn(0x7f8e100cca70 msgr2=0x7f8e100cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:15.520 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 -- 172.21.15.84:0/4189664956 shutdown_connections 2023-09-10T00:13:15.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.514+0000 7f8e17a88640 1 -- 172.21.15.84:0/4189664956 wait complete. 2023-09-10T00:13:15.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 Processor -- start 2023-09-10T00:13:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- start start 2023-09-10T00:13:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e1006d250 0x7f8e10141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006fad0 0x7f8e100c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100ca100 con 0x7f8e10158890 2023-09-10T00:13:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c4120 con 0x7f8e1006d250 2023-09-10T00:13:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100c9480 con 0x7f8e1006fad0 2023-09-10T00:13:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46584/0 (socket says 172.21.15.84:46584) 2023-09-10T00:13:15.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 -- 172.21.15.84:0/4129132454 learned_addr learned my addr 172.21.15.84:0/4129132454 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e15023640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006fad0 0x7f8e100c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e15824640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e1006d250 0x7f8e10141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 -- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006fad0 msgr2=0x7f8e100c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006fad0 0x7f8e100c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 -- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e1006d250 msgr2=0x7f8e10141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e1006d250 0x7f8e10141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 -- 172.21.15.84:0/4129132454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c009560 con 0x7f8e10158890 2023-09-10T00:13:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e16025640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c780 tx=0x7f8e0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08004b70 con 0x7f8e10158890 2023-09-10T00:13:15.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e0800ce90 con 0x7f8e10158890 2023-09-10T00:13:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800aab0 con 0x7f8e10158890 2023-09-10T00:13:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100c9760 con 0x7f8e10158890 2023-09-10T00:13:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e100c9d20 con 0x7f8e10158890 2023-09-10T00:13:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.518+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100ca240 con 0x7f8e10158890 2023-09-10T00:13:15.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.522+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8e0800ac10 con 0x7f8e10158890 2023-09-10T00:13:15.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.522+0000 7f8e067fc640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:15.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.522+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e080839e0 con 0x7f8e10158890 2023-09-10T00:13:15.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.522+0000 7f8e15824640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:15.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.522+0000 7f8e15824640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 0x7f8df4068010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0af000 tx=0x7f8e0c01b090 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:15.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.526+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8e08051040 con 0x7f8e10158890 2023-09-10T00:13:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.702+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e100c9ee0 con 0x7f8e10158890 2023-09-10T00:13:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e067fc640 1 -- 172.21.15.84:0/4129132454 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f8e08054660 con 0x7f8e10158890 2023-09-10T00:13:15.708 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:15.708 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 msgr2=0x7f8df4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 0x7f8df4068010 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0af000 tx=0x7f8e0c01b090 comp rx=0 tx=0).stop 2023-09-10T00:13:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 msgr2=0x7f8e101553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c780 tx=0x7f8e0800cc40 comp rx=0 tx=0).stop 2023-09-10T00:13:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 shutdown_connections 2023-09-10T00:13:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8df4065b50 0x7f8df4068010 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e10158890 0x7f8e101553b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8e1006fad0 0x7f8e100c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 --2- 172.21.15.84:0/4129132454 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e1006d250 0x7f8e10141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 >> 172.21.15.84:0/4129132454 conn(0x7f8e100cca70 msgr2=0x7f8e100c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 shutdown_connections 2023-09-10T00:13:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:15.706+0000 7f8e17a88640 1 -- 172.21.15.84:0/4129132454 wait complete. 2023-09-10T00:13:16.127 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-10T00:12:41.835038+0000', 'modified': '2023-09-10T00:13:04.568178+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4374}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4374': {'gid': 4374, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6837/1785947719', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6836', 'nonce': 1785947719}, {'type': 'v1', 'addr': '172.21.15.84:6837', 'nonce': 1785947719}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-10T00:13:16.128 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-10T00:13:16.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-10T00:13:16.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 -- 172.21.15.84:0/3330574100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 msgr2=0x7fa27c06bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 --2- 172.21.15.84:0/3330574100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c06bba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009900 tx=0x7fa26c01c850 comp rx=0 tx=0).stop 2023-09-10T00:13:16.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 -- 172.21.15.84:0/3330574100 shutdown_connections 2023-09-10T00:13:16.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 --2- 172.21.15.84:0/3330574100 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0c7240 0x7fa27c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 --2- 172.21.15.84:0/3330574100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c06bba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 -- 172.21.15.84:0/3330574100 >> 172.21.15.84:0/3330574100 conn(0x7fa27c0c9500 msgr2=0x7fa27c0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 -- 172.21.15.84:0/3330574100 shutdown_connections 2023-09-10T00:13:16.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.262+0000 7fa2845aa640 1 -- 172.21.15.84:0/3330574100 wait complete. 2023-09-10T00:13:16.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 Processor -- start 2023-09-10T00:13:16.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- start start 2023-09-10T00:13:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 0x7fa27c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 0x7fa27c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c14e230 con 0x7fa27c0af4d0 2023-09-10T00:13:16.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c156ab0 con 0x7fa27c0c7240 2023-09-10T00:13:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c156ce0 con 0x7fa27c0af8b0 2023-09-10T00:13:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46610/0 (socket says 172.21.15.84:46610) 2023-09-10T00:13:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 -- 172.21.15.84:0/1889979400 learned_addr learned my addr 172.21.15.84:0/1889979400 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282b47640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 0x7fa27c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa281b45640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 0x7fa27c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 -- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 msgr2=0x7fa27c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 0x7fa27c156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 -- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 msgr2=0x7fa27c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 0x7fa27c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 -- 172.21.15.84:0/1889979400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c009560 con 0x7fa27c0af4d0 2023-09-10T00:13:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa281b45640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 0x7fa27c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282b47640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 0x7fa27c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:16.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa282346640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa26c01af00 tx=0x7fa26c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa27affd640 1 -- 172.21.15.84:0/1889979400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c005030 con 0x7fa27c0af4d0 2023-09-10T00:13:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa27affd640 1 -- 172.21.15.84:0/1889979400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa26c005280 con 0x7fa27c0af4d0 2023-09-10T00:13:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c152ff0 con 0x7fa27c0af4d0 2023-09-10T00:13:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa27affd640 1 -- 172.21.15.84:0/1889979400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0046d0 con 0x7fa27c0af4d0 2023-09-10T00:13:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.266+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c1535b0 con 0x7fa27c0af4d0 2023-09-10T00:13:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa27affd640 1 -- 172.21.15.84:0/1889979400 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa26c0b4070 con 0x7fa27c0af4d0 2023-09-10T00:13:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa27affd640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 0x7fa268067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa27affd640 1 -- 172.21.15.84:0/1889979400 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa26c11d150 con 0x7fa27c0af4d0 2023-09-10T00:13:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa281b45640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 0x7fa268067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 Processor -- start 2023-09-10T00:13:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- start start 2023-09-10T00:13:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa281b45640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 0x7fa268067fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06d340 tx=0x7fa270009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd5a4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 0x55cddd55a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd3ad510 con 0x55cddd55a740 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd3aaa40 con 0x55cddd5a4a40 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd3a6330 con 0x55cddd5a4120 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46614/0 (socket says 172.21.15.84:46614) 2023-09-10T00:13:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 -- 172.21.15.84:0/3316377029 learned_addr learned my addr 172.21.15.84:0/3316377029 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa281b45640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 0x55cddd55a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282346640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd5a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 -- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 msgr2=0x55cddd5a4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd5a4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 -- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 msgr2=0x55cddd55a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 0x55cddd55a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 -- 172.21.15.84:0/3316377029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cddd0a0890 con 0x55cddd55a740 2023-09-10T00:13:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282346640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd5a4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa281b45640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 0x55cddd55a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa282b47640 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa274008d10 tx=0x7fa27400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e79be2b7b82922b server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa263fff640 1 -- 172.21.15.84:0/3316377029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400f630 con 0x55cddd55a740 2023-09-10T00:13:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa263fff640 1 -- 172.21.15.84:0/3316377029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa27400f8a0 con 0x55cddd55a740 2023-09-10T00:13:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa263fff640 1 -- 172.21.15.84:0/3316377029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400fcb0 con 0x55cddd55a740 2023-09-10T00:13:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- 172.21.15.84:0/3316377029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 msgr2=0x55cddd55ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa274008d10 tx=0x7fa27400d710 comp rx=0 tx=0).stop 2023-09-10T00:13:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- 172.21.15.84:0/3316377029 shutdown_connections 2023-09-10T00:13:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd55ab20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4a40 0x55cddd55a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3316377029 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd5a4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- 172.21.15.84:0/3316377029 >> 172.21.15.84:0/3316377029 conn(0x55cddd55c490 msgr2=0x55cddd5546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- 172.21.15.84:0/3316377029 shutdown_connections 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.270+0000 7fa2876d7000 1 -- 172.21.15.84:0/3316377029 wait complete. 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- start start 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 Processor -- start 2023-09-10T00:13:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd591930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4a40 0x55cddd591e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd360ed0 con 0x55cddd55a740 2023-09-10T00:13:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd360b70 con 0x55cddd5a4120 2023-09-10T00:13:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd061940 con 0x55cddd5a4a40 2023-09-10T00:13:16.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 10 client.0 _ll_register_callbacks cb 0x55cddd4744a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:13:16.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46620/0 (socket says 172.21.15.84:46620) 2023-09-10T00:13:16.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 -- 172.21.15.84:0/442582449 learned_addr learned my addr 172.21.15.84:0/442582449 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 -- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4a40 msgr2=0x55cddd591e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282b47640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4a40 0x55cddd591e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa281b45640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd591930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4a40 0x55cddd591e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 -- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 msgr2=0x55cddd591930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd591930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 -- 172.21.15.84:0/442582449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa274008970 con 0x55cddd55a740 2023-09-10T00:13:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa282346640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa26c11b390 tx=0x7fa26c0eddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d5b273c217a7f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:13:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0f22a0 con 0x55cddd55a740 2023-09-10T00:13:16.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa26c0f0e20 con 0x55cddd55a740 2023-09-10T00:13:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cddd35d880 con 0x55cddd55a740 2023-09-10T00:13:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa26c0f6450 con 0x55cddd55a740 2023-09-10T00:13:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 10 client.4935 fetch_fsmap learned FSMap version 9 2023-09-10T00:13:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55cddd369290 con 0x55cddd55a740 2023-09-10T00:13:16.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55cddd35d880 con 0x55cddd55a740 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fa26c0ed960 con 0x55cddd55a740 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 10 client.4935 fetch_fsmap finished waiting for FSMap version 9 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 10 client.4935 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 20 client.4935 populate_metadata read hostname 'smithi084' 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd592880 0x55cddd5b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 4 client.4935 mds_command: new command op to 4374 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-10T00:13:16.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 --> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cddd366700 con 0x55cddd592880 2023-09-10T00:13:16.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa281b45640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd592880 0x55cddd5b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 10 client.4935 ms_handle_connect on v2:172.21.15.84:6836/1785947719 2023-09-10T00:13:16.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa281b45640 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd592880 0x55cddd5b53d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f27d22e4a10ace6b server_cookie=c8f5d138e122041a in_seq=0 out_seq=0 2023-09-10T00:13:16.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 1 -- 172.21.15.84:0/442582449 <== mds.0 v2:172.21.15.84:6836/1785947719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cddd366700 con 0x55cddd592880 2023-09-10T00:13:16.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 10 client.4935 handle_command_reply: tid=0 2023-09-10T00:13:16.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 client.4935 shutdown 2023-09-10T00:13:16.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 msgr2=0x55cddd5913f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa26c11b390 tx=0x7fa26c0eddd0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 shutdown_connections 2023-09-10T00:13:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd592880 0x55cddd5b53d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4a40 0x55cddd591e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd591930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2617fa640 0 client.4935 ms_handle_reset on v2:172.21.15.84:6836/1785947719 2023-09-10T00:13:16.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 --2- 172.21.15.84:0/442582449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd55a740 0x55cddd5913f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 >> 172.21.15.84:0/442582449 conn(0x55cddd55c490 msgr2=0x55cddd55bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 shutdown_connections 2023-09-10T00:13:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 1 -- 172.21.15.84:0/442582449 wait complete. 2023-09-10T00:13:16.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.274+0000 7fa2876d7000 20 client.4935 trim_cache size 0 max 16384 2023-09-10T00:13:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 Processor -- start 2023-09-10T00:13:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 -- start start 2023-09-10T00:13:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd55a740 0x55cddd555270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd58fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd341db0 con 0x55cddd5a4a40 2023-09-10T00:13:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd3a3b40 con 0x55cddd55a740 2023-09-10T00:13:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.290+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd561c00 con 0x55cddd5a4120 2023-09-10T00:13:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46632/0 (socket says 172.21.15.84:46632) 2023-09-10T00:13:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 -- 172.21.15.84:0/3046116740 learned_addr learned my addr 172.21.15.84:0/3046116740 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282346640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd55a740 0x55cddd555270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa281b45640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd58fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 -- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 msgr2=0x55cddd58fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd58fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 -- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd55a740 msgr2=0x55cddd555270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd55a740 0x55cddd555270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 -- 172.21.15.84:0/3046116740 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cddd34f500 con 0x55cddd5a4a40 2023-09-10T00:13:16.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa281b45640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd58fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:16.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa282b47640 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa274014000 tx=0x7fa274004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4f27fb26580156 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa278ff9640 1 -- 172.21.15.84:0/3046116740 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27401d040 con 0x55cddd5a4a40 2023-09-10T00:13:16.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa278ff9640 1 -- 172.21.15.84:0/3046116740 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa274005e10 con 0x55cddd5a4a40 2023-09-10T00:13:16.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa278ff9640 1 -- 172.21.15.84:0/3046116740 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400f870 con 0x55cddd5a4a40 2023-09-10T00:13:16.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- 172.21.15.84:0/3046116740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 msgr2=0x55cddd590150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa274014000 tx=0x7fa274004ac0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- 172.21.15.84:0/3046116740 shutdown_connections 2023-09-10T00:13:16.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd590150 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd5a4120 0x55cddd58fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 --2- 172.21.15.84:0/3046116740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd55a740 0x55cddd555270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- 172.21.15.84:0/3046116740 >> 172.21.15.84:0/3046116740 conn(0x55cddd55c490 msgr2=0x55cddd58f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- 172.21.15.84:0/3046116740 shutdown_connections 2023-09-10T00:13:16.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- 172.21.15.84:0/3046116740 wait complete. 2023-09-10T00:13:16.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 -- start start 2023-09-10T00:13:16.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.294+0000 7fa2876d7000 1 Processor -- start 2023-09-10T00:13:16.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd55a740 0x55cddd5b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd5ff140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd3a1ca0 con 0x55cddd5a4a40 2023-09-10T00:13:16.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cddd39f6e0 con 0x55cddd5a4120 2023-09-10T00:13:16.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cddd561660 con 0x55cddd55a740 2023-09-10T00:13:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 10 client.0 _ll_register_callbacks cb 0x55cddd368d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:13:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46646/0 (socket says 172.21.15.84:46646) 2023-09-10T00:13:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 -- 172.21.15.84:0/1560236381 learned_addr learned my addr 172.21.15.84:0/1560236381 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.313 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282346640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd55a740 0x55cddd5b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa281b45640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd5ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 -- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd55a740 msgr2=0x55cddd5b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd55a740 0x55cddd5b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 -- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 msgr2=0x55cddd5ff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:13:16.314 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd5ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 -- 172.21.15.84:0/1560236381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cddd0a0890 con 0x55cddd5a4a40 2023-09-10T00:13:16.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282b47640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa274008d10 tx=0x7fa27400fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cbc017ee322a06 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:13:16.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27401c040 con 0x55cddd5a4a40 2023-09-10T00:13:16.315 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa274013070 con 0x55cddd5a4a40 2023-09-10T00:13:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cddd562700 con 0x55cddd5a4a40 2023-09-10T00:13:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa274005dd0 con 0x55cddd5a4a40 2023-09-10T00:13:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 10 client.4941 fetch_fsmap learned FSMap version 9 2023-09-10T00:13:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55cddd0a0cc0 con 0x55cddd5a4a40 2023-09-10T00:13:16.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55cddd562700 con 0x55cddd5a4a40 2023-09-10T00:13:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fa274038350 con 0x55cddd5a4a40 2023-09-10T00:13:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 10 client.4941 fetch_fsmap finished waiting for FSMap version 9 2023-09-10T00:13:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 10 client.4941 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-10T00:13:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 20 client.4941 populate_metadata read hostname 'smithi084' 2023-09-10T00:13:16.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd5ffbc0 0x55cddd5fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 4 client.4941 mds_command: new command op to 4374 tid=0[{"prefix": "status"}] 2023-09-10T00:13:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 --> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cddd3ac310 con 0x55cddd5ffbc0 2023-09-10T00:13:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282346640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd5ffbc0 0x55cddd5fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 10 client.4941 ms_handle_connect on v2:172.21.15.84:6836/1785947719 2023-09-10T00:13:16.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa282346640 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd5ffbc0 0x55cddd5fffa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6955a9d2c8ab82a3 server_cookie=2c1ec14c7dceb62b in_seq=0 out_seq=0 2023-09-10T00:13:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 1 -- 172.21.15.84:0/1560236381 <== mds.0 v2:172.21.15.84:6836/1785947719 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55cddd3ac310 con 0x55cddd5ffbc0 2023-09-10T00:13:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 10 client.4941 handle_command_reply: tid=0 2023-09-10T00:13:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 client.4941 shutdown 2023-09-10T00:13:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 msgr2=0x55cddd5ff680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.319 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa274008d10 tx=0x7fa27400fc40 comp rx=0 tx=0).stop 2023-09-10T00:13:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 shutdown_connections 2023-09-10T00:13:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:6836/1785947719,v1:172.21.15.84:6837/1785947719] conn(0x55cddd5ffbc0 0x55cddd5fffa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cddd5a4a40 0x55cddd5ff680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cddd5a4120 0x55cddd5ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 --2- 172.21.15.84:0/1560236381 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cddd55a740 0x55cddd5b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2617fa640 0 client.4941 ms_handle_reset on v2:172.21.15.84:6836/1785947719 2023-09-10T00:13:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 >> 172.21.15.84:0/1560236381 conn(0x55cddd55c490 msgr2=0x55cddd5546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 shutdown_connections 2023-09-10T00:13:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 1 -- 172.21.15.84:0/1560236381 wait complete. 2023-09-10T00:13:16.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2876d7000 20 client.4941 trim_cache size 0 max 16384 2023-09-10T00:13:16.322 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:13:16.322 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "af9d6115-2022-4a0a-92c0-a49edd021b51", 2023-09-10T00:13:16.322 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-10T00:13:16.323 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4374, 2023-09-10T00:13:16.323 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-10T00:13:16.323 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-10T00:13:16.323 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-10T00:13:16.323 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 33.827753282000003, 2023-09-10T00:13:16.324 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 9, 2023-09-10T00:13:16.324 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 26, 2023-09-10T00:13:16.324 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 26, 2023-09-10T00:13:16.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 40.903520086999997 2023-09-10T00:13:16.324 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:13:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 msgr2=0x7fa268067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 0x7fa268067fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06d340 tx=0x7fa270009040 comp rx=0 tx=0).stop 2023-09-10T00:13:16.326 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 msgr2=0x7fa27c153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa26c01af00 tx=0x7fa26c0040c0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 shutdown_connections 2023-09-10T00:13:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa268065b20 0x7fa268067fe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c0c7240 0x7fa27c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27c0af8b0 0x7fa27c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 --2- 172.21.15.84:0/1889979400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa27c0af4d0 0x7fa27c153db0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 >> 172.21.15.84:0/1889979400 conn(0x7fa27c0c9500 msgr2=0x7fa27c0c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 shutdown_connections 2023-09-10T00:13:16.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.298+0000 7fa2845aa640 1 -- 172.21.15.84:0/1889979400 wait complete. 2023-09-10T00:13:16.329 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-10T00:13:16.339 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-10T00:13:16.340 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-10T00:13:16.340 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-10T00:13:16.340 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-10T00:13:16.341 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:16.341 INFO:tasks.ceph_fuse:client.2 config is {} 2023-09-10T00:13:16.341 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-10T00:13:16.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:16.342 INFO:tasks.ceph_fuse:client.1 config is {} 2023-09-10T00:13:16.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-10T00:13:16.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:16.343 INFO:tasks.ceph_fuse:client.3 config is {} 2023-09-10T00:13:16.343 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-10T00:13:16.343 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:16.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:16.344 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T00:13:16.349 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-09-10T00:13:16.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:16.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-09-10T00:13:16.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:16.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-09-10T00:13:16.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:16.609 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-09-10T00:13:16.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:16.616 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-09-10T00:13:16.674 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2023-09-10T00:13:16.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:13:16.675 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-10T00:13:16.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:13:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/3605527530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 msgr2=0x7f1004158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- 172.21.15.84:0/3605527530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f1004158ee0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10040ca1f0 tx=0x7f0fec01cc90 comp rx=0 tx=0).stop 2023-09-10T00:13:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/3605527530 shutdown_connections 2023-09-10T00:13:16.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- 172.21.15.84:0/3605527530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f1004158ee0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- 172.21.15.84:0/3605527530 >> v2:172.21.15.100:3300/0 conn(0x7f10040afa40 0x7f10040afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/3605527530 >> 172.21.15.84:0/3605527530 conn(0x7f10040cca70 msgr2=0x7f10040cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/3605527530 shutdown_connections 2023-09-10T00:13:16.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/3605527530 wait complete. 2023-09-10T00:13:16.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 Processor -- start 2023-09-10T00:13:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- start start 2023-09-10T00:13:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f100406d250 0x7f100414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10040afa40 0x7f10041535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100414d6c0 con 0x7f100406a6e0 2023-09-10T00:13:16.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100414b120 con 0x7f10040afa40 2023-09-10T00:13:16.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1004153f80 con 0x7f100406d250 2023-09-10T00:13:16.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46670/0 (socket says 172.21.15.84:46670) 2023-09-10T00:13:16.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 -- 172.21.15.84:0/1550260636 learned_addr learned my addr 172.21.15.84:0/1550260636 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:16.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f10037fe640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f100406d250 0x7f100414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1008d7c640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10040afa40 0x7f10041535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 -- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f100406d250 msgr2=0x7f100414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f100406d250 0x7f100414abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 -- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10040afa40 msgr2=0x7f10041535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:16.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10040afa40 0x7f10041535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 -- 172.21.15.84:0/1550260636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0098e0 con 0x7f100406a6e0 2023-09-10T00:13:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1003fff640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b440 tx=0x7f0ff400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011890 con 0x7f100406a6e0 2023-09-10T00:13:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ff4011b00 con 0x7f100406a6e0 2023-09-10T00:13:16.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100414d070 con 0x7f100406a6e0 2023-09-10T00:13:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40103e0 con 0x7f100406a6e0 2023-09-10T00:13:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.806+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1004152fb0 con 0x7f100406a6e0 2023-09-10T00:13:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004153200 con 0x7f100406a6e0 2023-09-10T00:13:16.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0ff4010540 con 0x7f100406a6e0 2023-09-10T00:13:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f1000ff9640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 0x7f0fe4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0ff4083c70 con 0x7f100406a6e0 2023-09-10T00:13:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f10037fe640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 0x7f0fe4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:16.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.810+0000 7f10037fe640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 0x7f0fe4067fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0af000 tx=0x7f0fec01b4d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:16.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.814+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0ff4051230 con 0x7f100406a6e0 2023-09-10T00:13:17.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:16.998+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f100414ced0 con 0x7f100406a6e0 2023-09-10T00:13:17.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f1000ff9640 1 -- 172.21.15.84:0/1550260636 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f100414ced0 con 0x7f100406a6e0 2023-09-10T00:13:17.004 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-10T00:13:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 msgr2=0x7f0fe4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 0x7f0fe4067fe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0af000 tx=0x7f0fec01b4d0 comp rx=0 tx=0).stop 2023-09-10T00:13:17.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 msgr2=0x7f10040c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b440 tx=0x7f0ff400b900 comp rx=0 tx=0).stop 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 shutdown_connections 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fe4065b20 0x7f0fe4067fe0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10040afa40 0x7f10041535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f100406d250 0x7f100414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:17.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 --2- 172.21.15.84:0/1550260636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f100406a6e0 0x7f10040c3740 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 >> 172.21.15.84:0/1550260636 conn(0x7f10040cca70 msgr2=0x7f10040cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 shutdown_connections 2023-09-10T00:13:17.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:17.002+0000 7f100a7df640 1 -- 172.21.15.84:0/1550260636 wait complete. 2023-09-10T00:13:17.021 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-10T00:13:17.022 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:13:17.022 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-10T00:13:17.022 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-10T00:13:17.023 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:17.023 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-10T00:13:17.023 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:13:17.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:13:17.023 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-10T00:13:17.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.024 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-10T00:13:17.030 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:17.030 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:17.030 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:17.030 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-09-10T00:13:17.031 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:13:17.032 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:17.033 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:13:17.033 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42479sec preferred_lft 42479sec 2023-09-10T00:13:17.033 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-09-10T00:13:17.033 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:17.033 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:13:17.034 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:d2:3e:84:82 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:17.034 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:13:17.034 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:17.034 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-10T00:13:17.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.035 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:17.035 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:17.035 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2023-09-10T00:13:17.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2023-09-10T00:13:17.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2023-09-10T00:13:17.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-10T00:13:17.036 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:17.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.108 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:13:17.161 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-10T00:13:17.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.162 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-10T00:13:17.210 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-10T00:13:17.210 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:13:17.210 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:13:17.210 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:13:17.211 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:13:17.211 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:13:17.211 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:17.211 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:17.211 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:17.212 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:13:17.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.212 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:17.213 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:17.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:13:17.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:13:17.214 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:13:17.214 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:17.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.283 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T00:13:17.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.329 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-10T00:13:17.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.377 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:17.377 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:17.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-10T00:13:17.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-10T00:13:17.378 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:17.448 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-10T00:13:17.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.449 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:17.449 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:17.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-10T00:13:17.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-10T00:13:17.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-10T00:13:17.450 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-10T00:13:17.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-10T00:13:17.451 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:17.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.543 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:17.544 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:17.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-10T00:13:17.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2023-09-10T00:13:17.545 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:17.563 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-10T00:13:17.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:17.564 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:17.616 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-10T00:13:17.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:17.616 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:17.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:17.721 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:17.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:17.775 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:17.776 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:17.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.777 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:17.824 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-10T00:13:17.825 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-10T00:13:17.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:17.882 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:17.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:17.932 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:17.933 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:17.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:17.934 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:17.945 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-09-10T00:13:17.942+0000 7fa0c3a54580 -1 init, newargv = 0x56074a6bda60 newargc=15 2023-09-10T00:13:17.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[46214]: starting ceph client 2023-09-10T00:13:17.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[46214]: starting fuse 2023-09-10T00:13:19.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:19.069 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:19.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:19.122 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:19.123 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:19.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.124 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:19.173 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:13:19.174 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-10T00:13:19.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:13:19.175 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-09-10T00:13:19.175 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-09-10T00:13:19.175 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-09-10T00:13:19.176 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-09-10T00:13:19.176 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:19.176 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-09-10T00:13:19.177 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-10T00:13:19.177 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-09-10T00:13:19.177 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-10T00:13:19.178 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:19.178 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-09-10T00:13:19.178 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-09-10T00:13:19.179 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-09-10T00:13:19.179 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-09-10T00:13:19.179 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:19.180 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-09-10T00:13:19.180 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:13:19.180 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:13:19.180 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:13:19.181 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-09-10T00:13:19.181 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-09-10T00:13:19.181 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-09-10T00:13:19.181 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:13:19.182 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:19.182 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-09-10T00:13:19.182 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-09-10T00:13:19.297 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.46214.asok 2023-09-10T00:13:19.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:13:19.309 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46214.asok 2023-09-10T00:13:19.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46214.asok status 2023-09-10T00:13:19.468 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:13:19.468 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-09-10T00:13:19.468 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:13:19.468 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:13:19.469 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-09-10T00:13:19.469 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-09-10T00:13:19.469 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-10T00:13:19.469 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "46214", 2023-09-10T00:13:19.469 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-09-10T00:13:19.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:19.470 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-09-10T00:13:19.470 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-09-10T00:13:19.470 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4953, 2023-09-10T00:13:19.470 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-09-10T00:13:19.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-09-10T00:13:19.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-09-10T00:13:19.471 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4953 2023-09-10T00:13:19.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:19.471 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2821236255 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:19.472 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2821236255 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4953 192.168.0.1:0/2821236255", 2023-09-10T00:13:19.473 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2821236255", 2023-09-10T00:13:19.474 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-09-10T00:13:19.474 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-09-10T00:13:19.474 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-09-10T00:13:19.474 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:13:19.474 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-09-10T00:13:19.475 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-09-10T00:13:19.475 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:13:19.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:13:19.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 -- 172.21.15.84:0/3701064011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c070360 msgr2=0x7f131c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 --2- 172.21.15.84:0/3701064011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c070360 0x7f131c0707f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f131c070ee0 tx=0x7f131401c710 comp rx=0 tx=0).stop 2023-09-10T00:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 -- 172.21.15.84:0/3701064011 shutdown_connections 2023-09-10T00:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 --2- 172.21.15.84:0/3701064011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c070360 0x7f131c0707f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 --2- 172.21.15.84:0/3701064011 >> v2:172.21.15.100:3300/0 conn(0x7f131c158210 0x7f131c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 -- 172.21.15.84:0/3701064011 >> 172.21.15.84:0/3701064011 conn(0x7f131c0cca70 msgr2=0x7f131c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 -- 172.21.15.84:0/3701064011 shutdown_connections 2023-09-10T00:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.602+0000 7f13226a2640 1 -- 172.21.15.84:0/3701064011 wait complete. 2023-09-10T00:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 Processor -- start 2023-09-10T00:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- start start 2023-09-10T00:13:19.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 0x7f131c1f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 0x7f131c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c1640 con 0x7f131c158210 2023-09-10T00:13:19.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c0a30 con 0x7f131c070360 2023-09-10T00:13:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131c0c0d10 con 0x7f131c0ade00 2023-09-10T00:13:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46692/0 (socket says 172.21.15.84:46692) 2023-09-10T00:13:19.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 -- 172.21.15.84:0/3068395796 learned_addr learned my addr 172.21.15.84:0/3068395796 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f131bfff640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 0x7f131c1f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 -- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 msgr2=0x7f131c159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f131b7fe640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 0x7f131c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 0x7f131c159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 -- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 msgr2=0x7f131c1f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 0x7f131c1f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 -- 172.21.15.84:0/3068395796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009560 con 0x7f131c158210 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f131b7fe640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 0x7f131c159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f131bfff640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 0x7f131c1f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1320c3f640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f131401a340 tx=0x7f13140040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:19.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140044d0 con 0x7f131c158210 2023-09-10T00:13:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1314005120 con 0x7f131c158210 2023-09-10T00:13:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314005530 con 0x7f131c158210 2023-09-10T00:13:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131c0c0ff0 con 0x7f131c158210 2023-09-10T00:13:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.606+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c1479b0 con 0x7f131c158210 2023-09-10T00:13:19.618 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f131c0c1a60 con 0x7f131c158210 2023-09-10T00:13:19.619 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f13140b4040 con 0x7f131c158210 2023-09-10T00:13:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f1318ff9640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 0x7f12fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f131bfff640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 0x7f12fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f131411d1e0 con 0x7f131c158210 2023-09-10T00:13:19.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.610+0000 7f131bfff640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 0x7f12fc067fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f130c007fd0 tx=0x7f130c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:19.621 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.614+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f131c0c1a60 con 0x7f131c158210 2023-09-10T00:13:19.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.802+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f131c0c1a60 con 0x7f131c158210 2023-09-10T00:13:19.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.802+0000 7f1318ff9640 1 -- 172.21.15.84:0/3068395796 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f131c0c1a60 con 0x7f131c158210 2023-09-10T00:13:19.806 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-10T00:13:19.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 msgr2=0x7f12fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:19.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 0x7f12fc067fe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f130c007fd0 tx=0x7f130c009040 comp rx=0 tx=0).stop 2023-09-10T00:13:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 msgr2=0x7f131c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f131401a340 tx=0x7f13140040e0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 shutdown_connections 2023-09-10T00:13:19.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f12fc065b20 0x7f12fc067fe0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f131c158210 0x7f131c159ac0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f131c0ade00 0x7f131c159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 --2- 172.21.15.84:0/3068395796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f131c070360 0x7f131c1f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 >> 172.21.15.84:0/3068395796 conn(0x7f131c0cca70 msgr2=0x7f131c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:19.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 shutdown_connections 2023-09-10T00:13:19.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:19.806+0000 7f13226a2640 1 -- 172.21.15.84:0/3068395796 wait complete. 2023-09-10T00:13:19.825 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-10T00:13:19.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:13:19.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-10T00:13:19.826 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-09-10T00:13:19.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:19.827 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-10T00:13:19.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:13:19.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:13:19.827 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-09-10T00:13:19.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.828 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-10T00:13:19.834 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:19.834 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:19.835 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.836 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-09-10T00:13:19.836 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:19.836 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.836 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-09-10T00:13:19.836 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42476sec preferred_lft 42476sec 2023-09-10T00:13:19.837 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-09-10T00:13:19.838 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.838 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:13:19.838 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:d2:3e:84:82 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.838 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:13:19.838 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.839 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-10T00:13:19.840 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-10T00:13:19.840 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-10T00:13:19.840 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:19.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.841 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:13:19.885 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-10T00:13:19.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.888 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-10T00:13:19.939 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-10T00:13:19.939 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:13:19.939 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:13:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:13:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:13:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:13:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:19.940 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:19.941 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:19.941 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:13:19.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:19.941 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:19.942 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:19.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:13:19.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:13:19.943 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:13:19.943 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:20.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.017 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T00:13:20.064 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-10T00:13:20.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.066 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2023-09-10T00:13:20.112 INFO:teuthology.orchestra.run.smithi084.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-09-10T00:13:20.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.113 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:20.113 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:20.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-10T00:13:20.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-09-10T00:13:20.114 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:20.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.181 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-10T00:13:20.240 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:20.241 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:20.241 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:20.241 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.241 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:20.241 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.242 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:20.242 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:e2:80:92:69:72 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-10T00:13:20.242 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-10T00:13:20.242 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.243 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3ce2:80ff:fe92:6972/64 scope link 2023-09-10T00:13:20.243 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.244 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-09-10T00:13:20.300 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:20.301 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:20.301 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:20.301 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.301 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:20.301 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.302 INFO:teuthology.orchestra.run.smithi084.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:20.302 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 3e:e2:80:92:69:72 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-10T00:13:20.302 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-10T00:13:20.302 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.302 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::3ce2:80ff:fe92:6972/64 scope link 2023-09-10T00:13:20.303 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:20.304 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-09-10T00:13:20.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.304 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:20.305 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:20.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-09-10T00:13:20.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-10T00:13:20.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-09-10T00:13:20.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-09-10T00:13:20.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-09-10T00:13:20.306 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:20.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.401 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:13:20.401 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:13:20.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.1 up 2023-09-10T00:13:20.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.1 master ceph-brx 2023-09-10T00:13:20.402 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:13:20.421 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-09-10T00:13:20.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:20.422 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:20.467 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-09-10T00:13:20.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:20.468 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:20.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:20.573 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:20.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:20.627 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:20.628 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:20.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.629 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:20.676 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:13:20.676 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2023-09-10T00:13:20.677 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-09-10T00:13:20.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:20.738 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:20.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:20.790 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:20.791 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:20.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:20.792 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:20.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:2023-09-10T00:13:20.798+0000 7f8735ca9580 -1 init, newargv = 0x5582e858d4f0 newargc=15 2023-09-10T00:13:20.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[46352]: starting ceph client 2023-09-10T00:13:20.805 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:13:20.809 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi084.stderr:ceph-fuse[46352]: starting fuse 2023-09-10T00:13:21.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:13:21.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:21.923 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:21.979 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:21.981 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:21.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:21.982 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:13:22.028 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:13:22.029 INFO:teuthology.orchestra.run.smithi084.stdout:46 2023-09-10T00:13:22.029 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2023-09-10T00:13:22.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:13:22.030 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-09-10T00:13:22.030 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-09-10T00:13:22.030 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-09-10T00:13:22.031 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-09-10T00:13:22.031 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:22.031 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-09-10T00:13:22.031 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-09-10T00:13:22.032 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-09-10T00:13:22.032 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-09-10T00:13:22.032 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:22.033 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-09-10T00:13:22.033 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-09-10T00:13:22.033 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-09-10T00:13:22.033 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-09-10T00:13:22.034 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:22.034 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-09-10T00:13:22.037 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:13:22.037 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:13:22.037 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:13:22.038 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-09-10T00:13:22.038 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-09-10T00:13:22.038 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-09-10T00:13:22.038 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:13:22.039 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:13:22.039 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.2")) 2023-09-10T00:13:22.039 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-09-10T00:13:22.153 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.2.46352.asok 2023-09-10T00:13:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:13:22.165 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46352.asok 2023-09-10T00:13:22.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46352.asok status 2023-09-10T00:13:22.319 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:13:22.319 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-09-10T00:13:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:13:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:13:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "2", 2023-09-10T00:13:22.320 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "46352", 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-09-10T00:13:22.321 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-09-10T00:13:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4968, 2023-09-10T00:13:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-09-10T00:13:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-09-10T00:13:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-09-10T00:13:22.322 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4968 2023-09-10T00:13:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:13:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:13:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-09-10T00:13:22.323 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 192413346 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.2:0", 2023-09-10T00:13:22.324 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 192413346 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4968 192.168.0.2:0/192413346", 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.2:0/192413346", 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 9, 2023-09-10T00:13:22.325 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 26, 2023-09-10T00:13:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:13:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-09-10T00:13:22.326 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-09-10T00:13:22.326 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:13:22.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:13:22.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- 172.21.15.84:0/978658704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c06d250 msgr2=0x7f890c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:22.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 --2- 172.21.15.84:0/978658704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c06d250 0x7f890c0b2200 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009840 tx=0x7f88f401c790 comp rx=0 tx=0).stop 2023-09-10T00:13:22.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- 172.21.15.84:0/978658704 shutdown_connections 2023-09-10T00:13:22.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 --2- 172.21.15.84:0/978658704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c06d250 0x7f890c0b2200 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- 172.21.15.84:0/978658704 >> 172.21.15.84:0/978658704 conn(0x7f890c0cca70 msgr2=0x7f890c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- 172.21.15.84:0/978658704 shutdown_connections 2023-09-10T00:13:22.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- 172.21.15.84:0/978658704 wait complete. 2023-09-10T00:13:22.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 Processor -- start 2023-09-10T00:13:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- start start 2023-09-10T00:13:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f890c06d250 0x7f890c1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f890c06fad0 0x7f890c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:22.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c14f130 con 0x7f890c158890 2023-09-10T00:13:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c14f380 con 0x7f890c06d250 2023-09-10T00:13:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8911703640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c14f660 con 0x7f890c06fad0 2023-09-10T00:13:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56992/0 (socket says 172.21.15.84:56992) 2023-09-10T00:13:22.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 -- 172.21.15.84:0/1190663196 learned_addr learned my addr 172.21.15.84:0/1190663196 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890affd640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f890c06d250 0x7f890c1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f89027fc640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f890c06fad0 0x7f890c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 -- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f890c06fad0 msgr2=0x7f890c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f890c06fad0 0x7f890c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 -- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f890c06d250 msgr2=0x7f890c1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f890c06d250 0x7f890c1458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 -- 172.21.15.84:0/1190663196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40094a0 con 0x7f890c158890 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f890b7fe640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f890400c780 tx=0x7f890400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.458+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904003d90 con 0x7f890c158890 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f890400ce90 con 0x7f890c158890 2023-09-10T00:13:22.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c14f940 con 0x7f890c158890 2023-09-10T00:13:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89040052d0 con 0x7f890c158890 2023-09-10T00:13:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c14ff00 con 0x7f890c158890 2023-09-10T00:13:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c1500f0 con 0x7f890c158890 2023-09-10T00:13:22.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8904005430 con 0x7f890c158890 2023-09-10T00:13:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8903fff640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 0x7f88ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:22.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f890affd640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 0x7f88ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8904083170 con 0x7f890c158890 2023-09-10T00:13:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.462+0000 7f890affd640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 0x7f88ec067fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0046c0 tx=0x7f88fc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:22.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.466+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8904050700 con 0x7f890c158890 2023-09-10T00:13:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.670+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f890c0712c0 con 0x7f890c158890 2023-09-10T00:13:22.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8903fff640 1 -- 172.21.15.84:0/1190663196 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8904017070 con 0x7f890c158890 2023-09-10T00:13:22.676 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-10T00:13:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 msgr2=0x7f88ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:22.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 0x7f88ec067fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0046c0 tx=0x7f88fc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 msgr2=0x7f890c1f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f890400c780 tx=0x7f890400cc40 comp rx=0 tx=0).stop 2023-09-10T00:13:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 shutdown_connections 2023-09-10T00:13:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f88ec065b20 0x7f88ec067fe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f890c158890 0x7f890c1f6190 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f890c06fad0 0x7f890c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 --2- 172.21.15.84:0/1190663196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f890c06d250 0x7f890c1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:22.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 >> 172.21.15.84:0/1190663196 conn(0x7f890c0cca70 msgr2=0x7f890c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:22.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 shutdown_connections 2023-09-10T00:13:22.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:22.674+0000 7f8911703640 1 -- 172.21.15.84:0/1190663196 wait complete. 2023-09-10T00:13:22.695 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-10T00:13:22.695 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:13:22.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-09-10T00:13:22.696 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-09-10T00:13:22.696 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:22.696 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-10T00:13:22.696 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:13:22.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:13:22.697 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-09-10T00:13:22.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.698 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-09-10T00:13:22.705 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:22.705 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:22.705 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:22.705 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-09-10T00:13:22.706 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:22.707 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:22.707 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-09-10T00:13:22.707 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:22.707 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:22.707 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42473sec preferred_lft 42473sec 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:22.708 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:13:22.709 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:69:cc:a0:ef brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:22.709 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:13:22.709 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:22.709 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-10T00:13:22.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.710 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:22.710 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:22.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2023-09-10T00:13:22.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2023-09-10T00:13:22.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2023-09-10T00:13:22.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-10T00:13:22.712 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:22.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.789 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:13:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-09-10T00:13:22.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.841 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-09-10T00:13:22.910 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-09-10T00:13:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:13:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:13:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:13:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:13:22.911 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:13:22.912 INFO:teuthology.orchestra.run.smithi100.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:22.912 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:22.912 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:22.912 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:13:22.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.913 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:22.913 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:22.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:13:22.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:13:22.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:13:22.914 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:22.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:22.988 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-09-10T00:13:23.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.036 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2023-09-10T00:13:23.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.087 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:23.087 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:23.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-10T00:13:23.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-09-10T00:13:23.088 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:23.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-09-10T00:13:23.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.158 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:23.158 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:23.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-09-10T00:13:23.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-10T00:13:23.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-09-10T00:13:23.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-09-10T00:13:23.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-09-10T00:13:23.160 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:23.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.263 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:23.263 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:23.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2023-09-10T00:13:23.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2023-09-10T00:13:23.264 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:23.282 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-09-10T00:13:23.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:23.283 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:23.334 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-09-10T00:13:23.335 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:23.335 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:23.383 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:23.440 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:23.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:23.495 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:23.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.496 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:23.543 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-10T00:13:23.543 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-09-10T00:13:23.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:23.603 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:23.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:23.657 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:23.657 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:23.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:23.659 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:23.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:2023-09-10T00:13:23.669+0000 7f17c0676580 -1 init, newargv = 0x558e154bb940 newargc=15 2023-09-10T00:13:23.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:ceph-fuse[44107]: starting ceph client 2023-09-10T00:13:23.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi100.stderr:ceph-fuse[44107]: starting fuse 2023-09-10T00:13:24.779 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:24.796 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:24.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:24.851 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:24.852 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:24.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:24.853 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:24.899 INFO:teuthology.orchestra.run.smithi100.stdout:43 2023-09-10T00:13:24.900 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-09-10T00:13:24.900 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:13:24.901 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-09-10T00:13:24.901 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-09-10T00:13:24.901 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-09-10T00:13:24.901 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-09-10T00:13:24.902 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:24.902 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-09-10T00:13:24.902 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-09-10T00:13:24.903 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-09-10T00:13:24.903 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-09-10T00:13:24.903 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:24.903 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-09-10T00:13:24.904 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-09-10T00:13:24.904 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-09-10T00:13:24.904 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-09-10T00:13:24.905 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:24.905 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-09-10T00:13:24.905 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:13:24.905 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:13:24.906 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:13:24.906 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-09-10T00:13:24.906 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-09-10T00:13:24.907 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-09-10T00:13:24.907 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:13:24.907 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:24.907 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.1")) 2023-09-10T00:13:24.908 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-09-10T00:13:25.024 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.1.44107.asok 2023-09-10T00:13:25.028 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:13:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:13:25.036 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44107.asok 2023-09-10T00:13:25.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44107.asok status 2023-09-10T00:13:25.196 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-09-10T00:13:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-09-10T00:13:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:13:25.196 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:13:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "1", 2023-09-10T00:13:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-09-10T00:13:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-09-10T00:13:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "44107", 2023-09-10T00:13:25.197 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4595, 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-09-10T00:13:25.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-09-10T00:13:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-09-10T00:13:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4595 2023-09-10T00:13:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-09-10T00:13:25.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-09-10T00:13:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:13:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2674479551 2023-09-10T00:13:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-09-10T00:13:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:25.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-09-10T00:13:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-09-10T00:13:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:13:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2674479551 2023-09-10T00:13:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:25.201 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4595 192.168.0.1:0/2674479551", 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/2674479551", 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 9, 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 28, 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:13:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-09-10T00:13:25.203 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-09-10T00:13:25.203 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-09-10T00:13:25.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:13:25.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- 172.21.15.84:0/2917743401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3144158a90 msgr2=0x7f31440c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:25.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 --2- 172.21.15.84:0/2917743401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3144158a90 0x7f31440c01c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3138009840 tx=0x7f313801c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- 172.21.15.84:0/2917743401 shutdown_connections 2023-09-10T00:13:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 --2- 172.21.15.84:0/2917743401 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31440c0700 0x7f31440b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 --2- 172.21.15.84:0/2917743401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3144158a90 0x7f31440c01c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- 172.21.15.84:0/2917743401 >> 172.21.15.84:0/2917743401 conn(0x7f31440cca70 msgr2=0x7f31440cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:25.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- 172.21.15.84:0/2917743401 shutdown_connections 2023-09-10T00:13:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- 172.21.15.84:0/2917743401 wait complete. 2023-09-10T00:13:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 Processor -- start 2023-09-10T00:13:25.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.342+0000 7f314aef9640 1 -- start start 2023-09-10T00:13:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31440b1cd0 0x7f314414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3144158a90 0x7f31440c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:25.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144159e90 con 0x7f31440c0700 2023-09-10T00:13:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31441572f0 con 0x7f31440b1cd0 2023-09-10T00:13:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31441575d0 con 0x7f3144158a90 2023-09-10T00:13:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:25.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57000/0 (socket says 172.21.15.84:57000) 2023-09-10T00:13:25.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 -- 172.21.15.84:0/2804183678 learned_addr learned my addr 172.21.15.84:0/2804183678 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:25.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 -- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3144158a90 msgr2=0x7f31440c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:25.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3149496640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3144158a90 0x7f31440c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:25.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3148c95640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31440b1cd0 0x7f314414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3144158a90 0x7f31440c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 -- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31440b1cd0 msgr2=0x7f314414d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31440b1cd0 0x7f314414d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 -- 172.21.15.84:0/2804183678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380094a0 con 0x7f31440c0700 2023-09-10T00:13:25.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3143fff640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f313400c970 tx=0x7f313400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134007bb0 con 0x7f31440c0700 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3134007e00 con 0x7f31440c0700 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31441578b0 con 0x7f31440c0700 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134005280 con 0x7f31440c0700 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3144157b90 con 0x7f31440c0700 2023-09-10T00:13:25.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3144159cf0 con 0x7f31440c0700 2023-09-10T00:13:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f31340053e0 con 0x7f31440c0700 2023-09-10T00:13:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 0x7f3130067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:25.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3134083b70 con 0x7f31440c0700 2023-09-10T00:13:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3148c95640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 0x7f3130067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.346+0000 7f3148c95640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 0x7f3130067fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31380af000 tx=0x7f313801b010 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:25.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.350+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3144159cf0 con 0x7f31440c0700 2023-09-10T00:13:25.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3144159cf0 con 0x7f31440c0700 2023-09-10T00:13:25.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f31417fa640 1 -- 172.21.15.84:0/2804183678 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3144159cf0 con 0x7f31440c0700 2023-09-10T00:13:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-09-10T00:13:25.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 msgr2=0x7f3130067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:25.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 0x7f3130067fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f31380af000 tx=0x7f313801b010 comp rx=0 tx=0).stop 2023-09-10T00:13:25.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 msgr2=0x7f3144156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:25.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f313400c970 tx=0x7f313400ce30 comp rx=0 tx=0).stop 2023-09-10T00:13:25.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 shutdown_connections 2023-09-10T00:13:25.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3130065b20 0x7f3130067fe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3144158a90 0x7f31440c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31440c0700 0x7f3144156980 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 --2- 172.21.15.84:0/2804183678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31440b1cd0 0x7f314414d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 >> 172.21.15.84:0/2804183678 conn(0x7f31440cca70 msgr2=0x7f314406be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 shutdown_connections 2023-09-10T00:13:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:25.542+0000 7f314aef9640 1 -- 172.21.15.84:0/2804183678 wait complete. 2023-09-10T00:13:25.562 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-10T00:13:25.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:13:25.563 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2023-09-10T00:13:25.563 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-09-10T00:13:25.563 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:25.563 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-10T00:13:25.564 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:13:25.564 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:13:25.564 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-09-10T00:13:25.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.565 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2023-09-10T00:13:25.572 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:25.573 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:25.573 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:25.573 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.573 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:25.573 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.574 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:25.574 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.574 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2023-09-10T00:13:25.574 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:25.574 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.575 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2023-09-10T00:13:25.575 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:13:25.575 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.575 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:13:25.575 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42470sec preferred_lft 42470sec 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:13:25.576 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 02:42:69:cc:a0:ef brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.577 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:13:25.577 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.577 INFO:teuthology.orchestra.run.smithi100.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:25.577 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-10T00:13:25.577 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-10T00:13:25.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.578 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-10T00:13:25.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.578 INFO:teuthology.orchestra.run.smithi100.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-10T00:13:25.578 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-10T00:13:25.579 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-10T00:13:25.579 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.580 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:13:25.627 INFO:teuthology.orchestra.run.smithi100.stdout:1 2023-09-10T00:13:25.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.629 DEBUG:teuthology.orchestra.run.smithi100:> route 2023-09-10T00:13:25.678 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2023-09-10T00:13:25.679 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:13:25.679 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:13:25.679 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:13:25.679 INFO:teuthology.orchestra.run.smithi100.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:13:25.679 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:13:25.680 INFO:teuthology.orchestra.run.smithi100.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:25.680 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:25.680 INFO:teuthology.orchestra.run.smithi100.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:13:25.680 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:13:25.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.681 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:25.681 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:25.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:13:25.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:13:25.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:13:25.682 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:25.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.761 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-09-10T00:13:25.807 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-10T00:13:25.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.809 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2023-09-10T00:13:25.860 INFO:teuthology.orchestra.run.smithi100.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-09-10T00:13:25.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.861 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:25.861 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:25.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-10T00:13:25.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-09-10T00:13:25.862 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:25.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-10T00:13:25.987 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:25.988 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:25.988 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:25.988 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.988 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:25.989 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.989 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:25.989 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 52:b9:b4:35:9e:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-10T00:13:25.989 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-10T00:13:25.989 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.990 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::50b9:b4ff:fe35:9ef6/64 scope link 2023-09-10T00:13:25.990 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:25.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:25.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-09-10T00:13:26.048 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:13:26.048 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:13:26.049 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:13:26.049 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:26.049 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2023-09-10T00:13:26.049 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:26.049 INFO:teuthology.orchestra.run.smithi100.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:13:26.050 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 52:b9:b4:35:9e:f6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-09-10T00:13:26.050 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-09-10T00:13:26.050 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:26.050 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::50b9:b4ff:fe35:9ef6/64 scope link 2023-09-10T00:13:26.050 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:13:26.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-09-10T00:13:26.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:26.052 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:26.053 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:26.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-09-10T00:13:26.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-09-10T00:13:26.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-09-10T00:13:26.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-09-10T00:13:26.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-09-10T00:13:26.056 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:26.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:26.150 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2023-09-10T00:13:26.151 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2023-09-10T00:13:26.151 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.1 up 2023-09-10T00:13:26.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.1 master ceph-brx 2023-09-10T00:13:26.152 DEBUG:teuthology.orchestra.run.smithi100:> ') 2023-09-10T00:13:26.173 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-09-10T00:13:26.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:26.174 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:26.219 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-09-10T00:13:26.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:13:26.220 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:26.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:26.324 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:26.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:26.379 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:26.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:26.380 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:26.427 INFO:teuthology.orchestra.run.smithi100.stdout:43 2023-09-10T00:13:26.427 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-09-10T00:13:26.428 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-09-10T00:13:26.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:26.486 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:26.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:26.541 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:26.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:26.542 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:26.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi100.stderr:2023-09-10T00:13:26.549+0000 7f30dad3f580 -1 init, newargv = 0x558a457ad220 newargc=15 2023-09-10T00:13:26.554 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi100.stderr:ceph-fuse[44219]: starting ceph client 2023-09-10T00:13:26.558 INFO:teuthology.orchestra.run.smithi100.stdout:43 2023-09-10T00:13:26.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi100.stderr:ceph-fuse[44219]: starting fuse 2023-09-10T00:13:27.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2023-09-10T00:13:27.677 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:13:27.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:13:27.730 INFO:teuthology.orchestra.run.smithi100.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:13:27.731 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:13:27.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:27.732 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2023-09-10T00:13:27.780 INFO:teuthology.orchestra.run.smithi100.stdout:43 2023-09-10T00:13:27.780 INFO:teuthology.orchestra.run.smithi100.stdout:46 2023-09-10T00:13:27.781 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 46] 2023-09-10T00:13:27.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:13:27.782 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2023-09-10T00:13:27.783 DEBUG:teuthology.orchestra.run.smithi100:> import re 2023-09-10T00:13:27.783 DEBUG:teuthology.orchestra.run.smithi100:> import os 2023-09-10T00:13:27.784 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2023-09-10T00:13:27.784 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:27.785 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2023-09-10T00:13:27.785 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-09-10T00:13:27.786 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2023-09-10T00:13:27.787 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-09-10T00:13:27.787 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:27.788 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2023-09-10T00:13:27.788 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2023-09-10T00:13:27.789 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2023-09-10T00:13:27.789 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2023-09-10T00:13:27.790 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:27.791 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2023-09-10T00:13:27.791 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:13:27.792 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:13:27.793 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:13:27.793 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2023-09-10T00:13:27.794 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2023-09-10T00:13:27.794 DEBUG:teuthology.orchestra.run.smithi100:> return f 2023-09-10T00:13:27.795 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:13:27.795 DEBUG:teuthology.orchestra.run.smithi100:> 2023-09-10T00:13:27.796 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.3")) 2023-09-10T00:13:27.796 DEBUG:teuthology.orchestra.run.smithi100:> ' 2023-09-10T00:13:27.901 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.3.44219.asok 2023-09-10T00:13:27.905 INFO:teuthology.orchestra.run.smithi100.stderr:2023-09-10T00:13:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:13:27.913 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44219.asok 2023-09-10T00:13:27.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:27.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44219.asok status 2023-09-10T00:13:28.063 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-09-10T00:13:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2023-09-10T00:13:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:13:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:13:28.064 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "3", 2023-09-10T00:13:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2023-09-10T00:13:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-09-10T00:13:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "44219", 2023-09-10T00:13:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2023-09-10T00:13:28.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2023-09-10T00:13:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2023-09-10T00:13:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4699, 2023-09-10T00:13:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2023-09-10T00:13:28.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2023-09-10T00:13:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2023-09-10T00:13:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4699 2023-09-10T00:13:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:28.067 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-09-10T00:13:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-09-10T00:13:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2023-09-10T00:13:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2850874333 2023-09-10T00:13:28.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.2:0", 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2850874333 2023-09-10T00:13:28.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2023-09-10T00:13:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4699 192.168.0.2:0/2850874333", 2023-09-10T00:13:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.2:0/2850874333", 2023-09-10T00:13:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2023-09-10T00:13:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 9, 2023-09-10T00:13:28.070 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 28, 2023-09-10T00:13:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:13:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2023-09-10T00:13:28.071 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2023-09-10T00:13:28.071 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-09-10T00:13:28.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.077 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-09-10T00:13:28.077 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:28.085 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-09-10T00:13:28.085 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:28.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:28.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.142 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-09-10T00:13:28.143 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:28.189 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-09-10T00:13:28.189 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:28.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.246 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-09-10T00:13:28.246 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:28.254 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-09-10T00:13:28.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:28.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:28.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.313 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2023-09-10T00:13:28.313 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:28.360 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2023-09-10T00:13:28.361 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:28.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:28.416 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-09-10T00:13:28.435 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:28.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/3953517498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 msgr2=0x7f5bec0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- 172.21.15.84:0/3953517498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c76d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400a950 tx=0x7f5bd401da00 comp rx=0 tx=0).stop 2023-09-10T00:13:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/3953517498 shutdown_connections 2023-09-10T00:13:28.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- 172.21.15.84:0/3953517498 >> v2:172.21.15.100:3300/0 conn(0x7f5bec070360 0x7f5bec0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- 172.21.15.84:0/3953517498 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c76d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/3953517498 >> 172.21.15.84:0/3953517498 conn(0x7f5bec0cca70 msgr2=0x7f5bec0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:28.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/3953517498 shutdown_connections 2023-09-10T00:13:28.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/3953517498 wait complete. 2023-09-10T00:13:28.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 Processor -- start 2023-09-10T00:13:28.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- start start 2023-09-10T00:13:28.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec070360 0x7f5bec14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec14c440 con 0x7f5bec0ade00 2023-09-10T00:13:28.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0c3740 con 0x7f5bec070360 2023-09-10T00:13:28.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec152610 con 0x7f5bec158210 2023-09-10T00:13:28.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57016/0 (socket says 172.21.15.84:57016) 2023-09-10T00:13:28.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 -- 172.21.15.84:0/1872239684 learned_addr learned my addr 172.21.15.84:0/1872239684 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:28.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5beaffd640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec070360 0x7f5bec14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5beb7fe640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 -- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 msgr2=0x7f5bec0c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 -- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec070360 msgr2=0x7f5bec14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec070360 0x7f5bec14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 -- 172.21.15.84:0/1872239684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd400a5b0 con 0x7f5bec0ade00 2023-09-10T00:13:28.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5beb7fe640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:28.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bea7fc640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c10 tx=0x7f5bd40056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:28.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40048d0 con 0x7f5bec0ade00 2023-09-10T00:13:28.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5bd4004b20 con 0x7f5bec0ade00 2023-09-10T00:13:28.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec0c3990 con 0x7f5bec0ade00 2023-09-10T00:13:28.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40ae440 con 0x7f5bec0ade00 2023-09-10T00:13:28.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.569+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0c3f50 con 0x7f5bec0ade00 2023-09-10T00:13:28.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0712c0 con 0x7f5bec0ade00 2023-09-10T00:13:28.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5bd40b5040 con 0x7f5bec0ade00 2023-09-10T00:13:28.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5be37fe640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 0x7f5bcc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5bd40a6e40 con 0x7f5bec0ade00 2023-09-10T00:13:28.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5beaffd640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 0x7f5bcc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.573+0000 7f5beaffd640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 0x7f5bcc068010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc001ea0 tx=0x7f5bdc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:28.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.577+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5bd40eb280 con 0x7f5bec0ade00 2023-09-10T00:13:28.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.729+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bec073400 con 0x7f5bec0ade00 2023-09-10T00:13:28.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5be37fe640 1 -- 172.21.15.84:0/1872239684 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f5bd40b3020 con 0x7f5bec0ade00 2023-09-10T00:13:28.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:28.737 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:28.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 msgr2=0x7f5bcc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 0x7f5bcc068010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc001ea0 tx=0x7f5bdc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 msgr2=0x7f5bec14eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4000c10 tx=0x7f5bd40056d0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 shutdown_connections 2023-09-10T00:13:28.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5bcc065b50 0x7f5bcc068010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5bec158210 0x7f5bec0c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bec0ade00 0x7f5bec14eca0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 --2- 172.21.15.84:0/1872239684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec070360 0x7f5bec14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 >> 172.21.15.84:0/1872239684 conn(0x7f5bec0cca70 msgr2=0x7f5bec0cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:28.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 shutdown_connections 2023-09-10T00:13:28.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.733+0000 7f5bf17de640 1 -- 172.21.15.84:0/1872239684 wait complete. 2023-09-10T00:13:28.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:28.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:28.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.865+0000 7f974d7ab640 1 -- 172.21.15.84:0/768681254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 msgr2=0x7f974815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.865+0000 7f974d7ab640 1 --2- 172.21.15.84:0/768681254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974815b540 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9738009840 tx=0x7f973801c7c0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.865+0000 7f974d7ab640 1 -- 172.21.15.84:0/768681254 shutdown_connections 2023-09-10T00:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.865+0000 7f974d7ab640 1 --2- 172.21.15.84:0/768681254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974815b540 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.865+0000 7f974d7ab640 1 -- 172.21.15.84:0/768681254 >> 172.21.15.84:0/768681254 conn(0x7f97480aec00 msgr2=0x7f97480cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:28.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- 172.21.15.84:0/768681254 shutdown_connections 2023-09-10T00:13:28.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- 172.21.15.84:0/768681254 wait complete. 2023-09-10T00:13:28.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 Processor -- start 2023-09-10T00:13:28.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- start start 2023-09-10T00:13:28.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 0x7f9748144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9748157f00 0x7f974814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814d780 con 0x7f974814eb10 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814cb70 con 0x7f974806ccb0 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974814ce50 con 0x7f9748157f00 2023-09-10T00:13:28.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57034/0 (socket says 172.21.15.84:57034) 2023-09-10T00:13:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 -- 172.21.15.84:0/3851521114 learned_addr learned my addr 172.21.15.84:0/3851521114 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f9746ffd640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 0x7f9748144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97477fe640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9748157f00 0x7f974814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 -- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9748157f00 msgr2=0x7f974814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9748157f00 0x7f974814b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 -- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 msgr2=0x7f9748144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 0x7f9748144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 -- 172.21.15.84:0/3851521114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380094a0 con 0x7f974814eb10 2023-09-10T00:13:28.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f9746ffd640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 0x7f9748144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f97467fc640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f973c00b410 tx=0x7f973c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c004020 con 0x7f974814eb10 2023-09-10T00:13:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f973c004270 con 0x7f974814eb10 2023-09-10T00:13:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974814d130 con 0x7f974814eb10 2023-09-10T00:13:28.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011890 con 0x7f974814eb10 2023-09-10T00:13:28.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748144fb0 con 0x7f974814eb10 2023-09-10T00:13:28.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.869+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974814d930 con 0x7f974814eb10 2023-09-10T00:13:28.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.873+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f973c0119f0 con 0x7f974814eb10 2023-09-10T00:13:28.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.873+0000 7f972f7fe640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 0x7f9734068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:28.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.873+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f973c083580 con 0x7f974814eb10 2023-09-10T00:13:28.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.873+0000 7f9746ffd640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 0x7f9734068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:28.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.873+0000 7f9746ffd640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 0x7f9734068010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97380af000 tx=0x7f973801b000 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:28.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:28.877+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f974814d930 con 0x7f974814eb10 2023-09-10T00:13:29.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.025+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f974814d8c0 con 0x7f974814eb10 2023-09-10T00:13:29.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.025+0000 7f972f7fe640 1 -- 172.21.15.84:0/3851521114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f973c050ba0 con 0x7f974814eb10 2023-09-10T00:13:29.031 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 msgr2=0x7f9734068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 0x7f9734068010 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97380af000 tx=0x7f973801b000 comp rx=0 tx=0).stop 2023-09-10T00:13:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 msgr2=0x7f974814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f973c00b410 tx=0x7f973c00b8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 shutdown_connections 2023-09-10T00:13:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9734065b50 0x7f9734068010 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9748157f00 0x7f974814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f974814eb10 0x7f974814fa80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 --2- 172.21.15.84:0/3851521114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f974806ccb0 0x7f9748144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 >> 172.21.15.84:0/3851521114 conn(0x7f97480aec00 msgr2=0x7f97480700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 shutdown_connections 2023-09-10T00:13:29.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.029+0000 7f974d7ab640 1 -- 172.21.15.84:0/3851521114 wait complete. 2023-09-10T00:13:29.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:29.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.173+0000 7fda19f87640 1 -- 172.21.15.84:0/1337637631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1414eb10 msgr2=0x7fda1415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.173+0000 7fda19f87640 1 --2- 172.21.15.84:0/1337637631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1414eb10 0x7fda1415b540 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fda14070cb0 tx=0x7fda0c01c7e0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/1337637631 shutdown_connections 2023-09-10T00:13:29.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 --2- 172.21.15.84:0/1337637631 >> v2:172.21.15.100:3300/0 conn(0x7fda14157f00 0x7fda1406c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 --2- 172.21.15.84:0/1337637631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1414eb10 0x7fda1415b540 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/1337637631 >> 172.21.15.84:0/1337637631 conn(0x7fda140aec00 msgr2=0x7fda140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/1337637631 shutdown_connections 2023-09-10T00:13:29.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/1337637631 wait complete. 2023-09-10T00:13:29.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 Processor -- start 2023-09-10T00:13:29.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- start start 2023-09-10T00:13:29.183 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda1414eb10 0x7fda1413f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda14157f00 0x7fda1406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1415a1e0 con 0x7fda1406cae0 2023-09-10T00:13:29.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1414aa90 con 0x7fda14157f00 2023-09-10T00:13:29.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda141595d0 con 0x7fda1414eb10 2023-09-10T00:13:29.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57044/0 (socket says 172.21.15.84:57044) 2023-09-10T00:13:29.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 -- 172.21.15.84:0/706708486 learned_addr learned my addr 172.21.15.84:0/706708486 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:29.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 -- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda1414eb10 msgr2=0x7fda1413f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda1414eb10 0x7fda1413f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 -- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda14157f00 msgr2=0x7fda1406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda13fff640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda14157f00 0x7fda1406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda14157f00 0x7fda1406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 -- 172.21.15.84:0/706708486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0094a0 con 0x7fda1406cae0 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda137fe640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0193f0 tx=0x7fda0c0a7a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0a7e70 con 0x7fda1406cae0 2023-09-10T00:13:29.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda0c004130 con 0x7fda1406cae0 2023-09-10T00:13:29.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0044e0 con 0x7fda1406cae0 2023-09-10T00:13:29.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda141598b0 con 0x7fda1406cae0 2023-09-10T00:13:29.187 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.177+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda14159e70 con 0x7fda1406cae0 2023-09-10T00:13:29.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1415a350 con 0x7fda1406cae0 2023-09-10T00:13:29.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fda0c003600 con 0x7fda1406cae0 2023-09-10T00:13:29.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fd9fbfff640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 0x7fda00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda0c0aa070 con 0x7fda1406cae0 2023-09-10T00:13:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fda12ffd640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 0x7fda00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.181+0000 7fda12ffd640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 0x7fda00067fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda080058d0 tx=0x7fda08005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.185+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fda0c0ec0c0 con 0x7fda1406cae0 2023-09-10T00:13:29.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda1406d330 con 0x7fda1406cae0 2023-09-10T00:13:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fd9fbfff640 1 -- 172.21.15.84:0/706708486 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda0c0b7e60 con 0x7fda1406cae0 2023-09-10T00:13:29.341 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 msgr2=0x7fda00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 0x7fda00067fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda080058d0 tx=0x7fda08005860 comp rx=0 tx=0).stop 2023-09-10T00:13:29.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 msgr2=0x7fda1414a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0193f0 tx=0x7fda0c0a7a80 comp rx=0 tx=0).stop 2023-09-10T00:13:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 shutdown_connections 2023-09-10T00:13:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fda00065b20 0x7fda00067fe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda14157f00 0x7fda1406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fda1414eb10 0x7fda1413f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 --2- 172.21.15.84:0/706708486 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fda1406cae0 0x7fda1414a550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.337+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 >> 172.21.15.84:0/706708486 conn(0x7fda140aec00 msgr2=0x7fda140b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.341+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 shutdown_connections 2023-09-10T00:13:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.341+0000 7fda19f87640 1 -- 172.21.15.84:0/706708486 wait complete. 2023-09-10T00:13:29.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:29.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/3685269019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295806ccb0 msgr2=0x7f29580ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- 172.21.15.84:0/3685269019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295806ccb0 0x7f29580ab480 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2958159030 tx=0x7f295001cca0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/3685269019 shutdown_connections 2023-09-10T00:13:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- 172.21.15.84:0/3685269019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295806ccb0 0x7f29580ab480 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- 172.21.15.84:0/3685269019 >> v2:172.21.15.100:3300/0 conn(0x7f295814eb10 0x7f295815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/3685269019 >> 172.21.15.84:0/3685269019 conn(0x7f29580aec00 msgr2=0x7f29580cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/3685269019 shutdown_connections 2023-09-10T00:13:29.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/3685269019 wait complete. 2023-09-10T00:13:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 Processor -- start 2023-09-10T00:13:29.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- start start 2023-09-10T00:13:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 0x7f29581478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2958157f00 0x7f295815a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580adc10 con 0x7f295814eb10 2023-09-10T00:13:29.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958145810 con 0x7f2958157f00 2023-09-10T00:13:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580acee0 con 0x7f295806ccb0 2023-09-10T00:13:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57062/0 (socket says 172.21.15.84:57062) 2023-09-10T00:13:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 -- 172.21.15.84:0/2454121118 learned_addr learned my addr 172.21.15.84:0/2454121118 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:29.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29577fe640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2958157f00 0x7f295815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f2956ffd640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 0x7f29581478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 -- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 msgr2=0x7f29581478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 0x7f29581478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 -- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2958157f00 msgr2=0x7f295815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2958157f00 0x7f295815a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 -- 172.21.15.84:0/2454121118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500098e0 con 0x7f295814eb10 2023-09-10T00:13:29.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f2956ffd640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 0x7f29581478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:29.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f29567fc640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c3c0 tx=0x7f294c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0052d0 con 0x7f295814eb10 2023-09-10T00:13:29.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f294c003600 con 0x7f295814eb10 2023-09-10T00:13:29.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c003a10 con 0x7f295814eb10 2023-09-10T00:13:29.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29580ad1c0 con 0x7f295814eb10 2023-09-10T00:13:29.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.489+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29581470d0 con 0x7f295814eb10 2023-09-10T00:13:29.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2958146c50 con 0x7f295814eb10 2023-09-10T00:13:29.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f294c003b70 con 0x7f295814eb10 2023-09-10T00:13:29.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f293f7fe640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 0x7f2944067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f294c082e40 con 0x7f295814eb10 2023-09-10T00:13:29.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f2956ffd640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 0x7f2944067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.493+0000 7f2956ffd640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 0x7f2944067fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2948005fd0 tx=0x7f2948005e80 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.497+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2958146c50 con 0x7f295814eb10 2023-09-10T00:13:29.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2958146c50 con 0x7f295814eb10 2023-09-10T00:13:29.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f293f7fe640 1 -- 172.21.15.84:0/2454121118 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f294c017020 con 0x7f295814eb10 2023-09-10T00:13:29.656 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 msgr2=0x7f2944067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 0x7f2944067fe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2948005fd0 tx=0x7f2948005e80 comp rx=0 tx=0).stop 2023-09-10T00:13:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 msgr2=0x7f295815a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c3c0 tx=0x7f294c00c880 comp rx=0 tx=0).stop 2023-09-10T00:13:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 shutdown_connections 2023-09-10T00:13:29.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2944065b20 0x7f2944067fe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2958157f00 0x7f295815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f295814eb10 0x7f295815a200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 --2- 172.21.15.84:0/2454121118 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f295806ccb0 0x7f29581478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 >> 172.21.15.84:0/2454121118 conn(0x7f29580aec00 msgr2=0x7f2958156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 shutdown_connections 2023-09-10T00:13:29.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.653+0000 7f295d287640 1 -- 172.21.15.84:0/2454121118 wait complete. 2023-09-10T00:13:29.675 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:29.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 -- 172.21.15.84:0/179683770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 msgr2=0x7fd144070f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 --2- 172.21.15.84:0/179683770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd144070f20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd134009900 tx=0x7fd13401c890 comp rx=0 tx=0).stop 2023-09-10T00:13:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 -- 172.21.15.84:0/179683770 shutdown_connections 2023-09-10T00:13:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 --2- 172.21.15.84:0/179683770 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 0x7fd14406df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 --2- 172.21.15.84:0/179683770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd144070f20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 -- 172.21.15.84:0/179683770 >> 172.21.15.84:0/179683770 conn(0x7fd1440ccef0 msgr2=0x7fd1440cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 -- 172.21.15.84:0/179683770 shutdown_connections 2023-09-10T00:13:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.793+0000 7fd1497b5640 1 -- 172.21.15.84:0/179683770 wait complete. 2023-09-10T00:13:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 Processor -- start 2023-09-10T00:13:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- start start 2023-09-10T00:13:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd144069bf0 0x7fd144148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 0x7fd14414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1441485b0 con 0x7fd144158c10 2023-09-10T00:13:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144148f20 con 0x7fd144069bf0 2023-09-10T00:13:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14414bbd0 con 0x7fd14406da90 2023-09-10T00:13:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57066/0 (socket says 172.21.15.84:57066) 2023-09-10T00:13:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 -- 172.21.15.84:0/1315139826 learned_addr learned my addr 172.21.15.84:0/1315139826 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:29.805 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd142ffd640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd144069bf0 0x7fd144148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1427fc640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 0x7fd14414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 -- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 msgr2=0x7fd14414b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 0x7fd14414b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 -- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd144069bf0 msgr2=0x7fd144148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd144069bf0 0x7fd144148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 -- 172.21.15.84:0/1315139826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009560 con 0x7fd144158c10 2023-09-10T00:13:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1437fe640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00ea20 tx=0x7fd13c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c003de0 con 0x7fd144158c10 2023-09-10T00:13:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd13c004c70 con 0x7fd144158c10 2023-09-10T00:13:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14414c760 con 0x7fd144158c10 2023-09-10T00:13:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00cc30 con 0x7fd144158c10 2023-09-10T00:13:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14414cd20 con 0x7fd144158c10 2023-09-10T00:13:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.797+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14414c5c0 con 0x7fd144158c10 2023-09-10T00:13:29.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.801+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd13c004030 con 0x7fd144158c10 2023-09-10T00:13:29.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.801+0000 7fd13b7fe640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 0x7fd12c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.801+0000 7fd142ffd640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 0x7fd12c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.801+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd13c083df0 con 0x7fd144158c10 2023-09-10T00:13:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.801+0000 7fd142ffd640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 0x7fd12c067fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd13401b0d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:29.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.805+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd14414c5c0 con 0x7fd144158c10 2023-09-10T00:13:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.949+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd14414c5c0 con 0x7fd144158c10 2023-09-10T00:13:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.949+0000 7fd13b7fe640 1 -- 172.21.15.84:0/1315139826 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd13c016020 con 0x7fd144158c10 2023-09-10T00:13:29.954 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 msgr2=0x7fd12c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 0x7fd12c067fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1340af000 tx=0x7fd13401b0d0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 msgr2=0x7fd1440b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00ea20 tx=0x7fd13c00eee0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 shutdown_connections 2023-09-10T00:13:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd12c065b20 0x7fd12c067fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd144158c10 0x7fd1440b1170 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd14406da90 0x7fd14414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 --2- 172.21.15.84:0/1315139826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd144069bf0 0x7fd144148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:29.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 >> 172.21.15.84:0/1315139826 conn(0x7fd1440ccef0 msgr2=0x7fd14415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 shutdown_connections 2023-09-10T00:13:29.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:29.953+0000 7fd1497b5640 1 -- 172.21.15.84:0/1315139826 wait complete. 2023-09-10T00:13:29.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/495636923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 msgr2=0x7fbd400cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- 172.21.15.84:0/495636923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400cff90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd4006cdf0 tx=0x7fbd3801f510 comp rx=0 tx=0).stop 2023-09-10T00:13:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/495636923 shutdown_connections 2023-09-10T00:13:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- 172.21.15.84:0/495636923 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400cff90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- 172.21.15.84:0/495636923 >> v2:172.21.15.100:3300/0 conn(0x7fbd4015ab80 0x7fbd400cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/495636923 >> 172.21.15.84:0/495636923 conn(0x7fbd400b25b0 msgr2=0x7fbd400b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/495636923 shutdown_connections 2023-09-10T00:13:30.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/495636923 wait complete. 2023-09-10T00:13:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 Processor -- start 2023-09-10T00:13:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- start start 2023-09-10T00:13:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4015ab80 0x7fbd40159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbd4015af60 0x7fbd400c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c8c80 con 0x7fbd400afba0 2023-09-10T00:13:30.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c83e0 con 0x7fbd4015ab80 2023-09-10T00:13:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400c86c0 con 0x7fbd4015af60 2023-09-10T00:13:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37842/0 (socket says 172.21.15.84:37842) 2023-09-10T00:13:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 -- 172.21.15.84:0/2350897549 learned_addr learned my addr 172.21.15.84:0/2350897549 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:30.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3e59c640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4015ab80 0x7fbd40159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3f59e640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbd4015af60 0x7fbd400c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 -- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbd4015af60 msgr2=0x7fbd400c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbd4015af60 0x7fbd400c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 -- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4015ab80 msgr2=0x7fbd40159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4015ab80 0x7fbd40159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 -- 172.21.15.84:0/2350897549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380098e0 con 0x7fbd400afba0 2023-09-10T00:13:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd3ed9d640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c970 tx=0x7fbd3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30007bb0 con 0x7fbd400afba0 2023-09-10T00:13:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbd30007e00 con 0x7fbd400afba0 2023-09-10T00:13:30.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd400c89a0 con 0x7fbd400afba0 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30005280 con 0x7fbd400afba0 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.089+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd400c80d0 con 0x7fbd400afba0 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd400c93c0 con 0x7fbd400afba0 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbd300053e0 con 0x7fbd400afba0 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd277fe640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 0x7fbd2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd30083cf0 con 0x7fbd400afba0 2023-09-10T00:13:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd3e59c640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 0x7fbd2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.093+0000 7fbd3e59c640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 0x7fbd2c067fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd401e8560 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.097+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbd400c93c0 con 0x7fbd400afba0 2023-09-10T00:13:30.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd400c93c0 con 0x7fbd400afba0 2023-09-10T00:13:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd277fe640 1 -- 172.21.15.84:0/2350897549 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fbd400c93c0 con 0x7fbd400afba0 2023-09-10T00:13:30.253 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:30.253 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:30.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 msgr2=0x7fbd2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 0x7fbd2c067fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd401e8560 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2023-09-10T00:13:30.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 msgr2=0x7fbd400a7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c970 tx=0x7fbd3000ce30 comp rx=0 tx=0).stop 2023-09-10T00:13:30.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 shutdown_connections 2023-09-10T00:13:30.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbd2c065b20 0x7fbd2c067fe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbd4015af60 0x7fbd400c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd4015ab80 0x7fbd40159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.256 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 --2- 172.21.15.84:0/2350897549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbd400afba0 0x7fbd400a7ea0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 >> 172.21.15.84:0/2350897549 conn(0x7fbd400b25b0 msgr2=0x7fbd4006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 shutdown_connections 2023-09-10T00:13:30.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.249+0000 7fbd450f2640 1 -- 172.21.15.84:0/2350897549 wait complete. 2023-09-10T00:13:30.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:30.271 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:30.390 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- 172.21.15.84:0/964885806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b08158c60 msgr2=0x7f3b080b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 --2- 172.21.15.84:0/964885806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b08158c60 0x7f3b080b0870 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009900 tx=0x7f3afc01c850 comp rx=0 tx=0).stop 2023-09-10T00:13:30.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- 172.21.15.84:0/964885806 shutdown_connections 2023-09-10T00:13:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 --2- 172.21.15.84:0/964885806 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b080b0db0 0x7f3b080ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 --2- 172.21.15.84:0/964885806 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b08158c60 0x7f3b080b0870 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- 172.21.15.84:0/964885806 >> 172.21.15.84:0/964885806 conn(0x7f3b080af230 msgr2=0x7f3b080af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- 172.21.15.84:0/964885806 shutdown_connections 2023-09-10T00:13:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- 172.21.15.84:0/964885806 wait complete. 2023-09-10T00:13:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 Processor -- start 2023-09-10T00:13:30.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 -- start start 2023-09-10T00:13:30.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.385+0000 7f3b0f137640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b080ac9d0 0x7f3b080c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b08158c60 0x7f3b081463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815aa80 con 0x7f3b080b0db0 2023-09-10T00:13:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080c3880 con 0x7f3b080ac9d0 2023-09-10T00:13:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0815a150 con 0x7f3b08158c60 2023-09-10T00:13:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37858/0 (socket says 172.21.15.84:37858) 2023-09-10T00:13:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 -- 172.21.15.84:0/1649248344 learned_addr learned my addr 172.21.15.84:0/1649248344 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:30.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0ced3640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b080ac9d0 0x7f3b080c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0d6d4640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b08158c60 0x7f3b081463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 -- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b08158c60 msgr2=0x7f3b081463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b08158c60 0x7f3b081463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 -- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b080ac9d0 msgr2=0x7f3b080c3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b080ac9d0 0x7f3b080c3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 -- 172.21.15.84:0/1649248344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009560 con 0x7f3b080b0db0 2023-09-10T00:13:30.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b07fff640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b550 tx=0x7f3af800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8010870 con 0x7f3b080b0db0 2023-09-10T00:13:30.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3af8010ae0 con 0x7f3b080b0db0 2023-09-10T00:13:30.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af800f3c0 con 0x7f3b080b0db0 2023-09-10T00:13:30.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0815a430 con 0x7f3b080b0db0 2023-09-10T00:13:30.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0814e6b0 con 0x7f3b080b0db0 2023-09-10T00:13:30.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0815abf0 con 0x7f3b080b0db0 2023-09-10T00:13:30.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3af800f520 con 0x7f3b080b0db0 2023-09-10T00:13:30.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 0x7f3af4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.405 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3af8083950 con 0x7f3b080b0db0 2023-09-10T00:13:30.406 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0ced3640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 0x7f3af4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.407 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.389+0000 7f3b0ced3640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 0x7f3af4067fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc01b090 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.408 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.393+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3af8050ee0 con 0x7f3b080b0db0 2023-09-10T00:13:30.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b0806e0d0 con 0x7f3b080b0db0 2023-09-10T00:13:30.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b057fa640 1 -- 172.21.15.84:0/1649248344 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3af80140a0 con 0x7f3b080b0db0 2023-09-10T00:13:30.544 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 msgr2=0x7f3af4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 0x7f3af4067fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc01b090 comp rx=0 tx=0).stop 2023-09-10T00:13:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 msgr2=0x7f3b0814e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.546 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3af800b550 tx=0x7f3af800ba10 comp rx=0 tx=0).stop 2023-09-10T00:13:30.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 shutdown_connections 2023-09-10T00:13:30.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3af4065b20 0x7f3af4067fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3b08158c60 0x7f3b081463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3b080b0db0 0x7f3b0814e170 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 --2- 172.21.15.84:0/1649248344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b080ac9d0 0x7f3b080c3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 >> 172.21.15.84:0/1649248344 conn(0x7f3b080af230 msgr2=0x7f3b0814d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 shutdown_connections 2023-09-10T00:13:30.548 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.541+0000 7f3b0f137640 1 -- 172.21.15.84:0/1649248344 wait complete. 2023-09-10T00:13:30.561 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:30.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- 172.21.15.84:0/4249446807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc61c004d10 msgr2=0x7fc61c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/4249446807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc61c004d10 0x7fc61c005190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc62c001da0 tx=0x7fc62c01cb20 comp rx=0 tx=0).stop 2023-09-10T00:13:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63921b640 1 -- 172.21.15.84:0/4249446807 reap_dead start 2023-09-10T00:13:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- 172.21.15.84:0/4249446807 shutdown_connections 2023-09-10T00:13:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- 172.21.15.84:0/4249446807 >> 172.21.15.84:0/4249446807 conn(0x7fc6340af230 msgr2=0x7fc6340af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- 172.21.15.84:0/4249446807 shutdown_connections 2023-09-10T00:13:30.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- 172.21.15.84:0/4249446807 wait complete. 2023-09-10T00:13:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 Processor -- start 2023-09-10T00:13:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.681+0000 7fc63ac7e640 1 -- start start 2023-09-10T00:13:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6340ac9c0 0x7fc634069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 0x7fc63406a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a7a40 con 0x7fc63415a400 2023-09-10T00:13:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6340a5560 con 0x7fc63415a7e0 2023-09-10T00:13:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc634155a60 con 0x7fc6340ac9c0 2023-09-10T00:13:30.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37884/0 (socket says 172.21.15.84:37884) 2023-09-10T00:13:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 -- 172.21.15.84:0/3622002427 learned_addr learned my addr 172.21.15.84:0/3622002427 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63921b640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 0x7fc63406a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc633fff640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6340ac9c0 0x7fc634069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 -- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6340ac9c0 msgr2=0x7fc634069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6340ac9c0 0x7fc634069e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 -- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 msgr2=0x7fc63406a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 0x7fc63406a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 -- 172.21.15.84:0/3622002427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6340a5e90 con 0x7fc63415a400 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63921b640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 0x7fc63406a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:30.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc638a1a640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e990 tx=0x7fc62800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800cbe0 con 0x7fc63415a400 2023-09-10T00:13:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc62800ce30 con 0x7fc63415a400 2023-09-10T00:13:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6340a6170 con 0x7fc63415a400 2023-09-10T00:13:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc628005280 con 0x7fc63415a400 2023-09-10T00:13:30.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6340a6450 con 0x7fc63415a400 2023-09-10T00:13:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63406e0d0 con 0x7fc63415a400 2023-09-10T00:13:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc6280053e0 con 0x7fc63415a400 2023-09-10T00:13:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 0x7fc620067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc628084030 con 0x7fc63415a400 2023-09-10T00:13:30.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc633fff640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 0x7fc620067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.685+0000 7fc633fff640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 0x7fc620067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc634071640 tx=0x7fc624000ee0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.689+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc628051650 con 0x7fc63415a400 2023-09-10T00:13:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.829+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc634073400 con 0x7fc63415a400 2023-09-10T00:13:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc6317fa640 1 -- 172.21.15.84:0/3622002427 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc62801f020 con 0x7fc63415a400 2023-09-10T00:13:30.836 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 msgr2=0x7fc620067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 0x7fc620067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc634071640 tx=0x7fc624000ee0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 msgr2=0x7fc634155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e990 tx=0x7fc62800ee50 comp rx=0 tx=0).stop 2023-09-10T00:13:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 shutdown_connections 2023-09-10T00:13:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc620065b20 0x7fc620067fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc63415a7e0 0x7fc63406a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6340ac9c0 0x7fc634069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 --2- 172.21.15.84:0/3622002427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc63415a400 0x7fc634155520 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 >> 172.21.15.84:0/3622002427 conn(0x7fc6340af230 msgr2=0x7fc6340cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 shutdown_connections 2023-09-10T00:13:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.833+0000 7fc63ac7e640 1 -- 172.21.15.84:0/3622002427 wait complete. 2023-09-10T00:13:30.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2016529766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8148157f00 msgr2=0x7f814806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- 172.21.15.84:0/2016529766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8148157f00 0x7f814806c5a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8148159030 tx=0x7f813001c7e0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2016529766 shutdown_connections 2023-09-10T00:13:30.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- 172.21.15.84:0/2016529766 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f814806cae0 0x7f81480ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- 172.21.15.84:0/2016529766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8148157f00 0x7f814806c5a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- 172.21.15.84:0/2016529766 >> v2:172.21.15.100:3300/0 conn(0x7f814814eb10 0x7f814815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2016529766 >> 172.21.15.84:0/2016529766 conn(0x7f81480aec00 msgr2=0x7f81480cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2016529766 shutdown_connections 2023-09-10T00:13:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2016529766 wait complete. 2023-09-10T00:13:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 Processor -- start 2023-09-10T00:13:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- start start 2023-09-10T00:13:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f814806cae0 0x7f8148140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 0x7f81481599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148159590 con 0x7f814814eb10 2023-09-10T00:13:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8148149d60 con 0x7f814806cae0 2023-09-10T00:13:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148148290 con 0x7f8148157f00 2023-09-10T00:13:30.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37898/0 (socket says 172.21.15.84:37898) 2023-09-10T00:13:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 -- 172.21.15.84:0/2764861565 learned_addr learned my addr 172.21.15.84:0/2764861565 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f8147fff640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f814806cae0 0x7f8148140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814cf2f640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 0x7f81481599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 -- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 msgr2=0x7f81481599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 0x7f81481599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 -- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f814806cae0 msgr2=0x7f8148140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f814806cae0 0x7f8148140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 -- 172.21.15.84:0/2764861565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009560 con 0x7f814814eb10 2023-09-10T00:13:30.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814cf2f640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 0x7f81481599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f81477fe640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81300b0040 tx=0x7f81300a5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300042c0 con 0x7f814814eb10 2023-09-10T00:13:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8130004420 con 0x7f814814eb10 2023-09-10T00:13:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8148147cd0 con 0x7f814814eb10 2023-09-10T00:13:30.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130003860 con 0x7f814814eb10 2023-09-10T00:13:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.973+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81481591b0 con 0x7f814814eb10 2023-09-10T00:13:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81481596d0 con 0x7f814814eb10 2023-09-10T00:13:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f81300b4070 con 0x7f814814eb10 2023-09-10T00:13:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f8144ff9640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 0x7f8128067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:30.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f8147fff640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 0x7f8128067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f813011d820 con 0x7f814814eb10 2023-09-10T00:13:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.977+0000 7f8147fff640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 0x7f8128067fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8138005fd0 tx=0x7f8138005db0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:30.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:30.981+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f81481596d0 con 0x7f814814eb10 2023-09-10T00:13:31.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81481596d0 con 0x7f814814eb10 2023-09-10T00:13:31.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f8144ff9640 1 -- 172.21.15.84:0/2764861565 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81481596d0 con 0x7f814814eb10 2023-09-10T00:13:31.126 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:31.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 msgr2=0x7f8128067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 0x7f8128067fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8138005fd0 tx=0x7f8138005db0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 msgr2=0x7f8148149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81300b0040 tx=0x7f81300a5730 comp rx=0 tx=0).stop 2023-09-10T00:13:31.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 shutdown_connections 2023-09-10T00:13:31.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8128065b20 0x7f8128067fe0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8148157f00 0x7f81481599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f814814eb10 0x7f8148149820 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 --2- 172.21.15.84:0/2764861565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f814806cae0 0x7f8148140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.121+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 >> 172.21.15.84:0/2764861565 conn(0x7f81480aec00 msgr2=0x7f814806a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.125+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 shutdown_connections 2023-09-10T00:13:31.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.125+0000 7f814e992640 1 -- 172.21.15.84:0/2764861565 wait complete. 2023-09-10T00:13:31.143 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/1549707539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c158230 msgr2=0x7f0f8c0695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/1549707539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c158230 0x7f0f8c0695b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c155150 tx=0x7f0f7c01c7b0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/1549707539 shutdown_connections 2023-09-10T00:13:31.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/1549707539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c158230 0x7f0f8c0695b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/1549707539 >> v2:172.21.15.100:3300/0 conn(0x7f0f8c06c280 0x7f0f8c06c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/1549707539 >> 172.21.15.84:0/1549707539 conn(0x7f0f8c0aec00 msgr2=0x7f0f8c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/1549707539 shutdown_connections 2023-09-10T00:13:31.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/1549707539 wait complete. 2023-09-10T00:13:31.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 Processor -- start 2023-09-10T00:13:31.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- start start 2023-09-10T00:13:31.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f8c06fa60 0x7f0f8c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f8c158230 0x7f0f8c14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0ab1d0 con 0x7f0f8c06c280 2023-09-10T00:13:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0af910 con 0x7f0f8c06fa60 2023-09-10T00:13:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c0afbf0 con 0x7f0f8c158230 2023-09-10T00:13:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37914/0 (socket says 172.21.15.84:37914) 2023-09-10T00:13:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 -- 172.21.15.84:0/47607822 learned_addr learned my addr 172.21.15.84:0/47607822 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 -- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f8c158230 msgr2=0x7f0f8c14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f8c158230 0x7f0f8c14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 -- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f8c06fa60 msgr2=0x7f0f8c154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f8c06fa60 0x7f0f8c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 -- 172.21.15.84:0/47607822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0094a0 con 0x7f0f8c06c280 2023-09-10T00:13:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f90c83640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c4d0 tx=0x7f0f8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88005480 con 0x7f0f8c06c280 2023-09-10T00:13:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f880036f0 con 0x7f0f8c06c280 2023-09-10T00:13:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8c145a20 con 0x7f0f8c06c280 2023-09-10T00:13:31.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88003b00 con 0x7f0f8c06c280 2023-09-10T00:13:31.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.261+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8c1555a0 con 0x7f0f8c06c280 2023-09-10T00:13:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8c0af770 con 0x7f0f8c06c280 2023-09-10T00:13:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0f88003c60 con 0x7f0f8c06c280 2023-09-10T00:13:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f817fa640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 0x7f0f78067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f88083130 con 0x7f0f8c06c280 2023-09-10T00:13:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f83fff640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 0x7f0f78067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.265+0000 7f0f83fff640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 0x7f0f78067fe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0af000 tx=0x7f0f7c019550 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.269+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0f88050860 con 0x7f0f8c06c280 2023-09-10T00:13:31.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.421+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f8c0af770 con 0x7f0f8c06c280 2023-09-10T00:13:31.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.421+0000 7f0f817fa640 1 -- 172.21.15.84:0/47607822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0f8c0af770 con 0x7f0f8c06c280 2023-09-10T00:13:31.427 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:31.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 msgr2=0x7f0f78067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 0x7f0f78067fe0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0af000 tx=0x7f0f7c019550 comp rx=0 tx=0).stop 2023-09-10T00:13:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 msgr2=0x7f0f8c145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c4d0 tx=0x7f0f8800c990 comp rx=0 tx=0).stop 2023-09-10T00:13:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 shutdown_connections 2023-09-10T00:13:31.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0f78065b20 0x7f0f78067fe0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0f8c158230 0x7f0f8c14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f8c06fa60 0x7f0f8c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 --2- 172.21.15.84:0/47607822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0f8c06c280 0x7f0f8c145e00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 >> 172.21.15.84:0/47607822 conn(0x7f0f8c0aec00 msgr2=0x7f0f8c14eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 shutdown_connections 2023-09-10T00:13:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.425+0000 7f0f92ee7640 1 -- 172.21.15.84:0/47607822 wait complete. 2023-09-10T00:13:31.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:31.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/991853686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0158260 msgr2=0x7f4bc006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/991853686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0158260 0x7f4bc006a210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000aa10 tx=0x7f4bb001dbe0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/991853686 shutdown_connections 2023-09-10T00:13:31.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/991853686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0158260 0x7f4bc006a210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/991853686 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 0x7f4bc01542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/991853686 >> 172.21.15.84:0/991853686 conn(0x7f4bc00cca70 msgr2=0x7f4bc00cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/991853686 shutdown_connections 2023-09-10T00:13:31.570 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/991853686 wait complete. 2023-09-10T00:13:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 Processor -- start 2023-09-10T00:13:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- start start 2023-09-10T00:13:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 0x7f4bc00cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 0x7f4bc00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00ca600 con 0x7f4bc0158260 2023-09-10T00:13:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00caa20 con 0x7f4bc0070360 2023-09-10T00:13:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00c9980 con 0x7f4bc00c76d0 2023-09-10T00:13:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37930/0 (socket says 172.21.15.84:37930) 2023-09-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 -- 172.21.15.84:0/434510475 learned_addr learned my addr 172.21.15.84:0/434510475 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc550d640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 0x7f4bc00c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc5d0e640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 0x7f4bc00cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 -- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 msgr2=0x7f4bc00c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 0x7f4bc00c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 -- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 msgr2=0x7f4bc00cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 0x7f4bc00cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 -- 172.21.15.84:0/434510475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb000a670 con 0x7f4bc0158260 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc5d0e640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 0x7f4bc00cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc650f640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800eb20 tx=0x7f4bb800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8004b30 con 0x7f4bc0158260 2023-09-10T00:13:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4bb8004cb0 con 0x7f4bc0158260 2023-09-10T00:13:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc00c9c60 con 0x7f4bc0158260 2023-09-10T00:13:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8005280 con 0x7f4bc0158260 2023-09-10T00:13:31.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.565+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc00ca220 con 0x7f4bc0158260 2023-09-10T00:13:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc00ca740 con 0x7f4bc0158260 2023-09-10T00:13:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4bb80053e0 con 0x7f4bc0158260 2023-09-10T00:13:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bb67fc640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 0x7f4ba4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4bb8014070 con 0x7f4bc0158260 2023-09-10T00:13:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bc5d0e640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 0x7f4ba4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.569+0000 7f4bc5d0e640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 0x7f4ba4067fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0016f0 tx=0x7f4bbc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.573+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4bc00ca740 con 0x7f4bc0158260 2023-09-10T00:13:31.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.729+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bc00ca740 con 0x7f4bc0158260 2023-09-10T00:13:31.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bb67fc640 1 -- 172.21.15.84:0/434510475 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f4bc00ca740 con 0x7f4bc0158260 2023-09-10T00:13:31.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:31.736 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 msgr2=0x7f4ba4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 0x7f4ba4067fe0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0016f0 tx=0x7f4bbc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:31.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 msgr2=0x7f4bc01f7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4bb800eb20 tx=0x7f4bb800c2d0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 shutdown_connections 2023-09-10T00:13:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ba4065b20 0x7f4ba4067fe0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4bc0158260 0x7f4bc01f7e90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4bc00c76d0 0x7f4bc00c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 --2- 172.21.15.84:0/434510475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bc0070360 0x7f4bc00cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 >> 172.21.15.84:0/434510475 conn(0x7f4bc00cca70 msgr2=0x7f4bc0156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 shutdown_connections 2023-09-10T00:13:31.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.733+0000 7f4bc7f72640 1 -- 172.21.15.84:0/434510475 wait complete. 2023-09-10T00:13:31.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:31.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:31.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/1552200582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 msgr2=0x7fe5b8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/1552200582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5b8003d80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0005fd0 tx=0x7fe5c001cd10 comp rx=0 tx=0).stop 2023-09-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/1552200582 shutdown_connections 2023-09-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/1552200582 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5b8003d80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.881 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/1552200582 >> 172.21.15.84:0/1552200582 conn(0x7fe5d00af230 msgr2=0x7fe5d00af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/1552200582 shutdown_connections 2023-09-10T00:13:31.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/1552200582 wait complete. 2023-09-10T00:13:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 Processor -- start 2023-09-10T00:13:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- start start 2023-09-10T00:13:31.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 0x7fe5d00c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 0x7fe5d00a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00c6a60 con 0x7fe5b8003980 2023-09-10T00:13:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0158b80 con 0x7fe5d00c60a0 2023-09-10T00:13:31.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00ab180 con 0x7fe5d00a98b0 2023-09-10T00:13:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37950/0 (socket says 172.21.15.84:37950) 2023-09-10T00:13:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 -- 172.21.15.84:0/777856061 learned_addr learned my addr 172.21.15.84:0/777856061 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5ceffd640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 0x7fe5d00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cffff640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 0x7fe5d00a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 -- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 msgr2=0x7fe5d00a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 0x7fe5d00a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 -- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 msgr2=0x7fe5d00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 0x7fe5d00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:31.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 -- 172.21.15.84:0/777856061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d014d200 con 0x7fe5b8003980 2023-09-10T00:13:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cffff640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 0x7fe5d00a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5ceffd640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 0x7fe5d00c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5cf7fe640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000ba60 tx=0x7fe5c0004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00be070 con 0x7fe5b8003980 2023-09-10T00:13:31.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5c0004510 con 0x7fe5b8003980 2023-09-10T00:13:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d00aa600 con 0x7fe5b8003980 2023-09-10T00:13:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0005280 con 0x7fe5b8003980 2023-09-10T00:13:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.877+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00aabc0 con 0x7fe5b8003980 2023-09-10T00:13:31.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d0073400 con 0x7fe5b8003980 2023-09-10T00:13:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5c00053e0 con 0x7fe5b8003980 2023-09-10T00:13:31.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5b7fff640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 0x7fe5bc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe5c011d880 con 0x7fe5b8003980 2023-09-10T00:13:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5ceffd640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 0x7fe5bc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.881+0000 7fe5ceffd640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 0x7fe5bc068010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00aea80 tx=0x7fe5c4006b00 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:31.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:31.885+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5c00eae10 con 0x7fe5b8003980 2023-09-10T00:13:32.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.037+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5d00b0140 con 0x7fe5b8003980 2023-09-10T00:13:32.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5b7fff640 1 -- 172.21.15.84:0/777856061 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5c00ab0a0 con 0x7fe5b8003980 2023-09-10T00:13:32.044 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:32.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 msgr2=0x7fe5bc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 0x7fe5bc068010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00aea80 tx=0x7fe5c4006b00 comp rx=0 tx=0).stop 2023-09-10T00:13:32.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 msgr2=0x7fe5d014ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000ba60 tx=0x7fe5c0004170 comp rx=0 tx=0).stop 2023-09-10T00:13:32.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 shutdown_connections 2023-09-10T00:13:32.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe5bc065b50 0x7fe5bc068010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5d00a98b0 0x7fe5d00a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d00c60a0 0x7fe5d00c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 --2- 172.21.15.84:0/777856061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5b8003980 0x7fe5d014ccc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 >> 172.21.15.84:0/777856061 conn(0x7fe5d00af230 msgr2=0x7fe5d0156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 shutdown_connections 2023-09-10T00:13:32.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.041+0000 7fe5d5e35640 1 -- 172.21.15.84:0/777856061 wait complete. 2023-09-10T00:13:32.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:32.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1332271164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 msgr2=0x7ff59c0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1332271164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c0cea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06c060 tx=0x7ff58c01cd60 comp rx=0 tx=0).stop 2023-09-10T00:13:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1332271164 shutdown_connections 2023-09-10T00:13:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1332271164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c0cea50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1332271164 >> v2:172.21.15.100:3300/0 conn(0x7ff59c15e1b0 0x7ff59c06b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1332271164 >> 172.21.15.84:0/1332271164 conn(0x7ff59c0d0c20 msgr2=0x7ff59c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1332271164 shutdown_connections 2023-09-10T00:13:32.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1332271164 wait complete. 2023-09-10T00:13:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 Processor -- start 2023-09-10T00:13:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- start start 2023-09-10T00:13:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff59c06b840 0x7ff59c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.188 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 0x7ff59c1f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1f4960 con 0x7ff59c0cbb80 2023-09-10T00:13:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c155e20 con 0x7ff59c15e1b0 2023-09-10T00:13:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c159a10 con 0x7ff59c06b840 2023-09-10T00:13:32.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37968/0 (socket says 172.21.15.84:37968) 2023-09-10T00:13:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 -- 172.21.15.84:0/1996887761 learned_addr learned my addr 172.21.15.84:0/1996887761 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a160c640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 0x7ff59c1f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a0e0b640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff59c06b840 0x7ff59c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 -- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff59c06b840 msgr2=0x7ff59c152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff59c06b840 0x7ff59c152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 -- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 msgr2=0x7ff59c1f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 0x7ff59c1f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 -- 172.21.15.84:0/1996887761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c0098e0 con 0x7ff59c0cbb80 2023-09-10T00:13:32.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a160c640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 0x7ff59c1f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff59bfff640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c4d0 tx=0x7ff59000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590005480 con 0x7ff59c0cbb80 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff5900036f0 con 0x7ff59c0cbb80 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590003b00 con 0x7ff59c0cbb80 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c155860 con 0x7ff59c0cbb80 2023-09-10T00:13:32.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.181+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c1596a0 con 0x7ff59c0cbb80 2023-09-10T00:13:32.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c159b80 con 0x7ff59c0cbb80 2023-09-10T00:13:32.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff590003c60 con 0x7ff59c0cbb80 2023-09-10T00:13:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5997fa640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 0x7ff588067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff590082e60 con 0x7ff59c0cbb80 2023-09-10T00:13:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5a0e0b640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 0x7ff588067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.185+0000 7ff5a0e0b640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 0x7ff588067fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff59400b9a0 tx=0x7ff594005c30 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.189+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff590050540 con 0x7ff59c0cbb80 2023-09-10T00:13:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff59c0cfb80 con 0x7ff59c0cbb80 2023-09-10T00:13:32.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5997fa640 1 -- 172.21.15.84:0/1996887761 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5900170a0 con 0x7ff59c0cbb80 2023-09-10T00:13:32.345 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:32.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 msgr2=0x7ff588067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 0x7ff588067fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff59400b9a0 tx=0x7ff594005c30 comp rx=0 tx=0).stop 2023-09-10T00:13:32.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 msgr2=0x7ff59c1f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.341+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c4d0 tx=0x7ff59000c990 comp rx=0 tx=0).stop 2023-09-10T00:13:32.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 shutdown_connections 2023-09-10T00:13:32.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff588065b20 0x7ff588067fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff59c15e1b0 0x7ff59c1f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff59c0cbb80 0x7ff59c1f3ee0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 --2- 172.21.15.84:0/1996887761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff59c06b840 0x7ff59c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 >> 172.21.15.84:0/1996887761 conn(0x7ff59c0d0c20 msgr2=0x7ff59c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 shutdown_connections 2023-09-10T00:13:32.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.345+0000 7ff5a306f640 1 -- 172.21.15.84:0/1996887761 wait complete. 2023-09-10T00:13:32.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:32.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1595494502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 msgr2=0x7ff5e00cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1595494502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e00cefd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009900 tx=0x7ff5d001f070 comp rx=0 tx=0).stop 2023-09-10T00:13:32.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1595494502 shutdown_connections 2023-09-10T00:13:32.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1595494502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e00cefd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1595494502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b3c20 0x7ff5e00b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1595494502 >> 172.21.15.84:0/1595494502 conn(0x7ff5e00cd570 msgr2=0x7ff5e00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1595494502 shutdown_connections 2023-09-10T00:13:32.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1595494502 wait complete. 2023-09-10T00:13:32.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 Processor -- start 2023-09-10T00:13:32.492 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- start start 2023-09-10T00:13:32.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b2570 0x7ff5e0153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00b3c20 0x7ff5e0156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0158de0 con 0x7ff5e00ceb70 2023-09-10T00:13:32.493 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0153e70 con 0x7ff5e00b3c20 2023-09-10T00:13:32.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01e16c0 con 0x7ff5e00b2570 2023-09-10T00:13:32.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37980/0 (socket says 172.21.15.84:37980) 2023-09-10T00:13:32.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 -- 172.21.15.84:0/1525748818 learned_addr learned my addr 172.21.15.84:0/1525748818 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:32.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e52fd640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00b3c20 0x7ff5e0156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e5afe640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b2570 0x7ff5e0153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 -- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b2570 msgr2=0x7ff5e0153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b2570 0x7ff5e0153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 -- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00b3c20 msgr2=0x7ff5e0156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.495 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00b3c20 0x7ff5e0156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 -- 172.21.15.84:0/1525748818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009560 con 0x7ff5e00ceb70 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e62ff640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b9a0 tx=0x7ff5d800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800cba0 con 0x7ff5e00ceb70 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff5d800ce10 con 0x7ff5e00ceb70 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0157430 con 0x7ff5e00ceb70 2023-09-10T00:13:32.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80146a0 con 0x7ff5e00ceb70 2023-09-10T00:13:32.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.485+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e01e1c20 con 0x7ff5e00ceb70 2023-09-10T00:13:32.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e006c610 con 0x7ff5e00ceb70 2023-09-10T00:13:32.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff5d801d3b0 con 0x7ff5e00ceb70 2023-09-10T00:13:32.497 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5d67fc640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 0x7ff5c4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff5d8083890 con 0x7ff5e00ceb70 2023-09-10T00:13:32.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5e5afe640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 0x7ff5c4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.489+0000 7ff5e5afe640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 0x7ff5c4067fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00cc2b0 tx=0x7ff5dc008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.493+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff5d8050e20 con 0x7ff5e00ceb70 2023-09-10T00:13:32.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.637+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5e00b5f10 con 0x7ff5e00ceb70 2023-09-10T00:13:32.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5d67fc640 1 -- 172.21.15.84:0/1525748818 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5d80190a0 con 0x7ff5e00ceb70 2023-09-10T00:13:32.644 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:32.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 msgr2=0x7ff5c4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 0x7ff5c4067fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00cc2b0 tx=0x7ff5dc008040 comp rx=0 tx=0).stop 2023-09-10T00:13:32.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 msgr2=0x7ff5e0156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800b9a0 tx=0x7ff5d800be60 comp rx=0 tx=0).stop 2023-09-10T00:13:32.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 shutdown_connections 2023-09-10T00:13:32.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff5c4065b20 0x7ff5c4067fe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5e00ceb70 0x7ff5e0156db0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5e00b3c20 0x7ff5e0156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 --2- 172.21.15.84:0/1525748818 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5e00b2570 0x7ff5e0153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 >> 172.21.15.84:0/1525748818 conn(0x7ff5e00cd570 msgr2=0x7ff5e01502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 shutdown_connections 2023-09-10T00:13:32.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.641+0000 7ff5e7d62640 1 -- 172.21.15.84:0/1525748818 wait complete. 2023-09-10T00:13:32.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/3180107941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17b80039b0 msgr2=0x7f17b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 --2- 172.21.15.84:0/3180107941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17b80039b0 0x7f17b8003dd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001da0 tx=0x7f17c401cb20 comp rx=0 tx=0).stop 2023-09-10T00:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 -- 172.21.15.84:0/3180107941 reap_dead start 2023-09-10T00:13:32.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/3180107941 shutdown_connections 2023-09-10T00:13:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/3180107941 >> 172.21.15.84:0/3180107941 conn(0x7f17cc0aec00 msgr2=0x7f17cc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/3180107941 shutdown_connections 2023-09-10T00:13:32.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/3180107941 wait complete. 2023-09-10T00:13:32.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 Processor -- start 2023-09-10T00:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- start start 2023-09-10T00:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b80039b0 0x7f17cc1f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17cc160620 0x7f17cc15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc15f400 con 0x7f17cc15ea30 2023-09-10T00:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc0a65f0 con 0x7f17b80039b0 2023-09-10T00:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1f5e80 con 0x7f17cc160620 2023-09-10T00:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37996/0 (socket says 172.21.15.84:37996) 2023-09-10T00:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 -- 172.21.15.84:0/4000929696 learned_addr learned my addr 172.21.15.84:0/4000929696 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17cbfff640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b80039b0 0x7f17cc1f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17cb7fe640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17cc160620 0x7f17cc15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 -- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17cc160620 msgr2=0x7f17cc15f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17cc160620 0x7f17cc15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 -- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b80039b0 msgr2=0x7f17cc1f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b80039b0 0x7f17cc1f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 -- 172.21.15.84:0/4000929696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc160ab0 con 0x7f17cc15ea30 2023-09-10T00:13:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d0eef640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17cc06b010 tx=0x7f17bc00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005220 con 0x7f17cc15ea30 2023-09-10T00:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f17bc005490 con 0x7f17cc15ea30 2023-09-10T00:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc160d90 con 0x7f17cc15ea30 2023-09-10T00:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc004a10 con 0x7f17cc15ea30 2023-09-10T00:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc161350 con 0x7f17cc15ea30 2023-09-10T00:13:32.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.785+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17cc1f2bd0 con 0x7f17cc15ea30 2023-09-10T00:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.789+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f17bc004b70 con 0x7f17cc15ea30 2023-09-10T00:13:32.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.789+0000 7f17c8ff9640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 0x7f17ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.789+0000 7f17cbfff640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 0x7f17ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.789+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17bc083dd0 con 0x7f17cc15ea30 2023-09-10T00:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.789+0000 7f17cbfff640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 0x7f17ac067fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a9000 tx=0x7f17c40198c0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:32.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.793+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f17cc1f2bd0 con 0x7f17cc15ea30 2023-09-10T00:13:32.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.933+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17cc1f2bd0 con 0x7f17cc15ea30 2023-09-10T00:13:32.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17c8ff9640 1 -- 172.21.15.84:0/4000929696 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17bc085020 con 0x7f17cc15ea30 2023-09-10T00:13:32.940 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:32.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 msgr2=0x7f17ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 0x7f17ac067fe0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a9000 tx=0x7f17c40198c0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 msgr2=0x7f17cc15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:32.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17cc06b010 tx=0x7f17bc00fa20 comp rx=0 tx=0).stop 2023-09-10T00:13:32.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 shutdown_connections 2023-09-10T00:13:32.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f17ac065b20 0x7f17ac067fe0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f17cc15ea30 0x7f17cc15eec0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f17cc160620 0x7f17cc15f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 --2- 172.21.15.84:0/4000929696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b80039b0 0x7f17cc1f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:32.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 >> 172.21.15.84:0/4000929696 conn(0x7f17cc0aec00 msgr2=0x7f17cc1498f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:32.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 shutdown_connections 2023-09-10T00:13:32.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:32.937+0000 7f17d2952640 1 -- 172.21.15.84:0/4000929696 wait complete. 2023-09-10T00:13:32.957 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/725161895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18006fad0 msgr2=0x7ff18006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 --2- 172.21.15.84:0/725161895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18006fad0 0x7ff18006ff60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009840 tx=0x7ff17c01c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/725161895 shutdown_connections 2023-09-10T00:13:33.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 --2- 172.21.15.84:0/725161895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff18006fad0 0x7ff18006ff60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/725161895 >> 172.21.15.84:0/725161895 conn(0x7ff1800cca70 msgr2=0x7ff1800cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/725161895 shutdown_connections 2023-09-10T00:13:33.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/725161895 wait complete. 2023-09-10T00:13:33.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 Processor -- start 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- start start 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff18006fad0 0x7ff180159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 0x7ff1801f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff180159ec0 con 0x7ff1800affe0 2023-09-10T00:13:33.084 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff180153ba0 con 0x7ff180158a90 2023-09-10T00:13:33.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff180152f90 con 0x7ff18006fad0 2023-09-10T00:13:33.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38026/0 (socket says 172.21.15.84:38026) 2023-09-10T00:13:33.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 -- 172.21.15.84:0/1629902799 learned_addr learned my addr 172.21.15.84:0/1629902799 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:33.085 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18638d640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 0x7ff1801f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff185b8c640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff18006fad0 0x7ff180159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 -- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff18006fad0 msgr2=0x7ff180159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff18006fad0 0x7ff180159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 -- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 msgr2=0x7ff1801f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.086 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 0x7ff1801f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 -- 172.21.15.84:0/1629902799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0094a0 con 0x7ff1800affe0 2023-09-10T00:13:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18638d640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 0x7ff1801f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff18538b640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff17800cc50 tx=0x7ff17800cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17800a9f0 con 0x7ff1800affe0 2023-09-10T00:13:33.087 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff17800ac40 con 0x7ff1800affe0 2023-09-10T00:13:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff180153270 con 0x7ff1800affe0 2023-09-10T00:13:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178012680 con 0x7ff1800affe0 2023-09-10T00:13:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.077+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff180153830 con 0x7ff1800affe0 2023-09-10T00:13:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1800712c0 con 0x7ff1800affe0 2023-09-10T00:13:33.088 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff17801a3b0 con 0x7ff1800affe0 2023-09-10T00:13:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff1767fc640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 0x7ff164068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.089 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff178083b60 con 0x7ff1800affe0 2023-09-10T00:13:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff185b8c640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 0x7ff164068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.081+0000 7ff185b8c640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 0x7ff164068010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff170000f70 tx=0x7ff170009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.090 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.085+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff1780510e0 con 0x7ff1800affe0 2023-09-10T00:13:33.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.229+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1801539f0 con 0x7ff1800affe0 2023-09-10T00:13:33.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.229+0000 7ff1767fc640 1 -- 172.21.15.84:0/1629902799 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7ff178016090 con 0x7ff1800affe0 2023-09-10T00:13:33.235 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:33.235 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 msgr2=0x7ff164068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 0x7ff164068010 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff170000f70 tx=0x7ff170009040 comp rx=0 tx=0).stop 2023-09-10T00:13:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 msgr2=0x7ff18014abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff17800cc50 tx=0x7ff17800cd40 comp rx=0 tx=0).stop 2023-09-10T00:13:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 shutdown_connections 2023-09-10T00:13:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff164065b50 0x7ff164068010 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff180158a90 0x7ff1801f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1800affe0 0x7ff18014abe0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 --2- 172.21.15.84:0/1629902799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff18006fad0 0x7ff180159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 >> 172.21.15.84:0/1629902799 conn(0x7ff1800cca70 msgr2=0x7ff180153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 shutdown_connections 2023-09-10T00:13:33.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.233+0000 7ff187df0640 1 -- 172.21.15.84:0/1629902799 wait complete. 2023-09-10T00:13:33.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:33.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:33.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/633125664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 msgr2=0x7f34dc06c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- 172.21.15.84:0/633125664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc06c710 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0707e0 tx=0x7f34d401de60 comp rx=0 tx=0).stop 2023-09-10T00:13:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/633125664 shutdown_connections 2023-09-10T00:13:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- 172.21.15.84:0/633125664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc06c710 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- 172.21.15.84:0/633125664 >> v2:172.21.15.100:3300/0 conn(0x7f34dc06fa60 0x7f34dc06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/633125664 >> 172.21.15.84:0/633125664 conn(0x7f34dc0aec00 msgr2=0x7f34dc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/633125664 shutdown_connections 2023-09-10T00:13:33.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/633125664 wait complete. 2023-09-10T00:13:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 Processor -- start 2023-09-10T00:13:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- start start 2023-09-10T00:13:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc06fa60 0x7f34dc1f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 0x7f34dc1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc1f40f0 con 0x7f34dc06c280 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0ab220 con 0x7f34dc06fa60 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc153fd0 con 0x7f34dc158230 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38042/0 (socket says 172.21.15.84:38042) 2023-09-10T00:13:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 -- 172.21.15.84:0/1628200283 learned_addr learned my addr 172.21.15.84:0/1628200283 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34db7fe640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc06fa60 0x7f34dc1f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e0ccf640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 0x7f34dc1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 -- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 msgr2=0x7f34dc1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.374 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 0x7f34dc1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 -- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc06fa60 msgr2=0x7f34dc1f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc06fa60 0x7f34dc1f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 -- 172.21.15.84:0/1628200283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d400a930 con 0x7f34dc06c280 2023-09-10T00:13:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e0ccf640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 0x7f34dc1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:33.375 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34dbfff640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c970 tx=0x7f34cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc007bb0 con 0x7f34dc06c280 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f34cc007e00 con 0x7f34dc06c280 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc1542b0 con 0x7f34dc06c280 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc005280 con 0x7f34dc06c280 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.365+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc154870 con 0x7f34dc06c280 2023-09-10T00:13:33.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc154a60 con 0x7f34dc06c280 2023-09-10T00:13:33.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f34cc0053e0 con 0x7f34dc06c280 2023-09-10T00:13:33.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34d8ff9640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 0x7f34bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34cc083c60 con 0x7f34dc06c280 2023-09-10T00:13:33.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34db7fe640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 0x7f34bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.369+0000 7f34db7fe640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 0x7f34bc067fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f34dc14d810 tx=0x7f34c4009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.373+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f34cc051280 con 0x7f34dc06c280 2023-09-10T00:13:33.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.525+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34dc0cc0a0 con 0x7f34dc06c280 2023-09-10T00:13:33.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.525+0000 7f34d8ff9640 1 -- 172.21.15.84:0/1628200283 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34cc01d070 con 0x7f34dc06c280 2023-09-10T00:13:33.531 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 msgr2=0x7f34bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 0x7f34bc067fe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f34dc14d810 tx=0x7f34c4009040 comp rx=0 tx=0).stop 2023-09-10T00:13:33.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 msgr2=0x7f34dc0aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c970 tx=0x7f34cc00ce30 comp rx=0 tx=0).stop 2023-09-10T00:13:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 shutdown_connections 2023-09-10T00:13:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f34bc065b20 0x7f34bc067fe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34dc158230 0x7f34dc1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc06fa60 0x7f34dc1f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 --2- 172.21.15.84:0/1628200283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f34dc06c280 0x7f34dc0aace0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 >> 172.21.15.84:0/1628200283 conn(0x7f34dc0aec00 msgr2=0x7f34dc150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 shutdown_connections 2023-09-10T00:13:33.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.529+0000 7f34e2732640 1 -- 172.21.15.84:0/1628200283 wait complete. 2023-09-10T00:13:33.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:33.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/3043142617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0cbd60 msgr2=0x7f885c1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- 172.21.15.84:0/3043142617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0cbd60 0x7f885c1591a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8854009bf0 tx=0x7f885401cb50 comp rx=0 tx=0).stop 2023-09-10T00:13:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/3043142617 shutdown_connections 2023-09-10T00:13:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- 172.21.15.84:0/3043142617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0cbd60 0x7f885c1591a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- 172.21.15.84:0/3043142617 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c06fa60 0x7f885c0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/3043142617 >> 172.21.15.84:0/3043142617 conn(0x7f885c0aec00 msgr2=0x7f885c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/3043142617 shutdown_connections 2023-09-10T00:13:33.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/3043142617 wait complete. 2023-09-10T00:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 Processor -- start 2023-09-10T00:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- start start 2023-09-10T00:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f885c06fa60 0x7f885c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c0cbd60 0x7f885c135e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1584d0 con 0x7f885c0af770 2023-09-10T00:13:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c9970 con 0x7f885c06fa60 2023-09-10T00:13:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c157f50 con 0x7f885c0cbd60 2023-09-10T00:13:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38064/0 (socket says 172.21.15.84:38064) 2023-09-10T00:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 -- 172.21.15.84:0/1200183561 learned_addr learned my addr 172.21.15.84:0/1200183561 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88621b3640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f885c06fa60 0x7f885c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88629b4640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c0cbd60 0x7f885c135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 -- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c0cbd60 msgr2=0x7f885c135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c0cbd60 0x7f885c135e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 -- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f885c06fa60 msgr2=0x7f885c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f885c06fa60 0x7f885c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 -- 172.21.15.84:0/1200183561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009820 con 0x7f885c0af770 2023-09-10T00:13:33.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f88619b2640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c4b0 tx=0x7f884c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c012830 con 0x7f885c0af770 2023-09-10T00:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f884c012a80 con 0x7f885c0af770 2023-09-10T00:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0c9690 con 0x7f885c0af770 2023-09-10T00:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c012e70 con 0x7f885c0af770 2023-09-10T00:13:33.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.677+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0c92f0 con 0x7f885c0af770 2023-09-10T00:13:33.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c157db0 con 0x7f885c0af770 2023-09-10T00:13:33.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f884c01a3b0 con 0x7f885c0af770 2023-09-10T00:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f8852ffd640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 0x7f8840067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f884c083830 con 0x7f885c0af770 2023-09-10T00:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f88621b3640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 0x7f8840067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.681+0000 7f88621b3640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 0x7f8840067fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88580058d0 tx=0x7f8858005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.685+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f885c157db0 con 0x7f885c0af770 2023-09-10T00:13:33.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.825+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f885c157db0 con 0x7f885c0af770 2023-09-10T00:13:33.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8852ffd640 1 -- 172.21.15.84:0/1200183561 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f885c157db0 con 0x7f885c0af770 2023-09-10T00:13:33.832 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:33.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 msgr2=0x7f8840067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 0x7f8840067fe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88580058d0 tx=0x7f8858005860 comp rx=0 tx=0).stop 2023-09-10T00:13:33.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 msgr2=0x7f885c0ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c4b0 tx=0x7f884c00c970 comp rx=0 tx=0).stop 2023-09-10T00:13:33.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 shutdown_connections 2023-09-10T00:13:33.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8840065b20 0x7f8840067fe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f885c0cbd60 0x7f885c135e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f885c0af770 0x7f885c0ad670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 --2- 172.21.15.84:0/1200183561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f885c06fa60 0x7f885c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 >> 172.21.15.84:0/1200183561 conn(0x7f885c0aec00 msgr2=0x7f885c15a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 shutdown_connections 2023-09-10T00:13:33.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.829+0000 7f8864417640 1 -- 172.21.15.84:0/1200183561 wait complete. 2023-09-10T00:13:33.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/1433233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 msgr2=0x7f67781591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- 172.21.15.84:0/1433233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f67781591a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6770009bf0 tx=0x7f677001cb50 comp rx=0 tx=0).stop 2023-09-10T00:13:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/1433233070 shutdown_connections 2023-09-10T00:13:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- 172.21.15.84:0/1433233070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f67781591a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- 172.21.15.84:0/1433233070 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f67780ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/1433233070 >> 172.21.15.84:0/1433233070 conn(0x7f67780aec00 msgr2=0x7f67780cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/1433233070 shutdown_connections 2023-09-10T00:13:33.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/1433233070 wait complete. 2023-09-10T00:13:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 Processor -- start 2023-09-10T00:13:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- start start 2023-09-10T00:13:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f6778135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67780af770 0x7f67781412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778141e50 con 0x7f67780cbd60 2023-09-10T00:13:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677813c9a0 con 0x7f67780af770 2023-09-10T00:13:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677813e0e0 con 0x7f677806fa60 2023-09-10T00:13:33.978 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38082/0 (socket says 172.21.15.84:38082) 2023-09-10T00:13:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 -- 172.21.15.84:0/2799989641 learned_addr learned my addr 172.21.15.84:0/2799989641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677d442640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67780af770 0x7f67781412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677dc43640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f6778135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 -- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 msgr2=0x7f6778135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f6778135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 -- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67780af770 msgr2=0x7f67781412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67780af770 0x7f67781412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 -- 172.21.15.84:0/2799989641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009820 con 0x7f67780cbd60 2023-09-10T00:13:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677dc43640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f6778135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677e444640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f677001c5c0 tx=0x7f67700a5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770004300 con 0x7f67780cbd60 2023-09-10T00:13:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6770004550 con 0x7f67780cbd60 2023-09-10T00:13:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700b8440 con 0x7f67780cbd60 2023-09-10T00:13:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6778141b70 con 0x7f67780cbd60 2023-09-10T00:13:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.969+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677813c630 con 0x7f67780cbd60 2023-09-10T00:13:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677813c1b0 con 0x7f67780cbd60 2023-09-10T00:13:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f67700b4040 con 0x7f67780cbd60 2023-09-10T00:13:33.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f676e7fc640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 0x7f675c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f677dc43640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 0x7f675c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f677011eaa0 con 0x7f67780cbd60 2023-09-10T00:13:33.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.973+0000 7f677dc43640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 0x7f675c068010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6774005fd0 tx=0x7f6774005d40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:33.977+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f677813c1b0 con 0x7f67780cbd60 2023-09-10T00:13:34.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.117+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f677813c1b0 con 0x7f67780cbd60 2023-09-10T00:13:34.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.117+0000 7f676e7fc640 1 -- 172.21.15.84:0/2799989641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f677813c1b0 con 0x7f67780cbd60 2023-09-10T00:13:34.123 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:34.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 msgr2=0x7f675c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 0x7f675c068010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6774005fd0 tx=0x7f6774005d40 comp rx=0 tx=0).stop 2023-09-10T00:13:34.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 msgr2=0x7f6778158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f677001c5c0 tx=0x7f67700a5aa0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 shutdown_connections 2023-09-10T00:13:34.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f675c065b50 0x7f675c068010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67780cbd60 0x7f6778158250 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.126 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67780af770 0x7f67781412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 --2- 172.21.15.84:0/2799989641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f677806fa60 0x7f6778135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 >> 172.21.15.84:0/2799989641 conn(0x7f67780aec00 msgr2=0x7f67780b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 shutdown_connections 2023-09-10T00:13:34.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.121+0000 7f677fea7640 1 -- 172.21.15.84:0/2799989641 wait complete. 2023-09-10T00:13:34.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:34.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.253+0000 7fec80118640 1 -- 172.21.15.84:0/1745846083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 msgr2=0x7fec64005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.253+0000 7fec80118640 1 --2- 172.21.15.84:0/1745846083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec64005190 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fec70009f10 tx=0x7fec7001d5f0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.253+0000 7fec7e6b5640 1 -- 172.21.15.84:0/1745846083 reap_dead start 2023-09-10T00:13:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/1745846083 shutdown_connections 2023-09-10T00:13:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/1745846083 >> 172.21.15.84:0/1745846083 conn(0x7fec780aec00 msgr2=0x7fec780cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/1745846083 shutdown_connections 2023-09-10T00:13:34.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/1745846083 wait complete. 2023-09-10T00:13:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 Processor -- start 2023-09-10T00:13:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- start start 2023-09-10T00:13:34.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fec781ed010 0x7fec781ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec78151090 0x7fec78151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec78150080 con 0x7fec64004d10 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec78151a50 con 0x7fec78151090 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec781502d0 con 0x7fec781ed010 2023-09-10T00:13:34.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38100/0 (socket says 172.21.15.84:38100) 2023-09-10T00:13:34.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 -- 172.21.15.84:0/3680941366 learned_addr learned my addr 172.21.15.84:0/3680941366 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:34.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 -- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fec781ed010 msgr2=0x7fec781ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fec781ed010 0x7fec781ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 -- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec78151090 msgr2=0x7fec78151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec78151090 0x7fec78151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 -- 172.21.15.84:0/3680941366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec781505b0 con 0x7fec64004d10 2023-09-10T00:13:34.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec7deb4640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec74011a50 tx=0x7fec74011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7400fd10 con 0x7fec64004d10 2023-09-10T00:13:34.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec74012450 con 0x7fec64004d10 2023-09-10T00:13:34.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec78150890 con 0x7fec64004d10 2023-09-10T00:13:34.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec74012800 con 0x7fec64004d10 2023-09-10T00:13:34.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec78149da0 con 0x7fec64004d10 2023-09-10T00:13:34.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.257+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec780713a0 con 0x7fec64004d10 2023-09-10T00:13:34.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.261+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fec74012960 con 0x7fec64004d10 2023-09-10T00:13:34.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.261+0000 7fec6e7fc640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 0x7fec5c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.261+0000 7fec7d6b3640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 0x7fec5c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.261+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec74084560 con 0x7fec64004d10 2023-09-10T00:13:34.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.261+0000 7fec7d6b3640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 0x7fec5c067fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec680017b0 tx=0x7fec68001c10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.265+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fec74051c30 con 0x7fec64004d10 2023-09-10T00:13:34.409 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.405+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec7806d2d0 con 0x7fec64004d10 2023-09-10T00:13:34.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec6e7fc640 1 -- 172.21.15.84:0/3680941366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec74055250 con 0x7fec64004d10 2023-09-10T00:13:34.412 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 msgr2=0x7fec5c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.414 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 0x7fec5c067fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec680017b0 tx=0x7fec68001c10 comp rx=0 tx=0).stop 2023-09-10T00:13:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 msgr2=0x7fec78149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec74011a50 tx=0x7fec74011f10 comp rx=0 tx=0).stop 2023-09-10T00:13:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 shutdown_connections 2023-09-10T00:13:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fec5c065b20 0x7fec5c067fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec78151090 0x7fec78151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fec781ed010 0x7fec781ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 --2- 172.21.15.84:0/3680941366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fec64004d10 0x7fec78149860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 >> 172.21.15.84:0/3680941366 conn(0x7fec780aec00 msgr2=0x7fec780adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 shutdown_connections 2023-09-10T00:13:34.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.409+0000 7fec80118640 1 -- 172.21.15.84:0/3680941366 wait complete. 2023-09-10T00:13:34.516 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-10T00:13:34.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:34.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- 172.21.15.84:0/1503660099 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c158210 msgr2=0x7f905c0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- 172.21.15.84:0/1503660099 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c158210 0x7f905c0c76d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f904c009900 tx=0x7f904c01c830 comp rx=0 tx=0).stop 2023-09-10T00:13:34.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- 172.21.15.84:0/1503660099 shutdown_connections 2023-09-10T00:13:34.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- 172.21.15.84:0/1503660099 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c158210 0x7f905c0c76d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- 172.21.15.84:0/1503660099 >> v2:172.21.15.100:3300/0 conn(0x7f905c0ade00 0x7f905c06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- 172.21.15.84:0/1503660099 >> 172.21.15.84:0/1503660099 conn(0x7f905c0cca70 msgr2=0x7f905c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- 172.21.15.84:0/1503660099 shutdown_connections 2023-09-10T00:13:34.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- 172.21.15.84:0/1503660099 wait complete. 2023-09-10T00:13:34.649 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 Processor -- start 2023-09-10T00:13:34.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- start start 2023-09-10T00:13:34.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 0x7f905c0c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c0ade00 0x7f905c151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.650 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c152120 con 0x7f905c158210 2023-09-10T00:13:34.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0c0ff0 con 0x7f905c070360 2023-09-10T00:13:34.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f90639ce640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0c1270 con 0x7f905c0ade00 2023-09-10T00:13:34.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.641+0000 7f9061f6b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38112/0 (socket says 172.21.15.84:38112) 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 -- 172.21.15.84:0/2239994296 learned_addr learned my addr 172.21.15.84:0/2239994296 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9060f69640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c0ade00 0x7f905c151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f906176a640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 0x7f905c0c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 -- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c0ade00 msgr2=0x7f905c151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c0ade00 0x7f905c151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 -- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 msgr2=0x7f905c0c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 0x7f905c0c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 -- 172.21.15.84:0/2239994296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c009560 con 0x7f905c158210 2023-09-10T00:13:34.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f906176a640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 0x7f905c0c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:34.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9061f6b640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f905400c710 tx=0x7f905400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054006d60 con 0x7f905c158210 2023-09-10T00:13:34.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f905400ce20 con 0x7f905c158210 2023-09-10T00:13:34.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c070d00 con 0x7f905c158210 2023-09-10T00:13:34.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054003be0 con 0x7f905c158210 2023-09-10T00:13:34.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c151100 con 0x7f905c158210 2023-09-10T00:13:34.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c0712c0 con 0x7f905c158210 2023-09-10T00:13:34.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9054003d40 con 0x7f905c158210 2023-09-10T00:13:34.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 0x7f9040067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9054083480 con 0x7f905c158210 2023-09-10T00:13:34.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f906176a640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 0x7f9040067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.645+0000 7f906176a640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 0x7f9040067fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9058009b60 tx=0x7f90580091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.649+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9054050aa0 con 0x7f905c158210 2023-09-10T00:13:34.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.801+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f905c073400 con 0x7f905c158210 2023-09-10T00:13:34.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f9051ffb640 1 -- 172.21.15.84:0/2239994296 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f90540540c0 con 0x7f905c158210 2023-09-10T00:13:34.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:34.810 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:34.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 msgr2=0x7f9040067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 0x7f9040067fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9058009b60 tx=0x7f90580091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 msgr2=0x7f905c0c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f905400c710 tx=0x7f905400cbd0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 shutdown_connections 2023-09-10T00:13:34.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9040065b20 0x7f9040067fe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f905c158210 0x7f905c0c0ab0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f905c0ade00 0x7f905c151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 --2- 172.21.15.84:0/2239994296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c070360 0x7f905c0c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 >> 172.21.15.84:0/2239994296 conn(0x7f905c0cca70 msgr2=0x7f905c0cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 shutdown_connections 2023-09-10T00:13:34.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.805+0000 7f90639ce640 1 -- 172.21.15.84:0/2239994296 wait complete. 2023-09-10T00:13:34.828 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:34.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- 172.21.15.84:0/1463210405 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0cefd0 msgr2=0x7ff3cc069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/1463210405 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0cefd0 0x7ff3cc069cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4009c80 tx=0x7ff3c401f580 comp rx=0 tx=0).stop 2023-09-10T00:13:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- 172.21.15.84:0/1463210405 shutdown_connections 2023-09-10T00:13:34.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/1463210405 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0cefd0 0x7ff3cc069cc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/1463210405 >> v2:172.21.15.100:3300/0 conn(0x7ff3cc0b2570 0x7ff3cc0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- 172.21.15.84:0/1463210405 >> 172.21.15.84:0/1463210405 conn(0x7ff3cc0cd570 msgr2=0x7ff3cc0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- 172.21.15.84:0/1463210405 shutdown_connections 2023-09-10T00:13:34.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- 172.21.15.84:0/1463210405 wait complete. 2023-09-10T00:13:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 Processor -- start 2023-09-10T00:13:34.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.945+0000 7ff3d0c13640 1 -- start start 2023-09-10T00:13:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0b2570 0x7ff3cc159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3cc0cefd0 0x7ff3cc1e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1e2f60 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1f59f0 con 0x7ff3cc0cefd0 2023-09-10T00:13:34.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc1f2490 con 0x7ff3cc0b2570 2023-09-10T00:13:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38120/0 (socket says 172.21.15.84:38120) 2023-09-10T00:13:34.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 -- 172.21.15.84:0/2046759870 learned_addr learned my addr 172.21.15.84:0/2046759870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3cad9d640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3cc0cefd0 0x7ff3cc1e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3ca59c640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0b2570 0x7ff3cc159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 -- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0b2570 msgr2=0x7ff3cc159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0b2570 0x7ff3cc159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 -- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3cc0cefd0 msgr2=0x7ff3cc1e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:34.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3cc0cefd0 0x7ff3cc1e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 -- 172.21.15.84:0/2046759870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40098e0 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3c9d9b640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c420 tx=0x7ff3c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00052d0 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff3c0007020 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc1f4c30 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0007430 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc1f51f0 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc06c610 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff3c00067e0 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 0x7ff3ac067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3c0082d20 con 0x7ff3cc0ceb70 2023-09-10T00:13:34.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3ca59c640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 0x7ff3ac067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.949+0000 7ff3ca59c640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 0x7ff3ac067fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009ad0 tx=0x7ff3bc0091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:34.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:34.953+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff3c00502b0 con 0x7ff3cc0ceb70 2023-09-10T00:13:35.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.093+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3cc0c7950 con 0x7ff3cc0ceb70 2023-09-10T00:13:35.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3baffd640 1 -- 172.21.15.84:0/2046759870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3c00538d0 con 0x7ff3cc0ceb70 2023-09-10T00:13:35.100 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:35.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 msgr2=0x7ff3ac067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 0x7ff3ac067fe0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009ad0 tx=0x7ff3bc0091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 msgr2=0x7ff3cc1e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c420 tx=0x7ff3c000c8e0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 shutdown_connections 2023-09-10T00:13:35.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff3ac065b20 0x7ff3ac067fe0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3cc0cefd0 0x7ff3cc1e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff3cc0ceb70 0x7ff3cc1e24e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 --2- 172.21.15.84:0/2046759870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff3cc0b2570 0x7ff3cc159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 >> 172.21.15.84:0/2046759870 conn(0x7ff3cc0cd570 msgr2=0x7ff3cc152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 shutdown_connections 2023-09-10T00:13:35.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.097+0000 7ff3d0c13640 1 -- 172.21.15.84:0/2046759870 wait complete. 2023-09-10T00:13:35.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/2806857750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca80047d0 msgr2=0x7f0ca8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/2806857750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca80047d0 0x7f0ca8004c50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0016b0 tx=0x7f0cac01c750 comp rx=0 tx=0).stop 2023-09-10T00:13:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/2806857750 shutdown_connections 2023-09-10T00:13:35.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/2806857750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ca80047d0 0x7f0ca8004c50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/2806857750 >> 172.21.15.84:0/2806857750 conn(0x7f0cbc0cb350 msgr2=0x7f0cbc0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/2806857750 shutdown_connections 2023-09-10T00:13:35.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/2806857750 wait complete. 2023-09-10T00:13:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 Processor -- start 2023-09-10T00:13:35.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- start start 2023-09-10T00:13:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ca80047d0 0x7f0cbc1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 0x7f0cbc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc156980 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c7920 con 0x7f0cbc155fc0 2023-09-10T00:13:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c7c00 con 0x7f0ca80047d0 2023-09-10T00:13:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38130/0 (socket says 172.21.15.84:38130) 2023-09-10T00:13:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 -- 172.21.15.84:0/547906345 learned_addr learned my addr 172.21.15.84:0/547906345 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:35.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc12ef640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 0x7f0cbc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc1af0640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ca80047d0 0x7f0cbc1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 -- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ca80047d0 msgr2=0x7f0cbc1f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ca80047d0 0x7f0cbc1f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 -- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 msgr2=0x7f0cbc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 0x7f0cbc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 -- 172.21.15.84:0/547906345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0c7ee0 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc12ef640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 0x7f0cbc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc22f1640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0cac70 tx=0x7f0cb400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4003d90 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cb400cea0 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.229+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc0c81c0 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40052d0 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc1f2470 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc06f210 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0cb4005430 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cb27fc640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 0x7f0ca0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0cb4083090 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cc1af0640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 0x7f0ca0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.233+0000 7f0cc1af0640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 0x7f0ca0068010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0a65d0 tx=0x7f0cb80091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.237+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0cb40506b0 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.377+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cbc073400 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.377+0000 7f0cb27fc640 1 -- 172.21.15.84:0/547906345 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cb4017020 con 0x7f0cbc0c6bb0 2023-09-10T00:13:35.382 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:35.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 msgr2=0x7f0ca0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 0x7f0ca0068010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0a65d0 tx=0x7f0cb80091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 msgr2=0x7f0cbc0c7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0cac70 tx=0x7f0cb400cc50 comp rx=0 tx=0).stop 2023-09-10T00:13:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 shutdown_connections 2023-09-10T00:13:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ca0065b50 0x7f0ca0068010 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0cbc0c6bb0 0x7f0cbc0c7060 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0cbc155fc0 0x7f0cbc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 --2- 172.21.15.84:0/547906345 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ca80047d0 0x7f0cbc1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 >> 172.21.15.84:0/547906345 conn(0x7f0cbc0cb350 msgr2=0x7f0cbc0cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 shutdown_connections 2023-09-10T00:13:35.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.381+0000 7f0cc3d54640 1 -- 172.21.15.84:0/547906345 wait complete. 2023-09-10T00:13:35.399 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- 172.21.15.84:0/4081166885 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc06ccb0 msgr2=0x7fb7dc15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- 172.21.15.84:0/4081166885 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc06ccb0 0x7fb7dc15b540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009840 tx=0x7fb7c401c710 comp rx=0 tx=0).stop 2023-09-10T00:13:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- 172.21.15.84:0/4081166885 shutdown_connections 2023-09-10T00:13:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- 172.21.15.84:0/4081166885 >> v2:172.21.15.100:3300/0 conn(0x7fb7dc157f00 0x7fb7dc0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- 172.21.15.84:0/4081166885 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc06ccb0 0x7fb7dc15b540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- 172.21.15.84:0/4081166885 >> 172.21.15.84:0/4081166885 conn(0x7fb7dc0aec00 msgr2=0x7fb7dc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- 172.21.15.84:0/4081166885 shutdown_connections 2023-09-10T00:13:35.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- 172.21.15.84:0/4081166885 wait complete. 2023-09-10T00:13:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 Processor -- start 2023-09-10T00:13:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- start start 2023-09-10T00:13:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc06ccb0 0x7fb7dc1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc157f00 0x7fb7dc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc150f80 con 0x7fb7dc14eb10 2023-09-10T00:13:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc14f500 con 0x7fb7dc06ccb0 2023-09-10T00:13:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e291b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc14f7e0 con 0x7fb7dc157f00 2023-09-10T00:13:35.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38132/0 (socket says 172.21.15.84:38132) 2023-09-10T00:13:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7d37fe640 1 -- 172.21.15.84:0/1108255969 learned_addr learned my addr 172.21.15.84:0/1108255969 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7dbfff640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc06ccb0 0x7fb7dc1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.521+0000 7fb7e0eb8640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc157f00 0x7fb7dc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 -- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc157f00 msgr2=0x7fb7dc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc157f00 0x7fb7dc156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 -- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc06ccb0 msgr2=0x7fb7dc1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc06ccb0 0x7fb7dc1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 -- 172.21.15.84:0/1108255969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40094a0 con 0x7fb7dc14eb10 2023-09-10T00:13:35.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d37fe640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c401a340 tx=0x7fb7c40a6600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4004240 con 0x7fb7dc14eb10 2023-09-10T00:13:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7c4004490 con 0x7fb7dc14eb10 2023-09-10T00:13:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc14fac0 con 0x7fb7dc14eb10 2023-09-10T00:13:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4003840 con 0x7fb7dc14eb10 2023-09-10T00:13:35.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc14a760 con 0x7fb7dc14eb10 2023-09-10T00:13:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0713a0 con 0x7fb7dc14eb10 2023-09-10T00:13:35.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb7c40039a0 con 0x7fb7dc14eb10 2023-09-10T00:13:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 0x7fb7bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7c40aa070 con 0x7fb7dc14eb10 2023-09-10T00:13:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7dbfff640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 0x7fb7bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.525+0000 7fb7dbfff640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 0x7fb7bc067fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0046c0 tx=0x7fb7cc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.529+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb7c40ec430 con 0x7fb7dc14eb10 2023-09-10T00:13:35.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.669+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7dc14f2e0 con 0x7fb7dc14eb10 2023-09-10T00:13:35.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7d97fa640 1 -- 172.21.15.84:0/1108255969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7c40b7e60 con 0x7fb7dc14eb10 2023-09-10T00:13:35.677 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:35.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 msgr2=0x7fb7bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 0x7fb7bc067fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0046c0 tx=0x7fb7cc009040 comp rx=0 tx=0).stop 2023-09-10T00:13:35.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 msgr2=0x7fb7dc156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb7c401a340 tx=0x7fb7c40a6600 comp rx=0 tx=0).stop 2023-09-10T00:13:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 shutdown_connections 2023-09-10T00:13:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb7bc065b20 0x7fb7bc067fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7dc157f00 0x7fb7dc156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7dc14eb10 0x7fb7dc156a20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 --2- 172.21.15.84:0/1108255969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc06ccb0 0x7fb7dc1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 >> 172.21.15.84:0/1108255969 conn(0x7fb7dc0aec00 msgr2=0x7fb7dc0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 shutdown_connections 2023-09-10T00:13:35.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.673+0000 7fb7e291b640 1 -- 172.21.15.84:0/1108255969 wait complete. 2023-09-10T00:13:35.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:35.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/4248839552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a5006c280 msgr2=0x7f1a5006c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- 172.21.15.84:0/4248839552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a5006c280 0x7f1a5006c710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1a500cd6a0 tx=0x7f1a4801cd30 comp rx=0 tx=0).stop 2023-09-10T00:13:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/4248839552 shutdown_connections 2023-09-10T00:13:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- 172.21.15.84:0/4248839552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a5006c280 0x7f1a5006c710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- 172.21.15.84:0/4248839552 >> v2:172.21.15.100:3300/0 conn(0x7f1a50158230 0x7f1a500695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- 172.21.15.84:0/4248839552 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006fa60 0x7f1a5006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/4248839552 >> 172.21.15.84:0/4248839552 conn(0x7f1a500aec00 msgr2=0x7f1a500cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/4248839552 shutdown_connections 2023-09-10T00:13:35.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/4248839552 wait complete. 2023-09-10T00:13:35.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 Processor -- start 2023-09-10T00:13:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- start start 2023-09-10T00:13:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006c280 0x7f1a50145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5006fa60 0x7f1a50146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a501457c0 con 0x7f1a50158230 2023-09-10T00:13:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5014cd40 con 0x7f1a5006fa60 2023-09-10T00:13:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5014bca0 con 0x7f1a5006c280 2023-09-10T00:13:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38148/0 (socket says 172.21.15.84:38148) 2023-09-10T00:13:35.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 -- 172.21.15.84:0/1282537478 learned_addr learned my addr 172.21.15.84:0/1282537478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a54ab1640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006c280 0x7f1a50145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 -- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006c280 msgr2=0x7f1a50145280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006c280 0x7f1a50145280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 -- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5006fa60 msgr2=0x7f1a50146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a4ffff640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5006fa60 0x7f1a50146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5006fa60 0x7f1a50146f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 -- 172.21.15.84:0/1282537478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a480098e0 con 0x7f1a50158230 2023-09-10T00:13:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a552b2640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009bd0 tx=0x7f1a480a5b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48004e60 con 0x7f1a50158230 2023-09-10T00:13:35.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1a480ad5b0 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5014bf80 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480ad9a0 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.805+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5014c540 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a500713a0 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1a480b4040 con 0x7f1a50158230 2023-09-10T00:13:35.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a4d7fa640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 0x7f1a3c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:35.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a4811db70 con 0x7f1a50158230 2023-09-10T00:13:35.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a54ab1640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 0x7f1a3c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:35.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.809+0000 7f1a54ab1640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 0x7f1a3c067fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a400058d0 tx=0x7f1a40005e30 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:35.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.813+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1a480eb100 con 0x7f1a50158230 2023-09-10T00:13:35.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.965+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1a50070d10 con 0x7f1a50158230 2023-09-10T00:13:35.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.965+0000 7f1a4d7fa640 1 -- 172.21.15.84:0/1282537478 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1a480b2020 con 0x7f1a50158230 2023-09-10T00:13:35.971 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:35.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 msgr2=0x7f1a3c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 0x7f1a3c067fe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a400058d0 tx=0x7f1a40005e30 comp rx=0 tx=0).stop 2023-09-10T00:13:35.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 msgr2=0x7f1a50147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:35.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009bd0 tx=0x7f1a480a5b40 comp rx=0 tx=0).stop 2023-09-10T00:13:35.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 shutdown_connections 2023-09-10T00:13:35.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1a3c065b20 0x7f1a3c067fe0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a50158230 0x7f1a50147480 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a5006fa60 0x7f1a50146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 --2- 172.21.15.84:0/1282537478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1a5006c280 0x7f1a50145280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:35.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 >> 172.21.15.84:0/1282537478 conn(0x7f1a500aec00 msgr2=0x7f1a500ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:35.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 shutdown_connections 2023-09-10T00:13:35.975 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:35.969+0000 7f1a56d15640 1 -- 172.21.15.84:0/1282537478 wait complete. 2023-09-10T00:13:35.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-10T00:13:36.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- 172.21.15.84:0/1221022118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4014005190 msgr2=0x7f401400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 --2- 172.21.15.84:0/1221022118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4014005190 0x7f401400b990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4024009ee0 tx=0x7f402401d610 comp rx=0 tx=0).stop 2023-09-10T00:13:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- 172.21.15.84:0/1221022118 shutdown_connections 2023-09-10T00:13:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 --2- 172.21.15.84:0/1221022118 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4014005190 0x7f401400b990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- 172.21.15.84:0/1221022118 >> 172.21.15.84:0/1221022118 conn(0x7f402c0cb7c0 msgr2=0x7f402c0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:36.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- 172.21.15.84:0/1221022118 shutdown_connections 2023-09-10T00:13:36.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- 172.21.15.84:0/1221022118 wait complete. 2023-09-10T00:13:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 Processor -- start 2023-09-10T00:13:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- start start 2023-09-10T00:13:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4014005190 0x7f402c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402c0b19d0 0x7f402c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0b2390 con 0x7f402c0c2f10 2023-09-10T00:13:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c1f2930 con 0x7f402c0b19d0 2023-09-10T00:13:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f4032f10640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c14e8b0 con 0x7f4014005190 2023-09-10T00:13:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f40314ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f40314ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38164/0 (socket says 172.21.15.84:38164) 2023-09-10T00:13:36.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.105+0000 7f40314ad640 1 -- 172.21.15.84:0/692775357 learned_addr learned my addr 172.21.15.84:0/692775357 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:36.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 -- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4014005190 msgr2=0x7f402c0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4030cac640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4014005190 0x7f402c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f402bfff640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402c0b19d0 0x7f402c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4014005190 0x7f402c0afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 -- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402c0b19d0 msgr2=0x7f402c0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402c0b19d0 0x7f402c0b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 -- 172.21.15.84:0/692775357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c0c38d0 con 0x7f402c0c2f10 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40314ad640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4024009e00 tx=0x7f4024004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024003b80 con 0x7f402c0c2f10 2023-09-10T00:13:36.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4024009200 con 0x7f402c0c2f10 2023-09-10T00:13:36.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c0c3b60 con 0x7f402c0c2f10 2023-09-10T00:13:36.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024004cb0 con 0x7f402c0c2f10 2023-09-10T00:13:36.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0c4120 con 0x7f402c0c2f10 2023-09-10T00:13:36.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c06f3a0 con 0x7f402c0c2f10 2023-09-10T00:13:36.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4024005030 con 0x7f402c0c2f10 2023-09-10T00:13:36.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 0x7f4018068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f402411d7f0 con 0x7f402c0c2f10 2023-09-10T00:13:36.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4030cac640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 0x7f4018068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.109+0000 7f4030cac640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 0x7f4018068010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40200015b0 tx=0x7f4020009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.113+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f40240ead80 con 0x7f402c0c2f10 2023-09-10T00:13:36.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.309+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f402c1563c0 con 0x7f402c0c2f10 2023-09-10T00:13:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.425+0000 7f40297fa640 1 -- 172.21.15.84:0/692775357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v71) v1 ==== 147+0+0 (secure 0 0 0) 0x7f40240bb020 con 0x7f402c0c2f10 2023-09-10T00:13:36.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 msgr2=0x7f4018068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 0x7f4018068010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40200015b0 tx=0x7f4020009040 comp rx=0 tx=0).stop 2023-09-10T00:13:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 msgr2=0x7f402c0c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4024009e00 tx=0x7f4024004680 comp rx=0 tx=0).stop 2023-09-10T00:13:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 shutdown_connections 2023-09-10T00:13:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4018065b50 0x7f4018068010 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f402c0c2f10 0x7f402c0c3390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402c0b19d0 0x7f402c0b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 --2- 172.21.15.84:0/692775357 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4014005190 0x7f402c0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 >> 172.21.15.84:0/692775357 conn(0x7f402c0cb7c0 msgr2=0x7f402c1577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 shutdown_connections 2023-09-10T00:13:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.429+0000 7f4032f10640 1 -- 172.21.15.84:0/692775357 wait complete. 2023-09-10T00:13:36.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-09-10T00:13:36.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/3625541307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c06b250 msgr2=0x7f3c9c070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- 172.21.15.84:0/3625541307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c06b250 0x7f3c9c070be0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0c1110 tx=0x7f3c8401efd0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/3625541307 shutdown_connections 2023-09-10T00:13:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- 172.21.15.84:0/3625541307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c06b250 0x7f3c9c070be0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- 172.21.15.84:0/3625541307 >> v2:172.21.15.100:3300/0 conn(0x7f3c9c071120 0x7f3c9c0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/3625541307 >> 172.21.15.84:0/3625541307 conn(0x7f3c9c0cd770 msgr2=0x7f3c9c0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:36.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/3625541307 shutdown_connections 2023-09-10T00:13:36.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/3625541307 wait complete. 2023-09-10T00:13:36.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 Processor -- start 2023-09-10T00:13:36.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- start start 2023-09-10T00:13:36.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c9c06b250 0x7f3c9c14e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 0x7f3c9c1f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c13e5f0 con 0x7f3c9c071120 2023-09-10T00:13:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0ae530 con 0x7f3c9c1589f0 2023-09-10T00:13:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0ae1e0 con 0x7f3c9c06b250 2023-09-10T00:13:36.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38190/0 (socket says 172.21.15.84:38190) 2023-09-10T00:13:36.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 -- 172.21.15.84:0/4023321237 learned_addr learned my addr 172.21.15.84:0/4023321237 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:36.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 -- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c9c06b250 msgr2=0x7f3c9c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c9affd640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c9c06b250 0x7f3c9c14e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c9c06b250 0x7f3c9c14e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 -- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 msgr2=0x7f3c9c1f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c9b7fe640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 0x7f3c9c1f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 0x7f3c9c1f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 -- 172.21.15.84:0/4023321237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840094a0 con 0x7f3c9c071120 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c9b7fe640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 0x7f3c9c1f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:36.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c927fc640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3c8401bbe0 tx=0x7f3c84004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840b08a0 con 0x7f3c9c071120 2023-09-10T00:13:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c840b0af0 con 0x7f3c9c071120 2023-09-10T00:13:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c15cd70 con 0x7f3c9c071120 2023-09-10T00:13:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840b0ea0 con 0x7f3c9c071120 2023-09-10T00:13:36.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c1513d0 con 0x7f3c9c071120 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.569+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c06e040 con 0x7f3c9c071120 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.573+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3c840b7040 con 0x7f3c9c071120 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.573+0000 7f3c98ff9640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 0x7f3c7c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.573+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3c84121ff0 con 0x7f3c9c071120 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.573+0000 7f3c9affd640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 0x7f3c7c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.573+0000 7f3c9affd640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 0x7f3c7c067fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000f70 tx=0x7f3c8c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.577+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3c840ef660 con 0x7f3c9c071120 2023-09-10T00:13:36.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.717+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7f3c9c0acba0 con 0x7f3c9c071120 2023-09-10T00:13:36.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.717+0000 7f3c98ff9640 1 -- 172.21.15.84:0/4023321237 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7f3c840b5080 con 0x7f3c9c071120 2023-09-10T00:13:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-09-10T00:13:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_op_complaint_time 120 2023-09-10T00:13:36.723 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_complaint_time 180.000000 2023-09-10T00:13:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 6173.198644 2023-09-10T00:13:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4374.683142 2023-09-10T00:13:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4086.190880 2023-09-10T00:13:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5451.065742 2023-09-10T00:13:36.724 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 3673.380411 2023-09-10T00:13:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4137.703016 2023-09-10T00:13:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 3643.389084 2023-09-10T00:13:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 3611.022013 2023-09-10T00:13:36.725 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds 20/20 2023-09-10T00:13:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds_balancer 20/20 2023-09-10T00:13:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_ms 1/1 2023-09-10T00:13:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-09-10T00:13:36.726 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_merge_size 5 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_bits 3 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_size 100 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_frag true 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_scatterstat true 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_op_complaint_time 180.000000 2023-09-10T00:13:36.727 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_verify_scatter true 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced osd_op_complaint_time 180.000000 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_mon_op_timeout 900 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_osd_op_timeout 900 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_mount_timeout 600 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_client 20/20 2023-09-10T00:13:36.728 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_ms 1/1 2023-09-10T00:13:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_mon_op_timeout 900 2023-09-10T00:13:36.729 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_osd_op_timeout 900 2023-09-10T00:13:36.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 msgr2=0x7f3c7c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 0x7f3c7c067fe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000f70 tx=0x7f3c8c009040 comp rx=0 tx=0).stop 2023-09-10T00:13:36.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 msgr2=0x7f3c9c1f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3c8401bbe0 tx=0x7f3c84004310 comp rx=0 tx=0).stop 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 shutdown_connections 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3c7c065b20 0x7f3c7c067fe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c9c1589f0 0x7f3c9c1f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3c9c071120 0x7f3c9c1f2ee0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 --2- 172.21.15.84:0/4023321237 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c9c06b250 0x7f3c9c14e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 >> 172.21.15.84:0/4023321237 conn(0x7f3c9c0cd770 msgr2=0x7f3c9c0c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 shutdown_connections 2023-09-10T00:13:36.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.721+0000 7f3ca187c640 1 -- 172.21.15.84:0/4023321237 wait complete. 2023-09-10T00:13:36.740 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-09-10T00:13:36.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 -- 172.21.15.84:0/2801730488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 msgr2=0x7f70401591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 --2- 172.21.15.84:0/2801730488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401591a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f704006dd40 tx=0x7f703801cd30 comp rx=0 tx=0).stop 2023-09-10T00:13:36.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 -- 172.21.15.84:0/2801730488 shutdown_connections 2023-09-10T00:13:36.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 --2- 172.21.15.84:0/2801730488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401591a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 --2- 172.21.15.84:0/2801730488 >> v2:172.21.15.100:3300/0 conn(0x7f70400af770 0x7f704006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 --2- 172.21.15.84:0/2801730488 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f704006fa60 0x7f70400ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 -- 172.21.15.84:0/2801730488 >> 172.21.15.84:0/2801730488 conn(0x7f70400aec00 msgr2=0x7f70400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:36.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 -- 172.21.15.84:0/2801730488 shutdown_connections 2023-09-10T00:13:36.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.849+0000 7f7045649640 1 -- 172.21.15.84:0/2801730488 wait complete. 2023-09-10T00:13:36.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 Processor -- start 2023-09-10T00:13:36.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- start start 2023-09-10T00:13:36.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f704006fa60 0x7f7040151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70400af770 0x7f7040135f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ad6e0 con 0x7f70400cbd60 2023-09-10T00:13:36.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040136ba0 con 0x7f704006fa60 2023-09-10T00:13:36.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040136e80 con 0x7f70400af770 2023-09-10T00:13:36.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38202/0 (socket says 172.21.15.84:38202) 2023-09-10T00:13:36.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 -- 172.21.15.84:0/1096103926 learned_addr learned my addr 172.21.15.84:0/1096103926 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:36.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703effd640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f704006fa60 0x7f7040151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703e7fc640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70400af770 0x7f7040135f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 -- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70400af770 msgr2=0x7f7040135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70400af770 0x7f7040135f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 -- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f704006fa60 msgr2=0x7f7040151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:36.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f704006fa60 0x7f7040151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:36.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 -- 172.21.15.84:0/1096103926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380098e0 con 0x7f70400cbd60 2023-09-10T00:13:36.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f703f7fe640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7038009bd0 tx=0x7f7038009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380bc070 con 0x7f70400cbd60 2023-09-10T00:13:36.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7038004440 con 0x7f70400cbd60 2023-09-10T00:13:36.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040137160 con 0x7f70400cbd60 2023-09-10T00:13:36.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038004830 con 0x7f70400cbd60 2023-09-10T00:13:36.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70401516b0 con 0x7f70400cbd60 2023-09-10T00:13:36.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70400713a0 con 0x7f70400cbd60 2023-09-10T00:13:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.853+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f70380b4040 con 0x7f70400cbd60 2023-09-10T00:13:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.857+0000 7f70277fe640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 0x7f702c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.857+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f703811e3e0 con 0x7f70400cbd60 2023-09-10T00:13:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.857+0000 7f703effd640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 0x7f702c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.857+0000 7f703effd640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 0x7f702c067fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7030006fd0 tx=0x7f7030008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:36.861+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f70380eb970 con 0x7f70400cbd60 2023-09-10T00:13:37.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.001+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7040137610 con 0x7f70400cbd60 2023-09-10T00:13:37.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.005+0000 7f70277fe640 1 -- 172.21.15.84:0/1096103926 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7f70380eef90 con 0x7f70400cbd60 2023-09-10T00:13:37.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 msgr2=0x7f702c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 0x7f702c067fe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7030006fd0 tx=0x7f7030008040 comp rx=0 tx=0).stop 2023-09-10T00:13:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 msgr2=0x7f70401364d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7038009bd0 tx=0x7f7038009340 comp rx=0 tx=0).stop 2023-09-10T00:13:37.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 shutdown_connections 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f702c065b20 0x7f702c067fe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70400cbd60 0x7f70401364d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70400af770 0x7f7040135f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 --2- 172.21.15.84:0/1096103926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f704006fa60 0x7f7040151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 >> 172.21.15.84:0/1096103926 conn(0x7f70400aec00 msgr2=0x7f70400c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 shutdown_connections 2023-09-10T00:13:37.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.009+0000 7f7045649640 1 -- 172.21.15.84:0/1096103926 wait complete. 2023-09-10T00:13:37.028 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-10T00:13:37.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-10T00:13:37.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-10T00:13:37.117 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-10T00:13:37.118 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:37.118 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:37.125 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:37.126 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:37.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:37.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/3153474956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b741577f0 msgr2=0x7f7b740ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/3153474956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b741577f0 0x7f7b740ad970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b74070b30 tx=0x7f7b6401c7b0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/3153474956 shutdown_connections 2023-09-10T00:13:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/3153474956 >> v2:172.21.15.100:3300/0 conn(0x7f7b7406fad0 0x7f7b7406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/3153474956 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b741577f0 0x7f7b740ad970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/3153474956 >> 172.21.15.84:0/3153474956 conn(0x7f7b740cca70 msgr2=0x7f7b740cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/3153474956 shutdown_connections 2023-09-10T00:13:37.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/3153474956 wait complete. 2023-09-10T00:13:37.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 Processor -- start 2023-09-10T00:13:37.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- start start 2023-09-10T00:13:37.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b741577f0 0x7f7b740c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7b7415b460 0x7f7b7414e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b741527b0 con 0x7f7b7406fad0 2023-09-10T00:13:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740c4e20 con 0x7f7b741577f0 2023-09-10T00:13:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740c5100 con 0x7f7b7415b460 2023-09-10T00:13:37.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38216/0 (socket says 172.21.15.84:38216) 2023-09-10T00:13:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 -- 172.21.15.84:0/4022475193 learned_addr learned my addr 172.21.15.84:0/4022475193 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b79c3e640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b741577f0 0x7f7b740c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 -- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7b7415b460 msgr2=0x7f7b7414e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7ac40640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7b7415b460 0x7f7b7414e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7b7415b460 0x7f7b7414e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 -- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b741577f0 msgr2=0x7f7b740c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b741577f0 0x7f7b740c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 -- 172.21.15.84:0/4022475193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b640094a0 con 0x7f7b7406fad0 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7a43f640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b640193c0 tx=0x7f7b640a5780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003800 con 0x7f7b7406fad0 2023-09-10T00:13:37.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7b64003a50 con 0x7f7b7406fad0 2023-09-10T00:13:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b740c53e0 con 0x7f7b7406fad0 2023-09-10T00:13:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003de0 con 0x7f7b7406fad0 2023-09-10T00:13:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.337+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b740c56c0 con 0x7f7b7406fad0 2023-09-10T00:13:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b740c5e00 con 0x7f7b7406fad0 2023-09-10T00:13:37.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7b640b4040 con 0x7f7b7406fad0 2023-09-10T00:13:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b72ffd640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 0x7f7b60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7b6411e480 con 0x7f7b7406fad0 2023-09-10T00:13:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b79c3e640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 0x7f7b60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.341+0000 7f7b79c3e640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 0x7f7b60067fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b68005c50 tx=0x7f7b68005be0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.345+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7b640eba10 con 0x7f7b7406fad0 2023-09-10T00:13:37.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.501+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b740712c0 con 0x7f7b7406fad0 2023-09-10T00:13:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.501+0000 7f7b72ffd640 1 -- 172.21.15.84:0/4022475193 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f7b640ef030 con 0x7f7b7406fad0 2023-09-10T00:13:37.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:37.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 msgr2=0x7f7b60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 0x7f7b60067fe0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b68005c50 tx=0x7f7b68005be0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 msgr2=0x7f7b741529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b640193c0 tx=0x7f7b640a5780 comp rx=0 tx=0).stop 2023-09-10T00:13:37.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 shutdown_connections 2023-09-10T00:13:37.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7b60065b20 0x7f7b60067fe0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7b7415b460 0x7f7b7414e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b741577f0 0x7f7b740c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 --2- 172.21.15.84:0/4022475193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b7406fad0 0x7f7b741529d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 >> 172.21.15.84:0/4022475193 conn(0x7f7b740cca70 msgr2=0x7f7b7406c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 shutdown_connections 2023-09-10T00:13:37.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.505+0000 7f7b7c6a3640 1 -- 172.21.15.84:0/4022475193 wait complete. 2023-09-10T00:13:37.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:37.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:37.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- 172.21.15.84:0/560904369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003f30 msgr2=0x7f21bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/560904369 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21bc003f30 0x7f21bc0047d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f21b8006fb0 tx=0x7f21b801f700 comp rx=0 tx=0).stop 2023-09-10T00:13:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d1268640 1 -- 172.21.15.84:0/560904369 reap_dead start 2023-09-10T00:13:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- 172.21.15.84:0/560904369 shutdown_connections 2023-09-10T00:13:37.653 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- 172.21.15.84:0/560904369 >> 172.21.15.84:0/560904369 conn(0x7f21cc0aec00 msgr2=0x7f21cc0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- 172.21.15.84:0/560904369 shutdown_connections 2023-09-10T00:13:37.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- 172.21.15.84:0/560904369 wait complete. 2023-09-10T00:13:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 Processor -- start 2023-09-10T00:13:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- start start 2023-09-10T00:13:37.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 0x7f21cc14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 0x7f21cc156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc1573e0 con 0x7f21cc159390 2023-09-10T00:13:37.657 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc14c2c0 con 0x7f21cc156a20 2023-09-10T00:13:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d2ccb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc14f030 con 0x7f21bc003f30 2023-09-10T00:13:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38236/0 (socket says 172.21.15.84:38236) 2023-09-10T00:13:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 -- 172.21.15.84:0/1510199595 learned_addr learned my addr 172.21.15.84:0/1510199595 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:37.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d0a67640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 0x7f21cc14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d1268640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 0x7f21cc156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 -- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 msgr2=0x7f21cc14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 0x7f21cc14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 -- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 msgr2=0x7f21cc156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 0x7f21cc156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 -- 172.21.15.84:0/1510199595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc159950 con 0x7f21cc159390 2023-09-10T00:13:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d1268640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 0x7f21cc156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21d0a67640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 0x7f21cc14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.649+0000 7f21cbfff640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f21b809bf60 tx=0x7f21b8006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8001800 con 0x7f21cc159390 2023-09-10T00:13:37.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21b8003600 con 0x7f21cc159390 2023-09-10T00:13:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc159c30 con 0x7f21cc159390 2023-09-10T00:13:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8003a10 con 0x7f21cc159390 2023-09-10T00:13:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc15a1f0 con 0x7f21cc159390 2023-09-10T00:13:37.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc0713a0 con 0x7f21cc159390 2023-09-10T00:13:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f21b8003b70 con 0x7f21cc159390 2023-09-10T00:13:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 0x7f21b0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21b80ab070 con 0x7f21cc159390 2023-09-10T00:13:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21d0a67640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 0x7f21b0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.653+0000 7f21d0a67640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 0x7f21b0068010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0c97d0 tx=0x7f21c00091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.657+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f21b80ef210 con 0x7f21cc159390 2023-09-10T00:13:37.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.809+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21cc073400 con 0x7f21cc159390 2023-09-10T00:13:37.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.809+0000 7f21c97fa640 1 -- 172.21.15.84:0/1510199595 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21b8121e60 con 0x7f21cc159390 2023-09-10T00:13:37.814 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:37.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 msgr2=0x7f21b0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 0x7f21b0068010 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f21cc0c97d0 tx=0x7f21c00091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 msgr2=0x7f21cc0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f21b809bf60 tx=0x7f21b8006650 comp rx=0 tx=0).stop 2023-09-10T00:13:37.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 shutdown_connections 2023-09-10T00:13:37.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21b0065b50 0x7f21b0068010 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21cc156a20 0x7f21cc156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.817 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21cc159390 0x7f21cc0ad970 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 --2- 172.21.15.84:0/1510199595 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21bc003f30 0x7f21cc14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 >> 172.21.15.84:0/1510199595 conn(0x7f21cc0aec00 msgr2=0x7f21cc0b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 shutdown_connections 2023-09-10T00:13:37.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.813+0000 7f21d2ccb640 1 -- 172.21.15.84:0/1510199595 wait complete. 2023-09-10T00:13:37.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:37.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 -- 172.21.15.84:0/482812970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 msgr2=0x7f251406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 --2- 172.21.15.84:0/482812970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f251406c5a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2514159030 tx=0x7f250401cd20 comp rx=0 tx=0).stop 2023-09-10T00:13:37.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 -- 172.21.15.84:0/482812970 shutdown_connections 2023-09-10T00:13:37.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 --2- 172.21.15.84:0/482812970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f251406c5a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 --2- 172.21.15.84:0/482812970 >> v2:172.21.15.100:3300/0 conn(0x7f251414eb10 0x7f251415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 -- 172.21.15.84:0/482812970 >> 172.21.15.84:0/482812970 conn(0x7f25140aec00 msgr2=0x7f25140cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:37.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 -- 172.21.15.84:0/482812970 shutdown_connections 2023-09-10T00:13:37.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.957+0000 7f251921b640 1 -- 172.21.15.84:0/482812970 wait complete. 2023-09-10T00:13:37.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 Processor -- start 2023-09-10T00:13:37.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- start start 2023-09-10T00:13:37.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251406cae0 0x7f25140b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f251414eb10 0x7f2514147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514150510 con 0x7f2514157f00 2023-09-10T00:13:37.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251415a460 con 0x7f251406cae0 2023-09-10T00:13:37.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2514159850 con 0x7f251414eb10 2023-09-10T00:13:37.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38254/0 (socket says 172.21.15.84:38254) 2023-09-10T00:13:37.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 -- 172.21.15.84:0/3020607641 learned_addr learned my addr 172.21.15.84:0/3020607641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:37.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251259c640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f251414eb10 0x7f2514147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f2512d9d640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251406cae0 0x7f25140b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 -- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f251414eb10 msgr2=0x7f2514147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f251414eb10 0x7f2514147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 -- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251406cae0 msgr2=0x7f25140b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:37.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251406cae0 0x7f25140b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:37.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 -- 172.21.15.84:0/3020607641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040098e0 con 0x7f2514157f00 2023-09-10T00:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251359e640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c410 tx=0x7f250c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c003600 con 0x7f2514157f00 2023-09-10T00:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f250c003760 con 0x7f2514157f00 2023-09-10T00:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c003bb0 con 0x7f2514157f00 2023-09-10T00:13:37.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2514159b30 con 0x7f2514157f00 2023-09-10T00:13:37.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251415a0f0 con 0x7f2514157f00 2023-09-10T00:13:37.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.961+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251415a5d0 con 0x7f2514157f00 2023-09-10T00:13:37.976 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.965+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f250c003d10 con 0x7f2514157f00 2023-09-10T00:13:37.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.965+0000 7f250b7fe640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 0x7f24f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:37.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.965+0000 7f2512d9d640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 0x7f24f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:37.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.965+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f250c0829d0 con 0x7f2514157f00 2023-09-10T00:13:37.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.965+0000 7f2512d9d640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 0x7f24f4067fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0058d0 tx=0x7f24fc005e30 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:37.977 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:37.969+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f250c04ff50 con 0x7f2514157f00 2023-09-10T00:13:38.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.109+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25140713a0 con 0x7f2514157f00 2023-09-10T00:13:38.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f250b7fe640 1 -- 172.21.15.84:0/3020607641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f250c053570 con 0x7f2514157f00 2023-09-10T00:13:38.116 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:38.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 msgr2=0x7f24f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 0x7f24f4067fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0058d0 tx=0x7f24fc005e30 comp rx=0 tx=0).stop 2023-09-10T00:13:38.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 msgr2=0x7f2514148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f250c00c410 tx=0x7f250c00c8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 shutdown_connections 2023-09-10T00:13:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f24f4065b20 0x7f24f4067fe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2514157f00 0x7f2514148370 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f251414eb10 0x7f2514147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 --2- 172.21.15.84:0/3020607641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251406cae0 0x7f25140b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 >> 172.21.15.84:0/3020607641 conn(0x7f25140aec00 msgr2=0x7f2514069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 shutdown_connections 2023-09-10T00:13:38.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.113+0000 7f251921b640 1 -- 172.21.15.84:0/3020607641 wait complete. 2023-09-10T00:13:38.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:38.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- 172.21.15.84:0/2173658121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f296006fa60 msgr2=0x7f29600ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 --2- 172.21.15.84:0/2173658121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f296006fa60 0x7f29600ca550 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2950009840 tx=0x7f295001c7a0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- 172.21.15.84:0/2173658121 shutdown_connections 2023-09-10T00:13:38.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 --2- 172.21.15.84:0/2173658121 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f296006fa60 0x7f29600ca550 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- 172.21.15.84:0/2173658121 >> 172.21.15.84:0/2173658121 conn(0x7f29600aec00 msgr2=0x7f29600cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- 172.21.15.84:0/2173658121 shutdown_connections 2023-09-10T00:13:38.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- 172.21.15.84:0/2173658121 wait complete. 2023-09-10T00:13:38.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 Processor -- start 2023-09-10T00:13:38.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.257+0000 7f29671b4640 1 -- start start 2023-09-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f296006fa60 0x7f2960157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29600cbd60 0x7f29600b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296012df10 con 0x7f29600af770 2023-09-10T00:13:38.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960141210 con 0x7f29600cbd60 2023-09-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29601414f0 con 0x7f296006fa60 2023-09-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38270/0 (socket says 172.21.15.84:38270) 2023-09-10T00:13:38.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 -- 172.21.15.84:0/2896622328 learned_addr learned my addr 172.21.15.84:0/2896622328 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f2965751640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29600cbd60 0x7f29600b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f2964f50640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f296006fa60 0x7f2960157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 -- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f296006fa60 msgr2=0x7f2960157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f296006fa60 0x7f2960157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 -- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29600cbd60 msgr2=0x7f29600b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29600cbd60 0x7f29600b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 -- 172.21.15.84:0/2896622328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500094a0 con 0x7f29600af770 2023-09-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295ffff640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f295400c420 tx=0x7f295400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540052d0 con 0x7f29600af770 2023-09-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2954007020 con 0x7f29600af770 2023-09-10T00:13:38.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29601417d0 con 0x7f29600af770 2023-09-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954007430 con 0x7f29600af770 2023-09-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29601586f0 con 0x7f29600af770 2023-09-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960141a10 con 0x7f29600af770 2023-09-10T00:13:38.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f29540067e0 con 0x7f29600af770 2023-09-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 0x7f294c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2954082d40 con 0x7f29600af770 2023-09-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.261+0000 7f2964f50640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 0x7f294c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.265+0000 7f2964f50640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 0x7f294c067fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f29500af000 tx=0x7f295001afe0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.265+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2960141a10 con 0x7f29600af770 2023-09-10T00:13:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.417+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2960141a10 con 0x7f29600af770 2023-09-10T00:13:38.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f295d7fa640 1 -- 172.21.15.84:0/2896622328 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2960141a10 con 0x7f29600af770 2023-09-10T00:13:38.424 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:38.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 msgr2=0x7f294c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 0x7f294c067fe0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f29500af000 tx=0x7f295001afe0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 msgr2=0x7f2960137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f295400c420 tx=0x7f295400c8e0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 shutdown_connections 2023-09-10T00:13:38.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f294c065b20 0x7f294c067fe0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29600cbd60 0x7f29600b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29600af770 0x7f2960137900 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 --2- 172.21.15.84:0/2896622328 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f296006fa60 0x7f2960157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 >> 172.21.15.84:0/2896622328 conn(0x7f29600aec00 msgr2=0x7f296015b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 shutdown_connections 2023-09-10T00:13:38.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.421+0000 7f29671b4640 1 -- 172.21.15.84:0/2896622328 wait complete. 2023-09-10T00:13:38.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:38.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 -- 172.21.15.84:0/1781060307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940b2570 msgr2=0x7f11940b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 --2- 172.21.15.84:0/1781060307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940b2570 0x7f11940b2950 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f11940b3620 tx=0x7f118801f090 comp rx=0 tx=0).stop 2023-09-10T00:13:38.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 -- 172.21.15.84:0/1781060307 shutdown_connections 2023-09-10T00:13:38.567 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 --2- 172.21.15.84:0/1781060307 >> v2:172.21.15.100:3300/0 conn(0x7f11940695b0 0x7f1194069a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 --2- 172.21.15.84:0/1781060307 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 0x7f11940cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 --2- 172.21.15.84:0/1781060307 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940b2570 0x7f11940b2950 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 -- 172.21.15.84:0/1781060307 >> 172.21.15.84:0/1781060307 conn(0x7f11940cd570 msgr2=0x7f11940cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.568 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 -- 172.21.15.84:0/1781060307 shutdown_connections 2023-09-10T00:13:38.569 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.561+0000 7f119b030640 1 -- 172.21.15.84:0/1781060307 wait complete. 2023-09-10T00:13:38.571 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 Processor -- start 2023-09-10T00:13:38.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- start start 2023-09-10T00:13:38.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11940b2570 0x7f11941e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 0x7f119414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941e60b0 con 0x7f11940695b0 2023-09-10T00:13:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941f56c0 con 0x7f11940b2570 2023-09-10T00:13:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1194158990 con 0x7f11940ceb70 2023-09-10T00:13:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38290/0 (socket says 172.21.15.84:38290) 2023-09-10T00:13:38.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 -- 172.21.15.84:0/1258184602 learned_addr learned my addr 172.21.15.84:0/1258184602 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:38.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1193fff640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11940b2570 0x7f11941e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f11995cd640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 0x7f119414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 -- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 msgr2=0x7f119414e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 0x7f119414e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 -- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11940b2570 msgr2=0x7f11941e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11940b2570 0x7f11941e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 -- 172.21.15.84:0/1258184602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009560 con 0x7f11940695b0 2023-09-10T00:13:38.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f1198dcc640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f11880b3040 tx=0x7f11880b06a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880b0b50 con 0x7f11940695b0 2023-09-10T00:13:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f11880b0da0 con 0x7f11940695b0 2023-09-10T00:13:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11941e5af0 con 0x7f11940695b0 2023-09-10T00:13:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188005290 con 0x7f11940695b0 2023-09-10T00:13:38.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1194158c30 con 0x7f11940695b0 2023-09-10T00:13:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11941587f0 con 0x7f11940695b0 2023-09-10T00:13:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.565+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11880b7070 con 0x7f11940695b0 2023-09-10T00:13:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.569+0000 7f11917fa640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 0x7f1178067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.569+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11881209c0 con 0x7f11940695b0 2023-09-10T00:13:38.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.569+0000 7f1193fff640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 0x7f1178067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.569+0000 7f1193fff640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 0x7f1178067fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1180005fd0 tx=0x7f1180005f40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.573+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f11941587f0 con 0x7f11940695b0 2023-09-10T00:13:38.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.713+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f11941587f0 con 0x7f11940695b0 2023-09-10T00:13:38.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.713+0000 7f11917fa640 1 -- 172.21.15.84:0/1258184602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f11941587f0 con 0x7f11940695b0 2023-09-10T00:13:38.718 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 msgr2=0x7f1178067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 0x7f1178067fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1180005fd0 tx=0x7f1180005f40 comp rx=0 tx=0).stop 2023-09-10T00:13:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 msgr2=0x7f11941f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f11880b3040 tx=0x7f11880b06a0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 shutdown_connections 2023-09-10T00:13:38.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1178065b20 0x7f1178067fe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11940ceb70 0x7f119414e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11940b2570 0x7f11941e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 --2- 172.21.15.84:0/1258184602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f11940695b0 0x7f11941f5180 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 >> 172.21.15.84:0/1258184602 conn(0x7f11940cd570 msgr2=0x7f11940ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 shutdown_connections 2023-09-10T00:13:38.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.717+0000 7f119b030640 1 -- 172.21.15.84:0/1258184602 wait complete. 2023-09-10T00:13:38.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:38.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1219096265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 msgr2=0x7f36a80695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1219096265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a80695b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3690009840 tx=0x7f369001ef10 comp rx=0 tx=0).stop 2023-09-10T00:13:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1219096265 shutdown_connections 2023-09-10T00:13:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1219096265 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b6740 0x7f36a80b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1219096265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a80695b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1219096265 >> 172.21.15.84:0/1219096265 conn(0x7f36a80d0b30 msgr2=0x7f36a80d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:38.858 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1219096265 shutdown_connections 2023-09-10T00:13:38.859 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1219096265 wait complete. 2023-09-10T00:13:38.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 Processor -- start 2023-09-10T00:13:38.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- start start 2023-09-10T00:13:38.861 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b2af0 0x7f36a8145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a80b6740 0x7f36a814c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81586c0 con 0x7f36a815ad80 2023-09-10T00:13:38.862 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8146260 con 0x7f36a80b6740 2023-09-10T00:13:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.853+0000 7f36ae0cd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80b40c0 con 0x7f36a80b2af0 2023-09-10T00:13:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38312/0 (socket says 172.21.15.84:38312) 2023-09-10T00:13:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 -- 172.21.15.84:0/1745580704 learned_addr learned my addr 172.21.15.84:0/1745580704 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:38.863 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f369ffff640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a80b6740 0x7f36a814c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a77fe640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b2af0 0x7f36a8145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 -- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b2af0 msgr2=0x7f36a8145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b2af0 0x7f36a8145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 -- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a80b6740 msgr2=0x7f36a814c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:38.864 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a80b6740 0x7f36a814c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 -- 172.21.15.84:0/1745580704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900094a0 con 0x7f36a815ad80 2023-09-10T00:13:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a7fff640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36a00018e0 tx=0x7f36a00019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000aab0 con 0x7f36a815ad80 2023-09-10T00:13:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f36a000ad20 con 0x7f36a815ad80 2023-09-10T00:13:38.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a80b4380 con 0x7f36a815ad80 2023-09-10T00:13:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0012680 con 0x7f36a815ad80 2023-09-10T00:13:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a8146750 con 0x7f36a815ad80 2023-09-10T00:13:38.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8073390 con 0x7f36a815ad80 2023-09-10T00:13:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36a00127e0 con 0x7f36a815ad80 2023-09-10T00:13:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 0x7f3688067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f36a00840a0 con 0x7f36a815ad80 2023-09-10T00:13:38.867 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a77fe640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 0x7f3688067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.857+0000 7f36a77fe640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 0x7f3688067fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36900b2000 tx=0x7f369001d750 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:38.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:38.861+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f36a0051660 con 0x7f36a815ad80 2023-09-10T00:13:39.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.013+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f36a80cbc80 con 0x7f36a815ad80 2023-09-10T00:13:39.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.013+0000 7f36a4ff9640 1 -- 172.21.15.84:0/1745580704 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f36a0016020 con 0x7f36a815ad80 2023-09-10T00:13:39.018 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:39.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 msgr2=0x7f3688067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 0x7f3688067fe0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36900b2000 tx=0x7f369001d750 comp rx=0 tx=0).stop 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 msgr2=0x7f36a814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36a00018e0 tx=0x7f36a00019d0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 shutdown_connections 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3688065b20 0x7f3688067fe0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36a815ad80 0x7f36a814c9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a80b6740 0x7f36a814c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 --2- 172.21.15.84:0/1745580704 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36a80b2af0 0x7f36a8145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 >> 172.21.15.84:0/1745580704 conn(0x7f36a80d0b30 msgr2=0x7f36a80b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 shutdown_connections 2023-09-10T00:13:39.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.017+0000 7f36ae0cd640 1 -- 172.21.15.84:0/1745580704 wait complete. 2023-09-10T00:13:39.035 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:39.037 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:39.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:39.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/3131731696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc15c970 msgr2=0x7f15cc06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/3131731696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc15c970 0x7f15cc06b1c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009bc0 tx=0x7f15c401cb50 comp rx=0 tx=0).stop 2023-09-10T00:13:39.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/3131731696 shutdown_connections 2023-09-10T00:13:39.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/3131731696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc15c970 0x7f15cc06b1c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/3131731696 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc0cd080 0x7f15cc0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/3131731696 >> 172.21.15.84:0/3131731696 conn(0x7f15cc0ca240 msgr2=0x7f15cc0ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/3131731696 shutdown_connections 2023-09-10T00:13:39.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/3131731696 wait complete. 2023-09-10T00:13:39.200 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 Processor -- start 2023-09-10T00:13:39.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- start start 2023-09-10T00:13:39.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0cd080 0x7f15cc0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15c970 0x7f15cc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc14d280 con 0x7f15cc06cec0 2023-09-10T00:13:39.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0c1cd0 con 0x7f15cc0cd080 2023-09-10T00:13:39.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0c1fb0 con 0x7f15cc15c970 2023-09-10T00:13:39.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38332/0 (socket says 172.21.15.84:38332) 2023-09-10T00:13:39.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 -- 172.21.15.84:0/849857318 learned_addr learned my addr 172.21.15.84:0/849857318 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:39.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15c2ffd640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0cd080 0x7f15cc0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 -- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15c970 msgr2=0x7f15cc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15c970 0x7f15cc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 -- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0cd080 msgr2=0x7f15cc0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0cd080 0x7f15cc0c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 -- 172.21.15.84:0/849857318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4009820 con 0x7f15cc06cec0 2023-09-10T00:13:39.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15cb7fe640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c4d0 tx=0x7f15bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc005480 con 0x7f15cc06cec0 2023-09-10T00:13:39.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f15bc0036f0 con 0x7f15cc06cec0 2023-09-10T00:13:39.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc0c2290 con 0x7f15cc06cec0 2023-09-10T00:13:39.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003b00 con 0x7f15cc06cec0 2023-09-10T00:13:39.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.193+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc0c2850 con 0x7f15cc06cec0 2023-09-10T00:13:39.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc0c2a40 con 0x7f15cc06cec0 2023-09-10T00:13:39.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f15bc003c60 con 0x7f15cc06cec0 2023-09-10T00:13:39.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15c8ff9640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 0x7f15ac068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15bc082e60 con 0x7f15cc06cec0 2023-09-10T00:13:39.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15c2ffd640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 0x7f15ac068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.197+0000 7f15c2ffd640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 0x7f15ac068010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15cc153a40 tx=0x7f15b4005c90 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.201+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f15bc050540 con 0x7f15cc06cec0 2023-09-10T00:13:39.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.353+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15cc06bb90 con 0x7f15cc06cec0 2023-09-10T00:13:39.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.357+0000 7f15c8ff9640 1 -- 172.21.15.84:0/849857318 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f15bc017020 con 0x7f15cc06cec0 2023-09-10T00:13:39.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:39.363 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 msgr2=0x7f15ac068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 0x7f15ac068010 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f15cc153a40 tx=0x7f15b4005c90 comp rx=0 tx=0).stop 2023-09-10T00:13:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 msgr2=0x7f15cc14cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c4d0 tx=0x7f15bc00c990 comp rx=0 tx=0).stop 2023-09-10T00:13:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 shutdown_connections 2023-09-10T00:13:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f15ac065b50 0x7f15ac068010 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15cc15c970 0x7f15cc150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15cc0cd080 0x7f15cc0c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 --2- 172.21.15.84:0/849857318 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15cc06cec0 0x7f15cc14cd40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 >> 172.21.15.84:0/849857318 conn(0x7f15cc0ca240 msgr2=0x7f15cc06d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 shutdown_connections 2023-09-10T00:13:39.366 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.361+0000 7f15d1e2d640 1 -- 172.21.15.84:0/849857318 wait complete. 2023-09-10T00:13:39.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:39.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:39.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:13:39.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:13:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- 172.21.15.84:0/2863511119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00b2570 msgr2=0x7f8ab00b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/2863511119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00b2570 0x7f8ab00b2950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009840 tx=0x7f8aa001eff0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- 172.21.15.84:0/2863511119 shutdown_connections 2023-09-10T00:13:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/2863511119 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00ceb70 0x7f8ab00cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/2863511119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00b2570 0x7f8ab00b2950 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- 172.21.15.84:0/2863511119 >> 172.21.15.84:0/2863511119 conn(0x7f8ab00cd570 msgr2=0x7f8ab00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- 172.21.15.84:0/2863511119 shutdown_connections 2023-09-10T00:13:39.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- 172.21.15.84:0/2863511119 wait complete. 2023-09-10T00:13:39.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 Processor -- start 2023-09-10T00:13:39.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- start start 2023-09-10T00:13:39.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 0x7f8ab014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00b2570 0x7f8ab0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0158990 con 0x7f8ab00ceb70 2023-09-10T00:13:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab01f1610 con 0x7f8ab00695b0 2023-09-10T00:13:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8ab4df8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab014f530 con 0x7f8ab00b2570 2023-09-10T00:13:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38358/0 (socket says 172.21.15.84:38358) 2023-09-10T00:13:39.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 -- 172.21.15.84:0/1524537352 learned_addr learned my addr 172.21.15.84:0/1524537352 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aae59c640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 0x7f8ab014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 -- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00b2570 msgr2=0x7f8ab0159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aa7fff640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00b2570 0x7f8ab0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00b2570 0x7f8ab0159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 -- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 msgr2=0x7f8ab014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 0x7f8ab014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 -- 172.21.15.84:0/1524537352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00094a0 con 0x7f8ab00ceb70 2023-09-10T00:13:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aae59c640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 0x7f8ab014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.505+0000 7f8aaed9d640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800caa0 tx=0x7f8aa800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8003b80 con 0x7f8ab00ceb70 2023-09-10T00:13:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8aa8003dd0 con 0x7f8ab00ceb70 2023-09-10T00:13:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab01580f0 con 0x7f8ab00ceb70 2023-09-10T00:13:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004290 con 0x7f8ab00ceb70 2023-09-10T00:13:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01586b0 con 0x7f8ab00ceb70 2023-09-10T00:13:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab006c610 con 0x7f8ab00ceb70 2023-09-10T00:13:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8aa8004600 con 0x7f8ab00ceb70 2023-09-10T00:13:39.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 0x7f8a90067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aae59c640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 0x7f8a90067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8aa8083d50 con 0x7f8ab00ceb70 2023-09-10T00:13:39.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.509+0000 7f8aae59c640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 0x7f8a90067fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00b2000 tx=0x7f8aa001d830 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.513+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8aa8087030 con 0x7f8ab00ceb70 2023-09-10T00:13:39.658 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.653+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ab00cf4d0 con 0x7f8ab00ceb70 2023-09-10T00:13:39.659 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.653+0000 7f8aa6ffd640 1 -- 172.21.15.84:0/1524537352 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8aa8051250 con 0x7f8ab00ceb70 2023-09-10T00:13:39.659 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:39.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 msgr2=0x7f8a90067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 0x7f8a90067fe0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00b2000 tx=0x7f8aa001d830 comp rx=0 tx=0).stop 2023-09-10T00:13:39.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 msgr2=0x7f8ab0151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800caa0 tx=0x7f8aa800cb90 comp rx=0 tx=0).stop 2023-09-10T00:13:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 shutdown_connections 2023-09-10T00:13:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8a90065b20 0x7f8a90067fe0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ab00ceb70 0x7f8ab0151730 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ab00b2570 0x7f8ab0159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 --2- 172.21.15.84:0/1524537352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab00695b0 0x7f8ab014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 >> 172.21.15.84:0/1524537352 conn(0x7f8ab00cd570 msgr2=0x7f8ab00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 shutdown_connections 2023-09-10T00:13:39.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.657+0000 7f8ab4df8640 1 -- 172.21.15.84:0/1524537352 wait complete. 2023-09-10T00:13:39.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/1863027049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 msgr2=0x7fe0e000caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 --2- 172.21.15.84:0/1863027049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0e000caa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec006fd0 tx=0x7fe0ec01ca00 comp rx=0 tx=0).stop 2023-09-10T00:13:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/1863027049 shutdown_connections 2023-09-10T00:13:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 --2- 172.21.15.84:0/1863027049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0e000caa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/1863027049 >> 172.21.15.84:0/1863027049 conn(0x7fe0f40aec00 msgr2=0x7fe0f40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.845 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/1863027049 shutdown_connections 2023-09-10T00:13:39.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/1863027049 wait complete. 2023-09-10T00:13:39.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 Processor -- start 2023-09-10T00:13:39.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- start start 2023-09-10T00:13:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0f4154830 0x7fe0f4137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f4152fb0 0x7fe0f4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41543a0 con 0x7fe0e00062a0 2023-09-10T00:13:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4153790 con 0x7fe0f4152fb0 2023-09-10T00:13:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4153a70 con 0x7fe0f4154830 2023-09-10T00:13:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38384/0 (socket says 172.21.15.84:38384) 2023-09-10T00:13:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 -- 172.21.15.84:0/2955534062 learned_addr learned my addr 172.21.15.84:0/2955534062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa8cd640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f4152fb0 0x7fe0f4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0f98cb640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0f4154830 0x7fe0f4137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 -- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0f4154830 msgr2=0x7fe0f4137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0f4154830 0x7fe0f4137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 -- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f4152fb0 msgr2=0x7fe0f4155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f4152fb0 0x7fe0f4155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 -- 172.21.15.84:0/2955534062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4153d50 con 0x7fe0e00062a0 2023-09-10T00:13:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fa0cc640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e760 tx=0x7fe0f000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000cc60 con 0x7fe0e00062a0 2023-09-10T00:13:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe0f000ee70 con 0x7fe0e00062a0 2023-09-10T00:13:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4154030 con 0x7fe0e00062a0 2023-09-10T00:13:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00116b0 con 0x7fe0e00062a0 2023-09-10T00:13:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.841+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4156420 con 0x7fe0e00062a0 2023-09-10T00:13:39.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f40cb930 con 0x7fe0e00062a0 2023-09-10T00:13:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe0f0011810 con 0x7fe0e00062a0 2023-09-10T00:13:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0eaffd640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 0x7fe0d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe0f0084360 con 0x7fe0e00062a0 2023-09-10T00:13:39.854 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0f98cb640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 0x7fe0d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:39.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.845+0000 7fe0f98cb640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 0x7fe0d8067fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0f413a9f0 tx=0x7fe0e4001000 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:39.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.849+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe0f00517e0 con 0x7fe0e00062a0 2023-09-10T00:13:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.989+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0f4070d10 con 0x7fe0e00062a0 2023-09-10T00:13:39.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.989+0000 7fe0eaffd640 1 -- 172.21.15.84:0/2955534062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0f0054e00 con 0x7fe0e00062a0 2023-09-10T00:13:39.995 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 msgr2=0x7fe0d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 0x7fe0d8067fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0f413a9f0 tx=0x7fe0e4001000 comp rx=0 tx=0).stop 2023-09-10T00:13:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 msgr2=0x7fe0f414dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e760 tx=0x7fe0f000ec20 comp rx=0 tx=0).stop 2023-09-10T00:13:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 shutdown_connections 2023-09-10T00:13:39.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe0d8065b20 0x7fe0d8067fe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f4152fb0 0x7fe0f4155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0f4154830 0x7fe0f4137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 --2- 172.21.15.84:0/2955534062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0e00062a0 0x7fe0f414dc60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 >> 172.21.15.84:0/2955534062 conn(0x7fe0f40aec00 msgr2=0x7fe0f40ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 shutdown_connections 2023-09-10T00:13:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:39.993+0000 7fe0fc330640 1 -- 172.21.15.84:0/2955534062 wait complete. 2023-09-10T00:13:40.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:40.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- 172.21.15.84:0/1518591153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e80cbd60 msgr2=0x7f89e81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.184 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 --2- 172.21.15.84:0/1518591153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e80cbd60 0x7f89e81591a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009c80 tx=0x7f89e001cd80 comp rx=0 tx=0).stop 2023-09-10T00:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- 172.21.15.84:0/1518591153 shutdown_connections 2023-09-10T00:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 --2- 172.21.15.84:0/1518591153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e80cbd60 0x7f89e81591a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 --2- 172.21.15.84:0/1518591153 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- 172.21.15.84:0/1518591153 >> 172.21.15.84:0/1518591153 conn(0x7f89e80aec00 msgr2=0x7f89e80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.185 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- 172.21.15.84:0/1518591153 shutdown_connections 2023-09-10T00:13:40.186 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- 172.21.15.84:0/1518591153 wait complete. 2023-09-10T00:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 Processor -- start 2023-09-10T00:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.125+0000 7f89eef33640 1 -- start start 2023-09-10T00:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.189 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89e80cbd60 0x7f89e8162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8162ca0 con 0x7f89e806fa60 2023-09-10T00:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80c9980 con 0x7f89e80cbd60 2023-09-10T00:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80c96a0 con 0x7f89e80ca550 2023-09-10T00:13:40.190 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49096/0 (socket says 172.21.15.84:49096) 2023-09-10T00:13:40.191 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 -- 172.21.15.84:0/4049101366 learned_addr learned my addr 172.21.15.84:0/4049101366 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ed4d0640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89e80cbd60 0x7f89e8162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e7fff640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 -- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 msgr2=0x7f89e80ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 -- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89e80cbd60 msgr2=0x7f89e8162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89e80cbd60 0x7f89e8162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 -- 172.21.15.84:0/4049101366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00098e0 con 0x7f89e806fa60 2023-09-10T00:13:40.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e7fff640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:40.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89ecccf640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c530 tx=0x7f89d800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8005220 con 0x7f89e806fa60 2023-09-10T00:13:40.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f89d8005470 con 0x7f89e806fa60 2023-09-10T00:13:40.194 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e80ac3a0 con 0x7f89e806fa60 2023-09-10T00:13:40.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8007290 con 0x7f89e806fa60 2023-09-10T00:13:40.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e80ac960 con 0x7f89e806fa60 2023-09-10T00:13:40.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e80713a0 con 0x7f89e806fa60 2023-09-10T00:13:40.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f89d80073f0 con 0x7f89e806fa60 2023-09-10T00:13:40.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 0x7f89d4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89d8083270 con 0x7f89e806fa60 2023-09-10T00:13:40.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e7fff640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 0x7f89d4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.129+0000 7f89e7fff640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 0x7f89d4067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f89dc005fd0 tx=0x7f89dc005e60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.133+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f89d8050800 con 0x7f89e806fa60 2023-09-10T00:13:40.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.273+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89e8073400 con 0x7f89e806fa60 2023-09-10T00:13:40.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.273+0000 7f89e57fa640 1 -- 172.21.15.84:0/4049101366 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89d8053e20 con 0x7f89e806fa60 2023-09-10T00:13:40.278 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 msgr2=0x7f89d4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 0x7f89d4067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f89dc005fd0 tx=0x7f89dc005e60 comp rx=0 tx=0).stop 2023-09-10T00:13:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 msgr2=0x7f89e80c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c530 tx=0x7f89d800c9f0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 shutdown_connections 2023-09-10T00:13:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f89d4065b20 0x7f89d4067fe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89e80cbd60 0x7f89e8162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f89e80ca550 0x7f89e80ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 --2- 172.21.15.84:0/4049101366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89e806fa60 0x7f89e80c9000 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 >> 172.21.15.84:0/4049101366 conn(0x7f89e80aec00 msgr2=0x7f89e813eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 shutdown_connections 2023-09-10T00:13:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.277+0000 7f89eef33640 1 -- 172.21.15.84:0/4049101366 wait complete. 2023-09-10T00:13:40.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:40.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- 172.21.15.84:0/4269778132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400052b0 msgr2=0x7f9c4000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/4269778132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400052b0 0x7f9c4000b990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c009e00 tx=0x7f9c4c01d150 comp rx=0 tx=0).stop 2023-09-10T00:13:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- 172.21.15.84:0/4269778132 shutdown_connections 2023-09-10T00:13:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/4269778132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c400052b0 0x7f9c4000b990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- 172.21.15.84:0/4269778132 >> 172.21.15.84:0/4269778132 conn(0x7f9c540cb350 msgr2=0x7f9c540cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- 172.21.15.84:0/4269778132 shutdown_connections 2023-09-10T00:13:40.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- 172.21.15.84:0/4269778132 wait complete. 2023-09-10T00:13:40.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 Processor -- start 2023-09-10T00:13:40.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- start start 2023-09-10T00:13:40.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c400052b0 0x7f9c54156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c540ace40 0x7f9c541e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54157080 con 0x7f9c541f2140 2023-09-10T00:13:40.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5406aff0 con 0x7f9c400052b0 2023-09-10T00:13:40.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c5b37c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5406b2d0 con 0x7f9c540ace40 2023-09-10T00:13:40.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c58917640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c58917640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49112/0 (socket says 172.21.15.84:49112) 2023-09-10T00:13:40.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c58917640 1 -- 172.21.15.84:0/41149547 learned_addr learned my addr 172.21.15.84:0/41149547 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:40.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.413+0000 7f9c59919640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c540ace40 0x7f9c541e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c59118640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c400052b0 0x7f9c54156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 -- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c540ace40 msgr2=0x7f9c541e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c540ace40 0x7f9c541e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 -- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c400052b0 msgr2=0x7f9c54156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.424 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c400052b0 0x7f9c54156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 -- 172.21.15.84:0/41149547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5406b5b0 con 0x7f9c541f2140 2023-09-10T00:13:40.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c58917640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9c50000fc0 tx=0x7f9c5000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c500118a0 con 0x7f9c541f2140 2023-09-10T00:13:40.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9c50011af0 con 0x7f9c541f2140 2023-09-10T00:13:40.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5406b890 con 0x7f9c541f2140 2023-09-10T00:13:40.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011ea0 con 0x7f9c541f2140 2023-09-10T00:13:40.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c540c2940 con 0x7f9c541f2140 2023-09-10T00:13:40.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5406f210 con 0x7f9c541f2140 2023-09-10T00:13:40.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9c50012470 con 0x7f9c541f2140 2023-09-10T00:13:40.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 0x7f9c38067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c50086d60 con 0x7f9c541f2140 2023-09-10T00:13:40.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c59118640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 0x7f9c38067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.417+0000 7f9c59118640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 0x7f9c38067fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c5406e850 tx=0x7f9c48009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.421+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9c500542f0 con 0x7f9c541f2140 2023-09-10T00:13:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.569+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9c540b3ec0 con 0x7f9c541f2140 2023-09-10T00:13:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c45ffb640 1 -- 172.21.15.84:0/41149547 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9c50057910 con 0x7f9c541f2140 2023-09-10T00:13:40.576 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 msgr2=0x7f9c38067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 0x7f9c38067fe0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9c5406e850 tx=0x7f9c48009040 comp rx=0 tx=0).stop 2023-09-10T00:13:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 msgr2=0x7f9c540c2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9c50000fc0 tx=0x7f9c5000fa30 comp rx=0 tx=0).stop 2023-09-10T00:13:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 shutdown_connections 2023-09-10T00:13:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9c38065b20 0x7f9c38067fe0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9c540ace40 0x7f9c541e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9c541f2140 0x7f9c540c2400 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 --2- 172.21.15.84:0/41149547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c400052b0 0x7f9c54156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 >> 172.21.15.84:0/41149547 conn(0x7f9c540cb350 msgr2=0x7f9c540c1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 shutdown_connections 2023-09-10T00:13:40.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.573+0000 7f9c5b37c640 1 -- 172.21.15.84:0/41149547 wait complete. 2023-09-10T00:13:40.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:40.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- 172.21.15.84:0/1612591211 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc158980 msgr2=0x7f52dc0b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 --2- 172.21.15.84:0/1612591211 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc158980 0x7f52dc0b0c30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009cb0 tx=0x7f52d401cd50 comp rx=0 tx=0).stop 2023-09-10T00:13:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- 172.21.15.84:0/1612591211 shutdown_connections 2023-09-10T00:13:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 --2- 172.21.15.84:0/1612591211 >> v2:172.21.15.100:3300/0 conn(0x7f52dc0ce420 0x7f52dc0b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 --2- 172.21.15.84:0/1612591211 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc158980 0x7f52dc0b0c30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- 172.21.15.84:0/1612591211 >> 172.21.15.84:0/1612591211 conn(0x7f52dc0ceca0 msgr2=0x7f52dc0cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- 172.21.15.84:0/1612591211 shutdown_connections 2023-09-10T00:13:40.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- 172.21.15.84:0/1612591211 wait complete. 2023-09-10T00:13:40.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 Processor -- start 2023-09-10T00:13:40.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.705+0000 7f52e262f640 1 -- start start 2023-09-10T00:13:40.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 0x7f52dc152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc0ce420 0x7f52dc0c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc152f40 con 0x7f52dc158980 2023-09-10T00:13:40.716 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc148580 con 0x7f52dc0b1860 2023-09-10T00:13:40.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc0c3610 con 0x7f52dc0ce420 2023-09-10T00:13:40.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49118/0 (socket says 172.21.15.84:49118) 2023-09-10T00:13:40.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 -- 172.21.15.84:0/3771165790 learned_addr learned my addr 172.21.15.84:0/3771165790 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52db7fe640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc0ce420 0x7f52dc0c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52dbfff640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 0x7f52dc152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 -- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc0ce420 msgr2=0x7f52dc0c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc0ce420 0x7f52dc0c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 -- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 msgr2=0x7f52dc152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 0x7f52dc152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 -- 172.21.15.84:0/3771165790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40098e0 con 0x7f52dc158980 2023-09-10T00:13:40.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52dbfff640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 0x7f52dc152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:40.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e0bcc640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e970 tx=0x7f52cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.719 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0096d0 con 0x7f52dc158980 2023-09-10T00:13:40.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52cc00ccc0 con 0x7f52dc158980 2023-09-10T00:13:40.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc0c38f0 con 0x7f52dc158980 2023-09-10T00:13:40.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc005280 con 0x7f52dc158980 2023-09-10T00:13:40.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc0c3eb0 con 0x7f52dc158980 2023-09-10T00:13:40.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc150ca0 con 0x7f52dc158980 2023-09-10T00:13:40.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f52cc0053e0 con 0x7f52dc158980 2023-09-10T00:13:40.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 0x7f52bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:40.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52cc014070 con 0x7f52dc158980 2023-09-10T00:13:40.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52dbfff640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 0x7f52bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:40.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.709+0000 7f52dbfff640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 0x7f52bc067fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f52d40af000 tx=0x7f52d401b590 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:40.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.713+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f52cc0518c0 con 0x7f52dc158980 2023-09-10T00:13:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.865+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52dc073390 con 0x7f52dc158980 2023-09-10T00:13:40.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.865+0000 7f52d8ff9640 1 -- 172.21.15.84:0/3771165790 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52cc054ee0 con 0x7f52dc158980 2023-09-10T00:13:40.871 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:40.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 msgr2=0x7f52bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 0x7f52bc067fe0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f52d40af000 tx=0x7f52d401b590 comp rx=0 tx=0).stop 2023-09-10T00:13:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 msgr2=0x7f52dc0c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00e970 tx=0x7f52cc00ee30 comp rx=0 tx=0).stop 2023-09-10T00:13:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 shutdown_connections 2023-09-10T00:13:40.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f52bc065b20 0x7f52bc067fe0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52dc158980 0x7f52dc0c6680 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52dc0ce420 0x7f52dc0c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 --2- 172.21.15.84:0/3771165790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52dc0b1860 0x7f52dc152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 >> 172.21.15.84:0/3771165790 conn(0x7f52dc0ceca0 msgr2=0x7f52dc0c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:40.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 shutdown_connections 2023-09-10T00:13:40.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:40.869+0000 7f52e262f640 1 -- 172.21.15.84:0/3771165790 wait complete. 2023-09-10T00:13:40.887 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-09-10T00:13:40.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:40.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-10T00:13:40.899 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:40.900 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:13:40.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:40.901 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-10T00:13:40.949 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:40.950 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:40.958 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:40.959 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:41.008 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/1884141221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c1577f0 msgr2=0x7fce5c0ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- 172.21.15.84:0/1884141221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c1577f0 0x7fce5c0ad970 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fce5c070b30 tx=0x7fce5801c7b0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/1884141221 shutdown_connections 2023-09-10T00:13:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- 172.21.15.84:0/1884141221 >> v2:172.21.15.100:3300/0 conn(0x7fce5c06fad0 0x7fce5c06ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- 172.21.15.84:0/1884141221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c1577f0 0x7fce5c0ad970 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/1884141221 >> 172.21.15.84:0/1884141221 conn(0x7fce5c0cca70 msgr2=0x7fce5c0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/1884141221 shutdown_connections 2023-09-10T00:13:41.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/1884141221 wait complete. 2023-09-10T00:13:41.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 Processor -- start 2023-09-10T00:13:41.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- start start 2023-09-10T00:13:41.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce5c06fad0 0x7fce5c1637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c1577f0 0x7fce5c14eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c4f40 con 0x7fce5c15b460 2023-09-10T00:13:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c4960 con 0x7fce5c1577f0 2023-09-10T00:13:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c6040 con 0x7fce5c06fad0 2023-09-10T00:13:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49146/0 (socket says 172.21.15.84:49146) 2023-09-10T00:13:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 -- 172.21.15.84:0/140469172 learned_addr learned my addr 172.21.15.84:0/140469172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce60d54640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce5c06fad0 0x7fce5c1637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce53fff640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c1577f0 0x7fce5c14eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 -- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce5c06fad0 msgr2=0x7fce5c1637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce5c06fad0 0x7fce5c1637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 -- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c1577f0 msgr2=0x7fce5c14eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c1577f0 0x7fce5c14eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 -- 172.21.15.84:0/140469172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580094a0 con 0x7fce5c15b460 2023-09-10T00:13:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce61555640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cb70 tx=0x7fce5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5400aa50 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce5400aca0 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c163ea0 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54012680 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c14f060 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.125+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c0c50f0 con 0x7fce5c15b460 2023-09-10T00:13:41.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.129+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fce5401b400 con 0x7fce5c15b460 2023-09-10T00:13:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.129+0000 7fce517fa640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 0x7fce48068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.129+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce54083cb0 con 0x7fce5c15b460 2023-09-10T00:13:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.129+0000 7fce60d54640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 0x7fce48068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.129+0000 7fce60d54640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 0x7fce48068010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce580af000 tx=0x7fce5801aff0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.133+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fce5c0c50f0 con 0x7fce5c15b460 2023-09-10T00:13:41.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.277+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce5c0c50f0 con 0x7fce5c15b460 2023-09-10T00:13:41.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce517fa640 1 -- 172.21.15.84:0/140469172 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fce5c0c50f0 con 0x7fce5c15b460 2023-09-10T00:13:41.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:41.285 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:41.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 msgr2=0x7fce48068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 0x7fce48068010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce580af000 tx=0x7fce5801aff0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 msgr2=0x7fce5c0c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cb70 tx=0x7fce5400cc60 comp rx=0 tx=0).stop 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 shutdown_connections 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fce48065b50 0x7fce48068010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fce5c15b460 0x7fce5c0c53d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce5c1577f0 0x7fce5c14eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 --2- 172.21.15.84:0/140469172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fce5c06fad0 0x7fce5c1637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 >> 172.21.15.84:0/140469172 conn(0x7fce5c0cca70 msgr2=0x7fce5c06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 shutdown_connections 2023-09-10T00:13:41.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.281+0000 7fce62fb8640 1 -- 172.21.15.84:0/140469172 wait complete. 2023-09-10T00:13:41.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:41.303 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- 172.21.15.84:0/2035652309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad2415ad20 msgr2=0x7fad2415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- 172.21.15.84:0/2035652309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad2415ad20 0x7fad2415bd20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fad240cab00 tx=0x7fad1401c810 comp rx=0 tx=0).stop 2023-09-10T00:13:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- 172.21.15.84:0/2035652309 shutdown_connections 2023-09-10T00:13:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- 172.21.15.84:0/2035652309 >> v2:172.21.15.100:3300/0 conn(0x7fad240ca520 0x7fad240cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- 172.21.15.84:0/2035652309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad2415ad20 0x7fad2415bd20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- 172.21.15.84:0/2035652309 >> 172.21.15.84:0/2035652309 conn(0x7fad240c9a00 msgr2=0x7fad240c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- 172.21.15.84:0/2035652309 shutdown_connections 2023-09-10T00:13:41.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- 172.21.15.84:0/2035652309 wait complete. 2023-09-10T00:13:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 Processor -- start 2023-09-10T00:13:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- start start 2023-09-10T00:13:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad240ca520 0x7fad24142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.438 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 0x7fad240ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad241428e0 con 0x7fad240cb3c0 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad24155260 con 0x7fad240ca520 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad29264640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad24155540 con 0x7fad2415ad20 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49164/0 (socket says 172.21.15.84:49164) 2023-09-10T00:13:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad1bfff640 1 -- 172.21.15.84:0/1135907815 learned_addr learned my addr 172.21.15.84:0/1135907815 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:41.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad237fe640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 0x7fad240ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.429+0000 7fad22ffd640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad240ca520 0x7fad24142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 -- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 msgr2=0x7fad240ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 0x7fad240ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 -- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad240ca520 msgr2=0x7fad24142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad240ca520 0x7fad24142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 -- 172.21.15.84:0/1135907815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14009500 con 0x7fad240cb3c0 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad237fe640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 0x7fad240ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1bfff640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d770 tx=0x7fad0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c004440 con 0x7fad240cb3c0 2023-09-10T00:13:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fad0c009820 con 0x7fad240cb3c0 2023-09-10T00:13:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad24155820 con 0x7fad240cb3c0 2023-09-10T00:13:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c009c10 con 0x7fad240cb3c0 2023-09-10T00:13:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad24142550 con 0x7fad240cb3c0 2023-09-10T00:13:41.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad24155d40 con 0x7fad240cb3c0 2023-09-10T00:13:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fad0c003600 con 0x7fad240cb3c0 2023-09-10T00:13:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 0x7fad04067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fad0c083de0 con 0x7fad240cb3c0 2023-09-10T00:13:41.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad22ffd640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 0x7fad04067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.433+0000 7fad22ffd640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 0x7fad04067fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad140af000 tx=0x7fad1401b050 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.437+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fad24155d40 con 0x7fad240cb3c0 2023-09-10T00:13:41.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad24155d40 con 0x7fad240cb3c0 2023-09-10T00:13:41.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad1b7fe640 1 -- 172.21.15.84:0/1135907815 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad24155d40 con 0x7fad240cb3c0 2023-09-10T00:13:41.593 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 msgr2=0x7fad04067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 0x7fad04067fe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fad140af000 tx=0x7fad1401b050 comp rx=0 tx=0).stop 2023-09-10T00:13:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 msgr2=0x7fad240ab040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d770 tx=0x7fad0c00dc30 comp rx=0 tx=0).stop 2023-09-10T00:13:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 shutdown_connections 2023-09-10T00:13:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fad04065b20 0x7fad04067fe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad2415ad20 0x7fad240ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad240cb3c0 0x7fad240ab040 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 --2- 172.21.15.84:0/1135907815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad240ca520 0x7fad24142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 >> 172.21.15.84:0/1135907815 conn(0x7fad240c9a00 msgr2=0x7fad24143e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 shutdown_connections 2023-09-10T00:13:41.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.589+0000 7fad29264640 1 -- 172.21.15.84:0/1135907815 wait complete. 2023-09-10T00:13:41.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:41.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- 172.21.15.84:0/3535633840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0cbd60 msgr2=0x7f3e6c1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3535633840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0cbd60 0x7f3e6c1591a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009c80 tx=0x7f3e6401cd50 comp rx=0 tx=0).stop 2023-09-10T00:13:41.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- 172.21.15.84:0/3535633840 shutdown_connections 2023-09-10T00:13:41.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3535633840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0cbd60 0x7f3e6c1591a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3535633840 >> v2:172.21.15.100:3300/0 conn(0x7f3e6c06fa60 0x7f3e6c0ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- 172.21.15.84:0/3535633840 >> 172.21.15.84:0/3535633840 conn(0x7f3e6c0aec00 msgr2=0x7f3e6c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- 172.21.15.84:0/3535633840 shutdown_connections 2023-09-10T00:13:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- 172.21.15.84:0/3535633840 wait complete. 2023-09-10T00:13:41.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 Processor -- start 2023-09-10T00:13:41.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- start start 2023-09-10T00:13:41.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0af770 0x7f3e6c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0cbd60 0x7f3e6c1359d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0ac320 con 0x7f3e6c06fa60 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c1565c0 con 0x7f3e6c0cbd60 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e73a86640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c13df50 con 0x7f3e6c0af770 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e71822640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e71822640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49180/0 (socket says 172.21.15.84:49180) 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.721+0000 7f3e71822640 1 -- 172.21.15.84:0/3371649392 learned_addr learned my addr 172.21.15.84:0/3371649392 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:41.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71021640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0af770 0x7f3e6c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e72023640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0cbd60 0x7f3e6c1359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 -- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0af770 msgr2=0x7f3e6c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0af770 0x7f3e6c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 -- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0cbd60 msgr2=0x7f3e6c1359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0cbd60 0x7f3e6c1359d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 -- 172.21.15.84:0/3371649392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640098e0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71822640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800e9f0 tx=0x7f3e6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68009710 con 0x7f3e6c06fa60 2023-09-10T00:13:41.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e6800ce70 con 0x7f3e6c06fa60 2023-09-10T00:13:41.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c13e1f0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68010690 con 0x7f3e6c06fa60 2023-09-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c13e490 con 0x7f3e6c06fa60 2023-09-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c0713a0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e680107f0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 0x7f3e50067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:41.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e68014070 con 0x7f3e6c06fa60 2023-09-10T00:13:41.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71021640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 0x7f3e50067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:41.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.725+0000 7f3e71021640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 0x7f3e50067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c15ae00 tx=0x7f3e5c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:41.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.729+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e6804fdb0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e6c0cc2d0 con 0x7f3e6c06fa60 2023-09-10T00:13:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e627fc640 1 -- 172.21.15.84:0/3371649392 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e68055370 con 0x7f3e6c06fa60 2023-09-10T00:13:41.874 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 msgr2=0x7f3e50067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 0x7f3e50067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c15ae00 tx=0x7f3e5c009040 comp rx=0 tx=0).stop 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 msgr2=0x7f3e6c13c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800e9f0 tx=0x7f3e6800eeb0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 shutdown_connections 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e50065b20 0x7f3e50067fe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e6c0cbd60 0x7f3e6c1359d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e6c0af770 0x7f3e6c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 --2- 172.21.15.84:0/3371649392 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e6c06fa60 0x7f3e6c13c4d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 >> 172.21.15.84:0/3371649392 conn(0x7f3e6c0aec00 msgr2=0x7f3e6c15b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.869+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 shutdown_connections 2023-09-10T00:13:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:41.873+0000 7f3e73a86640 1 -- 172.21.15.84:0/3371649392 wait complete. 2023-09-10T00:13:41.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:42.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 -- 172.21.15.84:0/1997959050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 msgr2=0x7fbe3c0cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 --2- 172.21.15.84:0/1997959050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c0cefd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0cb2f0 tx=0x7fbe3001f050 comp rx=0 tx=0).stop 2023-09-10T00:13:42.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 -- 172.21.15.84:0/1997959050 shutdown_connections 2023-09-10T00:13:42.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 --2- 172.21.15.84:0/1997959050 >> v2:172.21.15.100:3300/0 conn(0x7fbe3c0b3c20 0x7fbe3c0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 --2- 172.21.15.84:0/1997959050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c0cefd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 -- 172.21.15.84:0/1997959050 >> 172.21.15.84:0/1997959050 conn(0x7fbe3c0cd570 msgr2=0x7fbe3c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 -- 172.21.15.84:0/1997959050 shutdown_connections 2023-09-10T00:13:42.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.001+0000 7fbe42573640 1 -- 172.21.15.84:0/1997959050 wait complete. 2023-09-10T00:13:42.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 Processor -- start 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- start start 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe3c0b2570 0x7fbe3c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe3c0b3c20 0x7fbe3c1e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c14f200 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1e1ee0 con 0x7fbe3c0b2570 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c1e2370 con 0x7fbe3c0b3c20 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49204/0 (socket says 172.21.15.84:49204) 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 -- 172.21.15.84:0/802413005 learned_addr learned my addr 172.21.15.84:0/802413005 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe3b7fe640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe3c0b3c20 0x7fbe3c1e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe3bfff640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe3c0b2570 0x7fbe3c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 -- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe3c0b3c20 msgr2=0x7fbe3c1e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe3c0b3c20 0x7fbe3c1e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 -- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe3c0b2570 msgr2=0x7fbe3c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe3c0b2570 0x7fbe3c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 -- 172.21.15.84:0/802413005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009560 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe40b10640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b430 tx=0x7fbe3400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34011830 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe34011a80 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c1e12d0 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34011e90 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c1e1890 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.005+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c1e2050 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.009+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbe3401a400 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.009+0000 7fbe38ff9640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 0x7fbe28067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.009+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe340839b0 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.009+0000 7fbe3bfff640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 0x7fbe28067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.009+0000 7fbe3bfff640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 0x7fbe28067fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009f60 tx=0x7fbe2c0094f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.013+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbe34050f40 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe3c06c610 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe38ff9640 1 -- 172.21.15.84:0/802413005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe340150a0 con 0x7fbe3c0ceb70 2023-09-10T00:13:42.157 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:42.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 msgr2=0x7fbe28067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 0x7fbe28067fe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009f60 tx=0x7fbe2c0094f0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 msgr2=0x7fbe3c1e6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400b430 tx=0x7fbe3400b8f0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 shutdown_connections 2023-09-10T00:13:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe28065b20 0x7fbe28067fe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe3c0ceb70 0x7fbe3c1e6990 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe3c0b3c20 0x7fbe3c1e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 --2- 172.21.15.84:0/802413005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe3c0b2570 0x7fbe3c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.153+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 >> 172.21.15.84:0/802413005 conn(0x7fbe3c0cd570 msgr2=0x7fbe3c1520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.157+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 shutdown_connections 2023-09-10T00:13:42.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.157+0000 7fbe42573640 1 -- 172.21.15.84:0/802413005 wait complete. 2023-09-10T00:13:42.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 -- 172.21.15.84:0/1596685811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 msgr2=0x7fcfa406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/1596685811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa406fe40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009900 tx=0x7fcf9801c860 comp rx=0 tx=0).stop 2023-09-10T00:13:42.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 -- 172.21.15.84:0/1596685811 shutdown_connections 2023-09-10T00:13:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/1596685811 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa406fe40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/1596685811 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 0x7fcfa40ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 -- 172.21.15.84:0/1596685811 >> 172.21.15.84:0/1596685811 conn(0x7fcfa40aec00 msgr2=0x7fcfa40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 -- 172.21.15.84:0/1596685811 shutdown_connections 2023-09-10T00:13:42.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.293+0000 7fcfa88e7640 1 -- 172.21.15.84:0/1596685811 wait complete. 2023-09-10T00:13:42.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 Processor -- start 2023-09-10T00:13:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- start start 2023-09-10T00:13:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 0x7fcfa413d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa40cbd60 0x7fcfa406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4137240 con 0x7fcfa40af770 2023-09-10T00:13:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4138f60 con 0x7fcfa40cbd60 2023-09-10T00:13:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4136220 con 0x7fcfa406fa60 2023-09-10T00:13:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49222/0 (socket says 172.21.15.84:49222) 2023-09-10T00:13:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 -- 172.21.15.84:0/854863776 learned_addr learned my addr 172.21.15.84:0/854863776 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa259c640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 0x7fcfa413d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 -- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 msgr2=0x7fcfa413d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa2d9d640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa40cbd60 0x7fcfa406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 0x7fcfa413d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 -- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa40cbd60 msgr2=0x7fcfa406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa40cbd60 0x7fcfa406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 -- 172.21.15.84:0/854863776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf98009560 con 0x7fcfa40af770 2023-09-10T00:13:42.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa1d9b640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf9801a490 tx=0x7fcf980a5840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980ba070 con 0x7fcfa40af770 2023-09-10T00:13:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf980051e0 con 0x7fcfa40af770 2023-09-10T00:13:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa4136500 con 0x7fcfa40af770 2023-09-10T00:13:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980055d0 con 0x7fcfa40af770 2023-09-10T00:13:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa406d190 con 0x7fcfa40af770 2023-09-10T00:13:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.297+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40713a0 con 0x7fcfa40af770 2023-09-10T00:13:42.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.301+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcf980b4070 con 0x7fcfa40af770 2023-09-10T00:13:42.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.301+0000 7fcf92ffd640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 0x7fcf84067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.301+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf9811e580 con 0x7fcfa40af770 2023-09-10T00:13:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.301+0000 7fcfa259c640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 0x7fcf84067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.301+0000 7fcfa259c640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 0x7fcf84067fe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400ba40 tx=0x7fcf94005cd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.305+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcf980ebb60 con 0x7fcfa40af770 2023-09-10T00:13:42.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.441+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcfa41369b0 con 0x7fcfa40af770 2023-09-10T00:13:42.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcf92ffd640 1 -- 172.21.15.84:0/854863776 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcf980ef180 con 0x7fcfa40af770 2023-09-10T00:13:42.448 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 msgr2=0x7fcf84067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 0x7fcf84067fe0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400ba40 tx=0x7fcf94005cd0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 msgr2=0x7fcfa4136d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcf9801a490 tx=0x7fcf980a5840 comp rx=0 tx=0).stop 2023-09-10T00:13:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 shutdown_connections 2023-09-10T00:13:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcf84065b20 0x7fcf84067fe0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa40cbd60 0x7fcfa406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcfa40af770 0x7fcfa4136d00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 --2- 172.21.15.84:0/854863776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcfa406fa60 0x7fcfa413d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 >> 172.21.15.84:0/854863776 conn(0x7fcfa40aec00 msgr2=0x7fcfa40b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 shutdown_connections 2023-09-10T00:13:42.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.445+0000 7fcfa88e7640 1 -- 172.21.15.84:0/854863776 wait complete. 2023-09-10T00:13:42.465 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:42.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- 172.21.15.84:0/3733611776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0047d0 msgr2=0x7f84bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 --2- 172.21.15.84:0/3733611776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0047d0 0x7f84bc004c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f84c800c260 tx=0x7f84c801cf80 comp rx=0 tx=0).stop 2023-09-10T00:13:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- 172.21.15.84:0/3733611776 shutdown_connections 2023-09-10T00:13:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 --2- 172.21.15.84:0/3733611776 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84bc0047d0 0x7f84bc004c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- 172.21.15.84:0/3733611776 >> 172.21.15.84:0/3733611776 conn(0x7f84d40ca240 msgr2=0x7f84d40ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- 172.21.15.84:0/3733611776 shutdown_connections 2023-09-10T00:13:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- 172.21.15.84:0/3733611776 wait complete. 2023-09-10T00:13:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 Processor -- start 2023-09-10T00:13:42.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.585+0000 7f84db238640 1 -- start start 2023-09-10T00:13:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 0x7f84d41549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 0x7f84d406a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 0x7f84d41f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4155ac0 con 0x7f84d41f4d00 2023-09-10T00:13:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4154ee0 con 0x7f84bc0047d0 2023-09-10T00:13:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4157910 con 0x7f84d41571a0 2023-09-10T00:13:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 0x7f84d41f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 0x7f84d406a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 0x7f84d406a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:45434/0 (socket says 172.21.15.84:45434) 2023-09-10T00:13:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d3fff640 1 -- 172.21.15.84:0/4007129489 learned_addr learned my addr 172.21.15.84:0/4007129489 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d8fd4640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 0x7f84d41549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 -- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 msgr2=0x7f84d406a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 0x7f84d406a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 -- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 msgr2=0x7f84d41549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 0x7f84d41549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 -- 172.21.15.84:0/4007129489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d41f56c0 con 0x7f84d41f4d00 2023-09-10T00:13:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d8fd4640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 0x7f84d41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:42.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d97d5640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 0x7f84d41f5180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ad230 tx=0x7f84cc00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003d90 con 0x7f84d41f4d00 2023-09-10T00:13:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84cc009e20 con 0x7f84d41f4d00 2023-09-10T00:13:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00daf0 con 0x7f84d41f4d00 2023-09-10T00:13:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4155120 con 0x7f84d41f4d00 2023-09-10T00:13:42.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d41556e0 con 0x7f84d41f4d00 2023-09-10T00:13:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d4155c00 con 0x7f84d41f4d00 2023-09-10T00:13:42.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f84cc00dc50 con 0x7f84d41f4d00 2023-09-10T00:13:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 0x7f84c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f84cc083760 con 0x7f84d41f4d00 2023-09-10T00:13:42.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.589+0000 7f84d8fd4640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 0x7f84c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.593+0000 7f84d8fd4640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 0x7f84c0067fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006430 tx=0x7f84c4006a10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.593+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f84d4155c00 con 0x7f84d41f4d00 2023-09-10T00:13:42.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f84d4155c00 con 0x7f84d41f4d00 2023-09-10T00:13:42.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84d17fa640 1 -- 172.21.15.84:0/4007129489 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f84d4155c00 con 0x7f84d41f4d00 2023-09-10T00:13:42.765 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 msgr2=0x7f84c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 0x7f84c0067fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006430 tx=0x7f84c4006a10 comp rx=0 tx=0).stop 2023-09-10T00:13:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 msgr2=0x7f84d41f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 0x7f84d41f5180 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ad230 tx=0x7f84cc00fd90 comp rx=0 tx=0).stop 2023-09-10T00:13:42.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 shutdown_connections 2023-09-10T00:13:42.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f84c0065b20 0x7f84c0067fe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84d41f4d00 0x7f84d41f5180 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84d41571a0 0x7f84d406a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 --2- 172.21.15.84:0/4007129489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84bc0047d0 0x7f84d41549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 >> 172.21.15.84:0/4007129489 conn(0x7f84d40ca240 msgr2=0x7f84d40aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 shutdown_connections 2023-09-10T00:13:42.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.761+0000 7f84db238640 1 -- 172.21.15.84:0/4007129489 wait complete. 2023-09-10T00:13:42.784 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:42.784 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:42.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:42.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 -- 172.21.15.84:0/787827010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 msgr2=0x7f16600047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 --2- 172.21.15.84:0/787827010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16600047d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f16780c0ae0 tx=0x7f166c01f700 comp rx=0 tx=0).stop 2023-09-10T00:13:42.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167cc49640 1 -- 172.21.15.84:0/787827010 reap_dead start 2023-09-10T00:13:42.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 -- 172.21.15.84:0/787827010 shutdown_connections 2023-09-10T00:13:42.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 -- 172.21.15.84:0/787827010 >> 172.21.15.84:0/787827010 conn(0x7f16780cca70 msgr2=0x7f16780cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 -- 172.21.15.84:0/787827010 shutdown_connections 2023-09-10T00:13:42.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.909+0000 7f167e6ac640 1 -- 172.21.15.84:0/787827010 wait complete. 2023-09-10T00:13:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 Processor -- start 2023-09-10T00:13:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- start start 2023-09-10T00:13:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 0x7f1678153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f167806c530 0x7f167806c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167806cf20 con 0x7f1660003f30 2023-09-10T00:13:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16781e1230 con 0x7f16781e3c00 2023-09-10T00:13:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780c5e00 con 0x7f167806c530 2023-09-10T00:13:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49250/0 (socket says 172.21.15.84:49250) 2023-09-10T00:13:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 -- 172.21.15.84:0/3083276305 learned_addr learned my addr 172.21.15.84:0/3083276305 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f16777fe640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 0x7f1678153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167cc49640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f167806c530 0x7f167806c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 -- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f167806c530 msgr2=0x7f167806c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f167806c530 0x7f167806c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 -- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 msgr2=0x7f1678153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 0x7f1678153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 -- 172.21.15.84:0/3083276305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780c60e0 con 0x7f1660003f30 2023-09-10T00:13:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f16777fe640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 0x7f1678153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1677fff640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1668010a10 tx=0x7f1668010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800ece0 con 0x7f1660003f30 2023-09-10T00:13:42.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f166800ee40 con 0x7f1660003f30 2023-09-10T00:13:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780c63c0 con 0x7f1660003f30 2023-09-10T00:13:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668005280 con 0x7f1660003f30 2023-09-10T00:13:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16780c66a0 con 0x7f1660003f30 2023-09-10T00:13:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16780712c0 con 0x7f1660003f30 2023-09-10T00:13:42.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16680053e0 con 0x7f1660003f30 2023-09-10T00:13:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 0x7f1664067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1668016070 con 0x7f1660003f30 2023-09-10T00:13:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.913+0000 7f16777fe640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 0x7f1664067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:42.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.917+0000 7f16777fe640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 0x7f1664067fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f166c0b0000 tx=0x7f166c01c4a0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:42.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:42.917+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1668055670 con 0x7f1660003f30 2023-09-10T00:13:43.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.073+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16780cd130 con 0x7f1660003f30 2023-09-10T00:13:43.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.073+0000 7f1674ff9640 1 -- 172.21.15.84:0/3083276305 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f1668055200 con 0x7f1660003f30 2023-09-10T00:13:43.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:43.080 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 msgr2=0x7f1664067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 0x7f1664067fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f166c0b0000 tx=0x7f166c01c4a0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 msgr2=0x7f16780c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1668010a10 tx=0x7f1668010ed0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 shutdown_connections 2023-09-10T00:13:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1664065b20 0x7f1664067fe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f167806c530 0x7f167806c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16781e3c00 0x7f1678153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 --2- 172.21.15.84:0/3083276305 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1660003f30 0x7f16780c3740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 >> 172.21.15.84:0/3083276305 conn(0x7f16780cca70 msgr2=0x7f16780cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 shutdown_connections 2023-09-10T00:13:43.083 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.077+0000 7f167e6ac640 1 -- 172.21.15.84:0/3083276305 wait complete. 2023-09-10T00:13:43.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:43.098 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:43.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- 172.21.15.84:0/3124313834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 msgr2=0x7f7db0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/3124313834 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7db0003dd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0006fb0 tx=0x7f7dc001cfa0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcabaa640 1 -- 172.21.15.84:0/3124313834 reap_dead start 2023-09-10T00:13:43.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- 172.21.15.84:0/3124313834 shutdown_connections 2023-09-10T00:13:43.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- 172.21.15.84:0/3124313834 >> 172.21.15.84:0/3124313834 conn(0x7f7dc40aec00 msgr2=0x7f7dc40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- 172.21.15.84:0/3124313834 shutdown_connections 2023-09-10T00:13:43.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- 172.21.15.84:0/3124313834 wait complete. 2023-09-10T00:13:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 Processor -- start 2023-09-10T00:13:43.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- start start 2023-09-10T00:13:43.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 0x7f7dc413f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc413fc50 0x7f7dc413eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc414cef0 con 0x7f7db00039b0 2023-09-10T00:13:43.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc414cbc0 con 0x7f7dc413fc50 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.221+0000 7f7dcc60d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc41461f0 con 0x7f7dc4148580 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49266/0 (socket says 172.21.15.84:49266) 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 -- 172.21.15.84:0/2337072968 learned_addr learned my addr 172.21.15.84:0/2337072968 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dcabaa640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc413fc50 0x7f7dc413eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dc9ba8640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 0x7f7dc413f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 -- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 msgr2=0x7f7dc413f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 0x7f7dc413f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 -- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc413fc50 msgr2=0x7f7dc413eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc413fc50 0x7f7dc413eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 -- 172.21.15.84:0/2337072968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc41400f0 con 0x7f7db00039b0 2023-09-10T00:13:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dc9ba8640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 0x7f7dc413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dca3a9640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7dc001cdd0 tx=0x7f7dc0001c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00b3070 con 0x7f7db00039b0 2023-09-10T00:13:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7dc0001500 con 0x7f7db00039b0 2023-09-10T00:13:43.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc41403d0 con 0x7f7db00039b0 2023-09-10T00:13:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0003860 con 0x7f7db00039b0 2023-09-10T00:13:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc40ac5d0 con 0x7f7db00039b0 2023-09-10T00:13:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc4140880 con 0x7f7db00039b0 2023-09-10T00:13:43.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7dc00ab020 con 0x7f7db00039b0 2023-09-10T00:13:43.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 0x7f7da8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7dc011cf80 con 0x7f7db00039b0 2023-09-10T00:13:43.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dc9ba8640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 0x7f7da8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.225+0000 7f7dc9ba8640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 0x7f7da8067fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40ae2f0 tx=0x7f7db4006ab0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.229+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7dc00ea510 con 0x7f7db00039b0 2023-09-10T00:13:43.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7dc40713a0 con 0x7f7db00039b0 2023-09-10T00:13:43.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dbaffd640 1 -- 172.21.15.84:0/2337072968 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dc00edb30 con 0x7f7db00039b0 2023-09-10T00:13:43.377 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:43.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 msgr2=0x7f7da8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 0x7f7da8067fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40ae2f0 tx=0x7f7db4006ab0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 msgr2=0x7f7dc4145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7dc001cdd0 tx=0x7f7dc0001c80 comp rx=0 tx=0).stop 2023-09-10T00:13:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 shutdown_connections 2023-09-10T00:13:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7da8065b20 0x7f7da8067fe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc413fc50 0x7f7dc413eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dc4148580 0x7f7dc413f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 --2- 172.21.15.84:0/2337072968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7db00039b0 0x7f7dc4145cb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 >> 172.21.15.84:0/2337072968 conn(0x7f7dc40aec00 msgr2=0x7f7dc40b0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 shutdown_connections 2023-09-10T00:13:43.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.373+0000 7f7dcc60d640 1 -- 172.21.15.84:0/2337072968 wait complete. 2023-09-10T00:13:43.395 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:43.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- 172.21.15.84:0/2469369843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 msgr2=0x7f359806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 --2- 172.21.15.84:0/2469369843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f359806fe40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3594009840 tx=0x7f359401c790 comp rx=0 tx=0).stop 2023-09-10T00:13:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- 172.21.15.84:0/2469369843 shutdown_connections 2023-09-10T00:13:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 --2- 172.21.15.84:0/2469369843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f359806fe40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- 172.21.15.84:0/2469369843 >> 172.21.15.84:0/2469369843 conn(0x7f35980aec00 msgr2=0x7f35980cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- 172.21.15.84:0/2469369843 shutdown_connections 2023-09-10T00:13:43.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- 172.21.15.84:0/2469369843 wait complete. 2023-09-10T00:13:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 Processor -- start 2023-09-10T00:13:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- start start 2023-09-10T00:13:43.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 0x7f359813bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3598158230 0x7f3598155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3598152620 con 0x7f359806fa60 2023-09-10T00:13:43.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3598151cf0 con 0x7f359806c280 2023-09-10T00:13:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f359ef7d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3598151fd0 con 0x7f3598158230 2023-09-10T00:13:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f358ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f358ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49282/0 (socket says 172.21.15.84:49282) 2023-09-10T00:13:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.517+0000 7f358ffff640 1 -- 172.21.15.84:0/607008587 learned_addr learned my addr 172.21.15.84:0/607008587 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:43.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359cd19640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 0x7f359813bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359d51a640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3598158230 0x7f3598155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 -- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3598158230 msgr2=0x7f3598155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3598158230 0x7f3598155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 -- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 msgr2=0x7f359813bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 0x7f359813bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 -- 172.21.15.84:0/607008587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940094a0 con 0x7f359806fa60 2023-09-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359cd19640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 0x7f359813bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358ffff640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f358800b410 tx=0x7f358800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588004020 con 0x7f359806fa60 2023-09-10T00:13:43.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3588004270 con 0x7f359806fa60 2023-09-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588011890 con 0x7f359806fa60 2023-09-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35981522b0 con 0x7f359806fa60 2023-09-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3598154010 con 0x7f359806fa60 2023-09-10T00:13:43.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35981527d0 con 0x7f359806fa60 2023-09-10T00:13:43.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3588003600 con 0x7f359806fa60 2023-09-10T00:13:43.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 0x7f3584068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3588082eb0 con 0x7f359806fa60 2023-09-10T00:13:43.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359cd19640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 0x7f3584068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.521+0000 7f359cd19640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 0x7f3584068010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35940af000 tx=0x7f359401afd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.525+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f35880504d0 con 0x7f359806fa60 2023-09-10T00:13:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3598152440 con 0x7f359806fa60 2023-09-10T00:13:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f358d7fa640 1 -- 172.21.15.84:0/607008587 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3588053af0 con 0x7f359806fa60 2023-09-10T00:13:43.673 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 msgr2=0x7f3584068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 0x7f3584068010 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f35940af000 tx=0x7f359401afd0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 msgr2=0x7f3598155a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f358800b410 tx=0x7f358800b8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 shutdown_connections 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3584065b50 0x7f3584068010 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3598158230 0x7f3598155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f359806fa60 0x7f3598155a20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 --2- 172.21.15.84:0/607008587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359806c280 0x7f359813bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 >> 172.21.15.84:0/607008587 conn(0x7f35980aec00 msgr2=0x7f35980acc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 shutdown_connections 2023-09-10T00:13:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.669+0000 7f359ef7d640 1 -- 172.21.15.84:0/607008587 wait complete. 2023-09-10T00:13:43.691 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/3796095860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c158230 msgr2=0x7f386c0695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- 172.21.15.84:0/3796095860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c158230 0x7f386c0695b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3854009900 tx=0x7f385401c890 comp rx=0 tx=0).stop 2023-09-10T00:13:43.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/3796095860 shutdown_connections 2023-09-10T00:13:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- 172.21.15.84:0/3796095860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c158230 0x7f386c0695b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- 172.21.15.84:0/3796095860 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c06fa60 0x7f386c06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/3796095860 >> 172.21.15.84:0/3796095860 conn(0x7f386c0aec00 msgr2=0x7f386c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/3796095860 shutdown_connections 2023-09-10T00:13:43.823 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/3796095860 wait complete. 2023-09-10T00:13:43.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 Processor -- start 2023-09-10T00:13:43.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- start start 2023-09-10T00:13:43.825 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c06c280 0x7f386c14b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 0x7f386c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c14b890 con 0x7f386c06fa60 2023-09-10T00:13:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0ab280 con 0x7f386c06c280 2023-09-10T00:13:43.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0aafa0 con 0x7f386c158230 2023-09-10T00:13:43.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49306/0 (socket says 172.21.15.84:49306) 2023-09-10T00:13:43.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 -- 172.21.15.84:0/191758470 learned_addr learned my addr 172.21.15.84:0/191758470 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:43.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386ad9d640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c06c280 0x7f386c14b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386b59e640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 0x7f386c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 -- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 msgr2=0x7f386c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 0x7f386c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 -- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c06c280 msgr2=0x7f386c14b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c06c280 0x7f386c14b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 -- 172.21.15.84:0/191758470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3854009560 con 0x7f386c06fa60 2023-09-10T00:13:43.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386b59e640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 0x7f386c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f386259c640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f385401a4c0 tx=0x7f3854005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854005230 con 0x7f386c06fa60 2023-09-10T00:13:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3854005480 con 0x7f386c06fa60 2023-09-10T00:13:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c152790 con 0x7f386c06fa60 2023-09-10T00:13:43.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.817+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854004930 con 0x7f386c06fa60 2023-09-10T00:13:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c152d50 con 0x7f386c06fa60 2023-09-10T00:13:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c152f40 con 0x7f386c06fa60 2023-09-10T00:13:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f38540b4070 con 0x7f386c06fa60 2023-09-10T00:13:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f3863fff640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 0x7f384c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:43.830 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f385411d980 con 0x7f386c06fa60 2023-09-10T00:13:43.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f386ad9d640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 0x7f384c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:43.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.821+0000 7f386ad9d640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 0x7f384c068010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f385c0058d0 tx=0x7f385c005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:43.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.825+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f38540eafa0 con 0x7f386c06fa60 2023-09-10T00:13:43.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f386c069b40 con 0x7f386c06fa60 2023-09-10T00:13:43.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f3863fff640 1 -- 172.21.15.84:0/191758470 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38540ee5c0 con 0x7f386c06fa60 2023-09-10T00:13:43.969 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:43.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 msgr2=0x7f384c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 0x7f384c068010 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f385c0058d0 tx=0x7f385c005860 comp rx=0 tx=0).stop 2023-09-10T00:13:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 msgr2=0x7f386c153890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f385401a4c0 tx=0x7f3854005760 comp rx=0 tx=0).stop 2023-09-10T00:13:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 shutdown_connections 2023-09-10T00:13:43.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f384c065b50 0x7f384c068010 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f386c158230 0x7f386c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f386c06fa60 0x7f386c153890 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 --2- 172.21.15.84:0/191758470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386c06c280 0x7f386c14b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 >> 172.21.15.84:0/191758470 conn(0x7f386c0aec00 msgr2=0x7f386c159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:43.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 shutdown_connections 2023-09-10T00:13:43.974 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:43.965+0000 7f387117b640 1 -- 172.21.15.84:0/191758470 wait complete. 2023-09-10T00:13:43.986 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 -- 172.21.15.84:0/957624267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0ca550 msgr2=0x7fa02c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 --2- 172.21.15.84:0/957624267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0ca550 0x7fa02c0af770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa014009840 tx=0x7fa01401c800 comp rx=0 tx=0).stop 2023-09-10T00:13:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 -- 172.21.15.84:0/957624267 shutdown_connections 2023-09-10T00:13:44.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 --2- 172.21.15.84:0/957624267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0cbd60 0x7fa02c1591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 --2- 172.21.15.84:0/957624267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c0ca550 0x7fa02c0af770 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 -- 172.21.15.84:0/957624267 >> 172.21.15.84:0/957624267 conn(0x7fa02c0aec00 msgr2=0x7fa02c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 -- 172.21.15.84:0/957624267 shutdown_connections 2023-09-10T00:13:44.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.097+0000 7fa030bfd640 1 -- 172.21.15.84:0/957624267 wait complete. 2023-09-10T00:13:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 Processor -- start 2023-09-10T00:13:44.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- start start 2023-09-10T00:13:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0ca550 0x7fa02c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa02c0cbd60 0x7fa02c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c0ab220 con 0x7fa02c06fa60 2023-09-10T00:13:44.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c156210 con 0x7fa02c0cbd60 2023-09-10T00:13:44.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02c13fe20 con 0x7fa02c0ca550 2023-09-10T00:13:44.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49326/0 (socket says 172.21.15.84:49326) 2023-09-10T00:13:44.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 -- 172.21.15.84:0/3757456870 learned_addr learned my addr 172.21.15.84:0/3757456870 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa023fff640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0ca550 0x7fa02c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 -- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0ca550 msgr2=0x7fa02c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0ca550 0x7fa02c155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 -- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa02c0cbd60 msgr2=0x7fa02c141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa02c0cbd60 0x7fa02c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 -- 172.21.15.84:0/3757456870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0140094a0 con 0x7fa02c06fa60 2023-09-10T00:13:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa02a59c640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c480 tx=0x7fa01c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c012830 con 0x7fa02c06fa60 2023-09-10T00:13:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa01c012a80 con 0x7fa02c06fa60 2023-09-10T00:13:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02c1f4480 con 0x7fa02c06fa60 2023-09-10T00:13:44.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01c012e70 con 0x7fa02c06fa60 2023-09-10T00:13:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02c1400c0 con 0x7fa02c06fa60 2023-09-10T00:13:44.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02c0713a0 con 0x7fa02c06fa60 2023-09-10T00:13:44.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa01c01a3b0 con 0x7fa02c06fa60 2023-09-10T00:13:44.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.101+0000 7fa022ffd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 0x7fa00c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.105+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa01c083780 con 0x7fa02c06fa60 2023-09-10T00:13:44.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.105+0000 7fa023fff640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 0x7fa00c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.105+0000 7fa023fff640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 0x7fa00c067fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af000 tx=0x7fa01401b040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.109+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa01c050da0 con 0x7fa02c06fa60 2023-09-10T00:13:44.254 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.249+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa02c073400 con 0x7fa02c06fa60 2023-09-10T00:13:44.255 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa022ffd640 1 -- 172.21.15.84:0/3757456870 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa01c0543c0 con 0x7fa02c06fa60 2023-09-10T00:13:44.255 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 msgr2=0x7fa00c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 0x7fa00c067fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa0140af000 tx=0x7fa01401b040 comp rx=0 tx=0).stop 2023-09-10T00:13:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 msgr2=0x7fa02c0aab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa01c00c480 tx=0x7fa01c00c940 comp rx=0 tx=0).stop 2023-09-10T00:13:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 shutdown_connections 2023-09-10T00:13:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa00c065b20 0x7fa00c067fe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa02c0cbd60 0x7fa02c141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa02c0ca550 0x7fa02c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 --2- 172.21.15.84:0/3757456870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa02c06fa60 0x7fa02c0aab60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 >> 172.21.15.84:0/3757456870 conn(0x7fa02c0aec00 msgr2=0x7fa02c157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 shutdown_connections 2023-09-10T00:13:44.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.253+0000 7fa030bfd640 1 -- 172.21.15.84:0/3757456870 wait complete. 2023-09-10T00:13:44.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:44.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- 172.21.15.84:0/1788373785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a40b1860 msgr2=0x7f67a40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 --2- 172.21.15.84:0/1788373785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a40b1860 0x7f67a40cdd10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6794009840 tx=0x7f679401c700 comp rx=0 tx=0).stop 2023-09-10T00:13:44.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- 172.21.15.84:0/1788373785 shutdown_connections 2023-09-10T00:13:44.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 --2- 172.21.15.84:0/1788373785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a40b1860 0x7f67a40cdd10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- 172.21.15.84:0/1788373785 >> 172.21.15.84:0/1788373785 conn(0x7f67a40ceca0 msgr2=0x7f67a40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:44.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- 172.21.15.84:0/1788373785 shutdown_connections 2023-09-10T00:13:44.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- 172.21.15.84:0/1788373785 wait complete. 2023-09-10T00:13:44.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 Processor -- start 2023-09-10T00:13:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- start start 2023-09-10T00:13:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f67a40b1860 0x7f67a4157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a4158980 0x7f67a40c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a406f010 con 0x7f67a4158d60 2023-09-10T00:13:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4158520 con 0x7f67a4158980 2023-09-10T00:13:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67ac591640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40c33d0 con 0x7f67a40b1860 2023-09-10T00:13:44.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49348/0 (socket says 172.21.15.84:49348) 2023-09-10T00:13:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 -- 172.21.15.84:0/1521315090 learned_addr learned my addr 172.21.15.84:0/1521315090 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:44.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67a9b2c640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a4158980 0x7f67a40c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aa32d640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f67a40b1860 0x7f67a4157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 -- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f67a40b1860 msgr2=0x7f67a4157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f67a40b1860 0x7f67a4157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 -- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a4158980 msgr2=0x7f67a40c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a4158980 0x7f67a40c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.381+0000 7f67aab2e640 1 -- 172.21.15.84:0/1521315090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940094a0 con 0x7f67a4158d60 2023-09-10T00:13:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67aab2e640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f679c002240 tx=0x7f679c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c003db0 con 0x7f67a4158d60 2023-09-10T00:13:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f679c00ce30 con 0x7f67a4158d60 2023-09-10T00:13:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0052b0 con 0x7f67a4158d60 2023-09-10T00:13:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a40c36b0 con 0x7f67a4158d60 2023-09-10T00:13:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a41563a0 con 0x7f67a4158d60 2023-09-10T00:13:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4073390 con 0x7f67a4158d60 2023-09-10T00:13:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f679c005410 con 0x7f67a4158d60 2023-09-10T00:13:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 0x7f6788067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f679c083180 con 0x7f67a4158d60 2023-09-10T00:13:44.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67aa32d640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 0x7f6788067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.403 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.385+0000 7f67aa32d640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 0x7f6788067fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67a40c8eb0 tx=0x7f67a0009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.404 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.389+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f679c050710 con 0x7f67a4158d60 2023-09-10T00:13:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f67a40ae870 con 0x7f67a4158d60 2023-09-10T00:13:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f679affd640 1 -- 172.21.15.84:0/1521315090 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f679c053d30 con 0x7f67a4158d60 2023-09-10T00:13:44.552 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 msgr2=0x7f6788067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.554 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 0x7f6788067fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f67a40c8eb0 tx=0x7f67a0009040 comp rx=0 tx=0).stop 2023-09-10T00:13:44.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 msgr2=0x7f67a40c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f679c002240 tx=0x7f679c00cbe0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 shutdown_connections 2023-09-10T00:13:44.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6788065b20 0x7f6788067fe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.555 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67a4158d60 0x7f67a40c4180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a4158980 0x7f67a40c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 --2- 172.21.15.84:0/1521315090 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f67a40b1860 0x7f67a4157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 >> 172.21.15.84:0/1521315090 conn(0x7f67a40ceca0 msgr2=0x7f67a41546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 shutdown_connections 2023-09-10T00:13:44.556 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.549+0000 7f67ac591640 1 -- 172.21.15.84:0/1521315090 wait complete. 2023-09-10T00:13:44.570 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-09-10T00:13:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:44.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-09-10T00:13:44.594 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:44.595 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:13:44.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:44.595 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-10T00:13:44.647 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:44.648 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:44.653 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:44.654 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:44.701 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/1794531585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f84003980 msgr2=0x7f9f84003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 --2- 172.21.15.84:0/1794531585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f84003980 0x7f9f84003d80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800bb10 tx=0x7f9f8801cd80 comp rx=0 tx=0).stop 2023-09-10T00:13:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/1794531585 shutdown_connections 2023-09-10T00:13:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 --2- 172.21.15.84:0/1794531585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f84003980 0x7f9f84003d80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/1794531585 >> 172.21.15.84:0/1794531585 conn(0x7f9f980b25b0 msgr2=0x7f9f980b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/1794531585 shutdown_connections 2023-09-10T00:13:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/1794531585 wait complete. 2023-09-10T00:13:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 Processor -- start 2023-09-10T00:13:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- start start 2023-09-10T00:13:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9f84003980 0x7f9f981f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f980b4ff0 0x7f9f980b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9806afb0 con 0x7f9f981f55e0 2023-09-10T00:13:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c4bf0 con 0x7f9f980b4ff0 2023-09-10T00:13:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b59b0 con 0x7f9f84003980 2023-09-10T00:13:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49370/0 (socket says 172.21.15.84:49370) 2023-09-10T00:13:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 -- 172.21.15.84:0/394817882 learned_addr learned my addr 172.21.15.84:0/394817882 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9d6df640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f980b4ff0 0x7f9f980b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9cede640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9f84003980 0x7f9f981f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 -- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9f84003980 msgr2=0x7f9f981f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9f84003980 0x7f9f981f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.874 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 -- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f980b4ff0 msgr2=0x7f9f980b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f980b4ff0 0x7f9f980b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 -- 172.21.15.84:0/394817882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9815d9b0 con 0x7f9f981f55e0 2023-09-10T00:13:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f97fff640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e360 tx=0x7f9f8000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800129d0 con 0x7f9f981f55e0 2023-09-10T00:13:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9f80012c20 con 0x7f9f981f55e0 2023-09-10T00:13:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9815dc90 con 0x7f9f981f55e0 2023-09-10T00:13:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8001a400 con 0x7f9f981f55e0 2023-09-10T00:13:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.865+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9815d5c0 con 0x7f9f981f55e0 2023-09-10T00:13:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9806c610 con 0x7f9f981f55e0 2023-09-10T00:13:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9f8001a560 con 0x7f9f981f55e0 2023-09-10T00:13:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f957fa640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 0x7f9f78067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f9cede640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 0x7f9f78067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9f80086dd0 con 0x7f9f981f55e0 2023-09-10T00:13:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.869+0000 7f9f9cede640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 0x7f9f78067fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b0000 tx=0x7f9f88019b20 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:44.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:44.873+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9f80054360 con 0x7f9f981f55e0 2023-09-10T00:13:45.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.013+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f980c49c0 con 0x7f9f981f55e0 2023-09-10T00:13:45.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f957fa640 1 -- 172.21.15.84:0/394817882 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f9f8001f020 con 0x7f9f981f55e0 2023-09-10T00:13:45.021 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:45.021 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 msgr2=0x7f9f78067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 0x7f9f78067fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b0000 tx=0x7f9f88019b20 comp rx=0 tx=0).stop 2023-09-10T00:13:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 msgr2=0x7f9f9815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e360 tx=0x7f9f8000e820 comp rx=0 tx=0).stop 2023-09-10T00:13:45.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 shutdown_connections 2023-09-10T00:13:45.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f78065b20 0x7f9f78067fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f980b4ff0 0x7f9f980b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f981f55e0 0x7f9f9815d080 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 --2- 172.21.15.84:0/394817882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9f84003980 0x7f9f981f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 >> 172.21.15.84:0/394817882 conn(0x7f9f980b25b0 msgr2=0x7f9f98159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 shutdown_connections 2023-09-10T00:13:45.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.017+0000 7f9f9f142640 1 -- 172.21.15.84:0/394817882 wait complete. 2023-09-10T00:13:45.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:45.039 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:45.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 -- 172.21.15.84:0/486582003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 msgr2=0x7f56dc0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 --2- 172.21.15.84:0/486582003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc0c9520 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f56dc06a4c0 tx=0x7f56d401cab0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 -- 172.21.15.84:0/486582003 shutdown_connections 2023-09-10T00:13:45.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 --2- 172.21.15.84:0/486582003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc0c9520 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 --2- 172.21.15.84:0/486582003 >> v2:172.21.15.100:3300/0 conn(0x7f56dc0cdea0 0x7f56dc15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 -- 172.21.15.84:0/486582003 >> 172.21.15.84:0/486582003 conn(0x7f56dc0ce890 msgr2=0x7f56dc0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 -- 172.21.15.84:0/486582003 shutdown_connections 2023-09-10T00:13:45.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.161+0000 7f56e369f640 1 -- 172.21.15.84:0/486582003 wait complete. 2023-09-10T00:13:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 Processor -- start 2023-09-10T00:13:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- start start 2023-09-10T00:13:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56dc0cdea0 0x7f56dc0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.171 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56dc158dc0 0x7f56dc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1f40c0 con 0x7f56dc0c90f0 2023-09-10T00:13:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0b00e0 con 0x7f56dc0cdea0 2023-09-10T00:13:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0b03c0 con 0x7f56dc158dc0 2023-09-10T00:13:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49388/0 (socket says 172.21.15.84:49388) 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 -- 172.21.15.84:0/3425379030 learned_addr learned my addr 172.21.15.84:0/3425379030 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 -- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56dc158dc0 msgr2=0x7f56dc0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56dc158dc0 0x7f56dc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 -- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56dc0cdea0 msgr2=0x7f56dc0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56dc0cdea0 0x7f56dc0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 -- 172.21.15.84:0/3425379030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d4009820 con 0x7f56dc0c90f0 2023-09-10T00:13:45.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e143b640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c3c0 tx=0x7f56d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011790 con 0x7f56dc0c90f0 2023-09-10T00:13:45.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56d8011a00 con 0x7f56dc0c90f0 2023-09-10T00:13:45.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc0c2460 con 0x7f56dc0c90f0 2023-09-10T00:13:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011e10 con 0x7f56dc0c90f0 2023-09-10T00:13:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc0b06a0 con 0x7f56dc0c90f0 2023-09-10T00:13:45.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.165+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc06f2a0 con 0x7f56dc0c90f0 2023-09-10T00:13:45.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.169+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f56d801c460 con 0x7f56dc0c90f0 2023-09-10T00:13:45.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.169+0000 7f56d1ffb640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 0x7f56c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.169+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56d80836d0 con 0x7f56dc0c90f0 2023-09-10T00:13:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.169+0000 7f56e0c3a640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 0x7f56c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.169+0000 7f56e0c3a640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 0x7f56c0067fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56dc15c530 tx=0x7f56cc005c20 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.173+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f56d8050cf0 con 0x7f56dc0c90f0 2023-09-10T00:13:45.317 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.313+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56dc073400 con 0x7f56dc0c90f0 2023-09-10T00:13:45.318 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.313+0000 7f56d1ffb640 1 -- 172.21.15.84:0/3425379030 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56d8054310 con 0x7f56dc0c90f0 2023-09-10T00:13:45.318 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:45.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 msgr2=0x7f56c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 0x7f56c0067fe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56dc15c530 tx=0x7f56cc005c20 comp rx=0 tx=0).stop 2023-09-10T00:13:45.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 msgr2=0x7f56dc1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c3c0 tx=0x7f56d800c880 comp rx=0 tx=0).stop 2023-09-10T00:13:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 shutdown_connections 2023-09-10T00:13:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f56c0065b20 0x7f56c0067fe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56dc158dc0 0x7f56dc0b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.321 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56dc0cdea0 0x7f56dc0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 --2- 172.21.15.84:0/3425379030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56dc0c90f0 0x7f56dc1f3b80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 >> 172.21.15.84:0/3425379030 conn(0x7f56dc0ce890 msgr2=0x7f56dc154960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 shutdown_connections 2023-09-10T00:13:45.322 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.317+0000 7f56e369f640 1 -- 172.21.15.84:0/3425379030 wait complete. 2023-09-10T00:13:45.336 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:45.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1309055161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390157f00 msgr2=0x7fe3900ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1309055161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390157f00 0x7fe3900ab480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe388009930 tx=0x7fe38801c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1309055161 shutdown_connections 2023-09-10T00:13:45.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1309055161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe390157f00 0x7fe3900ab480 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1309055161 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe39006ccb0 0x7fe39015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1309055161 >> 172.21.15.84:0/1309055161 conn(0x7fe3900aec00 msgr2=0x7fe3900cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1309055161 shutdown_connections 2023-09-10T00:13:45.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1309055161 wait complete. 2023-09-10T00:13:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 Processor -- start 2023-09-10T00:13:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- start start 2023-09-10T00:13:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 0x7fe3901529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 0x7fe39014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390153ed0 con 0x7fe39006ccb0 2023-09-10T00:13:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390154360 con 0x7fe39014eb10 2023-09-10T00:13:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39014b700 con 0x7fe390157f00 2023-09-10T00:13:45.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49400/0 (socket says 172.21.15.84:49400) 2023-09-10T00:13:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 -- 172.21.15.84:0/1461529980 learned_addr learned my addr 172.21.15.84:0/1461529980 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38dd9b640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 0x7fe3901529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38ed9d640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 0x7fe39014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 -- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 msgr2=0x7fe39014bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 0x7fe39014bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 -- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 msgr2=0x7fe3901529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 0x7fe3901529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 -- 172.21.15.84:0/1461529980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009560 con 0x7fe39006ccb0 2023-09-10T00:13:45.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38dd9b640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 0x7fe3901529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38ed9d640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 0x7fe39014bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe38e59c640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c7f0 tx=0x7fe38000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380003b80 con 0x7fe39006ccb0 2023-09-10T00:13:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe380003ce0 con 0x7fe39006ccb0 2023-09-10T00:13:45.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3901532c0 con 0x7fe39006ccb0 2023-09-10T00:13:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000aab0 con 0x7fe39006ccb0 2023-09-10T00:13:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.461+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe390153880 con 0x7fe39006ccb0 2023-09-10T00:13:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900713a0 con 0x7fe39006ccb0 2023-09-10T00:13:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe38000ac10 con 0x7fe39006ccb0 2023-09-10T00:13:45.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe386ffd640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 0x7fe370068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe3800836c0 con 0x7fe39006ccb0 2023-09-10T00:13:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe38dd9b640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 0x7fe370068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.465+0000 7fe38dd9b640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 0x7fe370068010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe378005fd0 tx=0x7fe378005e60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.469+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe380050c60 con 0x7fe39006ccb0 2023-09-10T00:13:45.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe390073400 con 0x7fe39006ccb0 2023-09-10T00:13:45.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe386ffd640 1 -- 172.21.15.84:0/1461529980 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe380054280 con 0x7fe39006ccb0 2023-09-10T00:13:45.629 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:45.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 msgr2=0x7fe370068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 0x7fe370068010 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe378005fd0 tx=0x7fe378005e60 comp rx=0 tx=0).stop 2023-09-10T00:13:45.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 msgr2=0x7fe39014b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe38000c7f0 tx=0x7fe38000ccb0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 shutdown_connections 2023-09-10T00:13:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe370065b50 0x7fe370068010 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe390157f00 0x7fe39014bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe39014eb10 0x7fe3901529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 --2- 172.21.15.84:0/1461529980 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe39006ccb0 0x7fe39014b1c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 >> 172.21.15.84:0/1461529980 conn(0x7fe3900aec00 msgr2=0x7fe39006ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 shutdown_connections 2023-09-10T00:13:45.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.625+0000 7fe394ad5640 1 -- 172.21.15.84:0/1461529980 wait complete. 2023-09-10T00:13:45.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:45.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/548506768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa33c004d10 msgr2=0x7fa33c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 --2- 172.21.15.84:0/548506768 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa33c004d10 0x7fa33c005190 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa34c009f10 tx=0x7fa34c01d5b0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.768 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35359e640 1 -- 172.21.15.84:0/548506768 reap_dead start 2023-09-10T00:13:45.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/548506768 shutdown_connections 2023-09-10T00:13:45.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/548506768 >> 172.21.15.84:0/548506768 conn(0x7fa3540aec00 msgr2=0x7fa3540cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/548506768 shutdown_connections 2023-09-10T00:13:45.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/548506768 wait complete. 2023-09-10T00:13:45.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 Processor -- start 2023-09-10T00:13:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- start start 2023-09-10T00:13:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 0x7fa354156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3540adb20 0x7fa354141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35415a160 con 0x7fa354137460 2023-09-10T00:13:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35415aa00 con 0x7fa33c004d10 2023-09-10T00:13:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa354137a20 con 0x7fa3540adb20 2023-09-10T00:13:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49418/0 (socket says 172.21.15.84:49418) 2023-09-10T00:13:45.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 -- 172.21.15.84:0/3494308972 learned_addr learned my addr 172.21.15.84:0/3494308972 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa352d9d640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 0x7fa354156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 -- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3540adb20 msgr2=0x7fa354141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3540adb20 0x7fa354141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 -- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 msgr2=0x7fa354156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 0x7fa354156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 -- 172.21.15.84:0/3494308972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35415a3b0 con 0x7fa354137460 2023-09-10T00:13:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa352d9d640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 0x7fa354156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa35259c640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d8d0 tx=0x7fa34800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480062e0 con 0x7fa354137460 2023-09-10T00:13:45.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa348006530 con 0x7fa354137460 2023-09-10T00:13:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34800b9b0 con 0x7fa354137460 2023-09-10T00:13:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35415a690 con 0x7fa354137460 2023-09-10T00:13:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa354141840 con 0x7fa354137460 2023-09-10T00:13:45.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.765+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3540713a0 con 0x7fa354137460 2023-09-10T00:13:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.769+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa34800bb10 con 0x7fa354137460 2023-09-10T00:13:45.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.769+0000 7fa33b7fe640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 0x7fa340067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.769+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3480841a0 con 0x7fa354137460 2023-09-10T00:13:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.769+0000 7fa352d9d640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 0x7fa340067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.769+0000 7fa352d9d640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 0x7fa340067fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa344005d10 tx=0x7fa344005c60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:45.778 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.773+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa3480517c0 con 0x7fa354137460 2023-09-10T00:13:45.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa35415ab40 con 0x7fa354137460 2023-09-10T00:13:45.920 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa33b7fe640 1 -- 172.21.15.84:0/3494308972 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa348054de0 con 0x7fa354137460 2023-09-10T00:13:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 msgr2=0x7fa340067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 0x7fa340067fe0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa344005d10 tx=0x7fa344005c60 comp rx=0 tx=0).stop 2023-09-10T00:13:45.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 msgr2=0x7fa354134830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d8d0 tx=0x7fa34800dd90 comp rx=0 tx=0).stop 2023-09-10T00:13:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 shutdown_connections 2023-09-10T00:13:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa340065b20 0x7fa340067fe0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa3540adb20 0x7fa354141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa354137460 0x7fa354134830 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 --2- 172.21.15.84:0/3494308972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa33c004d10 0x7fa354156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 >> 172.21.15.84:0/3494308972 conn(0x7fa3540aec00 msgr2=0x7fa3541583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 shutdown_connections 2023-09-10T00:13:45.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:45.917+0000 7fa3590fa640 1 -- 172.21.15.84:0/3494308972 wait complete. 2023-09-10T00:13:45.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- 172.21.15.84:0/693547502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80cbd60 msgr2=0x7fc5a81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 --2- 172.21.15.84:0/693547502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80cbd60 0x7fc5a81591a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009900 tx=0x7fc5a001c880 comp rx=0 tx=0).stop 2023-09-10T00:13:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- 172.21.15.84:0/693547502 shutdown_connections 2023-09-10T00:13:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 --2- 172.21.15.84:0/693547502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80cbd60 0x7fc5a81591a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 --2- 172.21.15.84:0/693547502 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80ca550 0x7fc5a80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- 172.21.15.84:0/693547502 >> 172.21.15.84:0/693547502 conn(0x7fc5a80aec00 msgr2=0x7fc5a80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- 172.21.15.84:0/693547502 shutdown_connections 2023-09-10T00:13:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- 172.21.15.84:0/693547502 wait complete. 2023-09-10T00:13:46.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 Processor -- start 2023-09-10T00:13:46.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.061+0000 7fc5aebad640 1 -- start start 2023-09-10T00:13:46.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5a806fa60 0x7fc5a8153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80cbd60 0x7fc5a81535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8163770 con 0x7fc5a80ca550 2023-09-10T00:13:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8154b60 con 0x7fc5a806fa60 2023-09-10T00:13:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8162440 con 0x7fc5a80cbd60 2023-09-10T00:13:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49430/0 (socket says 172.21.15.84:49430) 2023-09-10T00:13:46.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 -- 172.21.15.84:0/1945239132 learned_addr learned my addr 172.21.15.84:0/1945239132 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5ac949640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5a806fa60 0x7fc5a8153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5ad14a640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80cbd60 0x7fc5a81535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 -- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80cbd60 msgr2=0x7fc5a81535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80cbd60 0x7fc5a81535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 -- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5a806fa60 msgr2=0x7fc5a8153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5a806fa60 0x7fc5a8153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 -- 172.21.15.84:0/1945239132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0009560 con 0x7fc5a80ca550 2023-09-10T00:13:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59ffff640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc59800d980 tx=0x7fc59800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598009c30 con 0x7fc5a80ca550 2023-09-10T00:13:46.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc598005020 con 0x7fc5a80ca550 2023-09-10T00:13:46.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a8162720 con 0x7fc5a80ca550 2023-09-10T00:13:46.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598005430 con 0x7fc5a80ca550 2023-09-10T00:13:46.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a8154db0 con 0x7fc5a80ca550 2023-09-10T00:13:46.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a8154fd0 con 0x7fc5a80ca550 2023-09-10T00:13:46.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc5980047b0 con 0x7fc5a80ca550 2023-09-10T00:13:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 0x7fc594067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc5ac949640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 0x7fc594067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.065+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc598083870 con 0x7fc5a80ca550 2023-09-10T00:13:46.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.069+0000 7fc5ac949640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 0x7fc594067fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005530 tx=0x7fc5a4009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.073+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc598050e90 con 0x7fc5a80ca550 2023-09-10T00:13:46.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.213+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5a80713a0 con 0x7fc5a80ca550 2023-09-10T00:13:46.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.213+0000 7fc59d7fa640 1 -- 172.21.15.84:0/1945239132 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5980170a0 con 0x7fc5a80ca550 2023-09-10T00:13:46.219 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 msgr2=0x7fc594067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 0x7fc594067fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4005530 tx=0x7fc5a4009040 comp rx=0 tx=0).stop 2023-09-10T00:13:46.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 msgr2=0x7fc5a8163230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc59800d980 tx=0x7fc59800de40 comp rx=0 tx=0).stop 2023-09-10T00:13:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 shutdown_connections 2023-09-10T00:13:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc594065b20 0x7fc594067fe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc5a80cbd60 0x7fc5a81535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5a80ca550 0x7fc5a8163230 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 --2- 172.21.15.84:0/1945239132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5a806fa60 0x7fc5a8153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 >> 172.21.15.84:0/1945239132 conn(0x7fc5a80aec00 msgr2=0x7fc5a80c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 shutdown_connections 2023-09-10T00:13:46.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.217+0000 7fc5aebad640 1 -- 172.21.15.84:0/1945239132 wait complete. 2023-09-10T00:13:46.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- 172.21.15.84:0/1039446384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 msgr2=0x7f47f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 --2- 172.21.15.84:0/1039446384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f47f8003da0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c290 tx=0x7f47fc01cfd0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480b59e640 1 -- 172.21.15.84:0/1039446384 reap_dead start 2023-09-10T00:13:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- 172.21.15.84:0/1039446384 shutdown_connections 2023-09-10T00:13:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- 172.21.15.84:0/1039446384 >> 172.21.15.84:0/1039446384 conn(0x7f480c0c9500 msgr2=0x7f480c0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- 172.21.15.84:0/1039446384 shutdown_connections 2023-09-10T00:13:46.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- 172.21.15.84:0/1039446384 wait complete. 2023-09-10T00:13:46.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 Processor -- start 2023-09-10T00:13:46.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- start start 2023-09-10T00:13:46.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f480c1424e0 0x7f480c142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f480c159080 0x7f480c159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c155610 con 0x7f47f8003980 2023-09-10T00:13:46.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c154990 con 0x7f480c159080 2023-09-10T00:13:46.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f48110c2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c154c70 con 0x7f480c1424e0 2023-09-10T00:13:46.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49440/0 (socket says 172.21.15.84:49440) 2023-09-10T00:13:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480ad9d640 1 -- 172.21.15.84:0/2905868139 learned_addr learned my addr 172.21.15.84:0/2905868139 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480259c640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f480c1424e0 0x7f480c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.345+0000 7f480b59e640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f480c159080 0x7f480c159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 -- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f480c1424e0 msgr2=0x7f480c142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f480c1424e0 0x7f480c142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 -- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f480c159080 msgr2=0x7f480c159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f480c159080 0x7f480c159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 -- 172.21.15.84:0/2905868139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c154f50 con 0x7f47f8003980 2023-09-10T00:13:46.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480ad9d640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f47fc01ca40 tx=0x7f47fc0a5c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0b4070 con 0x7f47f8003980 2023-09-10T00:13:46.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f47fc0a5e40 con 0x7f47f8003980 2023-09-10T00:13:46.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c155230 con 0x7f47f8003980 2023-09-10T00:13:46.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc001680 con 0x7f47f8003980 2023-09-10T00:13:46.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c142e60 con 0x7f47f8003980 2023-09-10T00:13:46.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c073390 con 0x7f47f8003980 2023-09-10T00:13:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f47fc006070 con 0x7f47f8003980 2023-09-10T00:13:46.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 0x7f47ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47fc11cad0 con 0x7f47f8003980 2023-09-10T00:13:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480259c640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 0x7f47ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.349+0000 7f480259c640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 0x7f47ec067fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f480c0c2570 tx=0x7f47f400f530 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.353+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f47fc0ea060 con 0x7f47f8003980 2023-09-10T00:13:46.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.525+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f480c15d1e0 con 0x7f47f8003980 2023-09-10T00:13:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.525+0000 7f4803fff640 1 -- 172.21.15.84:0/2905868139 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47fc0be070 con 0x7f47f8003980 2023-09-10T00:13:46.531 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 msgr2=0x7f47ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 0x7f47ec067fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f480c0c2570 tx=0x7f47f400f530 comp rx=0 tx=0).stop 2023-09-10T00:13:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 msgr2=0x7f480c0c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.533 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f47fc01ca40 tx=0x7f47fc0a5c50 comp rx=0 tx=0).stop 2023-09-10T00:13:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 shutdown_connections 2023-09-10T00:13:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47ec065b20 0x7f47ec067fe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f480c159080 0x7f480c159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.534 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f480c1424e0 0x7f480c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 --2- 172.21.15.84:0/2905868139 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f8003980 0x7f480c0c4470 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 >> 172.21.15.84:0/2905868139 conn(0x7f480c0c9500 msgr2=0x7f480c15db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 shutdown_connections 2023-09-10T00:13:46.535 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.529+0000 7f48110c2640 1 -- 172.21.15.84:0/2905868139 wait complete. 2023-09-10T00:13:46.550 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:13:46.550 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:46.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2486917910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 msgr2=0x7fb9640b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2486917910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb9640b1790 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb958009900 tx=0x7fb95801c890 comp rx=0 tx=0).stop 2023-09-10T00:13:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2486917910 shutdown_connections 2023-09-10T00:13:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2486917910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb9640b1790 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2486917910 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 0x7fb9640c01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2486917910 >> 172.21.15.84:0/2486917910 conn(0x7fb9640cca70 msgr2=0x7fb9640cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2486917910 shutdown_connections 2023-09-10T00:13:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2486917910 wait complete. 2023-09-10T00:13:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 Processor -- start 2023-09-10T00:13:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- start start 2023-09-10T00:13:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9640b1cd0 0x7fb96414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 0x7fb964153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964153ed0 con 0x7fb9640c0700 2023-09-10T00:13:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964150a40 con 0x7fb9640b1cd0 2023-09-10T00:13:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96414fe30 con 0x7fb964158a90 2023-09-10T00:13:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49452/0 (socket says 172.21.15.84:49452) 2023-09-10T00:13:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 -- 172.21.15.84:0/2939714828 learned_addr learned my addr 172.21.15.84:0/2939714828 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 -- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 msgr2=0x7fb964153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb963fff640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 0x7fb964153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb9637fe640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9640b1cd0 0x7fb96414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 0x7fb964153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 -- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9640b1cd0 msgr2=0x7fb96414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9640b1cd0 0x7fb96414ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 -- 172.21.15.84:0/2939714828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958009560 con 0x7fb9640c0700 2023-09-10T00:13:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb962ffd640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb958098470 tx=0x7fb9580a57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958003800 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb958003a50 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb964150110 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958003e60 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9641506d0 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.717+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9640712c0 con 0x7fb9640c0700 2023-09-10T00:13:46.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.721+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb9580b4040 con 0x7fb9640c0700 2023-09-10T00:13:46.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.721+0000 7fb94bfff640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 0x7fb950067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.721+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb95811e4e0 con 0x7fb9640c0700 2023-09-10T00:13:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.721+0000 7fb9637fe640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 0x7fb950067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.721+0000 7fb9637fe640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 0x7fb950067fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb954007dc0 tx=0x7fb9540072f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:46.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.725+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb9580ebb90 con 0x7fb9640c0700 2023-09-10T00:13:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.865+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9640af6c0 con 0x7fb9640c0700 2023-09-10T00:13:46.873 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb94bfff640 1 -- 172.21.15.84:0/2939714828 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fb9580ef1b0 con 0x7fb9640c0700 2023-09-10T00:13:46.873 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:46.874 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:46.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 msgr2=0x7fb950067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 0x7fb950067fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb954007dc0 tx=0x7fb9540072f0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 msgr2=0x7fb96414f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb958098470 tx=0x7fb9580a57d0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 shutdown_connections 2023-09-10T00:13:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb950065b20 0x7fb950067fe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb964158a90 0x7fb964153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb9640c0700 0x7fb96414f730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 --2- 172.21.15.84:0/2939714828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9640b1cd0 0x7fb96414ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 >> 172.21.15.84:0/2939714828 conn(0x7fb9640cca70 msgr2=0x7fb96406cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 shutdown_connections 2023-09-10T00:13:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:46.869+0000 7fb969ec5640 1 -- 172.21.15.84:0/2939714828 wait complete. 2023-09-10T00:13:46.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:46.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/408158777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a406fa60 msgr2=0x7f01a40ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- 172.21.15.84:0/408158777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a406fa60 0x7f01a40ca550 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f01a40708b0 tx=0x7f019401c870 comp rx=0 tx=0).stop 2023-09-10T00:13:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/408158777 shutdown_connections 2023-09-10T00:13:47.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- 172.21.15.84:0/408158777 >> v2:172.21.15.100:3300/0 conn(0x7f01a40cbd60 0x7f01a41591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- 172.21.15.84:0/408158777 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a40af770 0x7f01a406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- 172.21.15.84:0/408158777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a406fa60 0x7f01a40ca550 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/408158777 >> 172.21.15.84:0/408158777 conn(0x7f01a40aec00 msgr2=0x7f01a40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/408158777 shutdown_connections 2023-09-10T00:13:47.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/408158777 wait complete. 2023-09-10T00:13:47.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 Processor -- start 2023-09-10T00:13:47.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- start start 2023-09-10T00:13:47.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a406fa60 0x7f01a41534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a40cbd60 0x7f01a4157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415af60 con 0x7f01a40af770 2023-09-10T00:13:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415a2e0 con 0x7f01a40cbd60 2023-09-10T00:13:47.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415a5c0 con 0x7f01a406fa60 2023-09-10T00:13:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49482/0 (socket says 172.21.15.84:49482) 2023-09-10T00:13:47.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 -- 172.21.15.84:0/958229532 learned_addr learned my addr 172.21.15.84:0/958229532 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a2d9d640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a406fa60 0x7f01a41534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a359e640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a40cbd60 0x7f01a4157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 -- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a406fa60 msgr2=0x7f01a41534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a406fa60 0x7f01a41534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 -- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a40cbd60 msgr2=0x7f01a4157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a40cbd60 0x7f01a4157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 -- 172.21.15.84:0/958229532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009560 con 0x7f01a40af770 2023-09-10T00:13:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019a59c640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b550 tx=0x7f018c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c010870 con 0x7f01a40af770 2023-09-10T00:13:47.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f018c010ae0 con 0x7f01a40af770 2023-09-10T00:13:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a415a8a0 con 0x7f01a40af770 2023-09-10T00:13:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00f3c0 con 0x7f01a40af770 2023-09-10T00:13:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.001+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a413fa80 con 0x7f01a40af770 2023-09-10T00:13:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a415b0a0 con 0x7f01a40af770 2023-09-10T00:13:47.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f018c00f520 con 0x7f01a40af770 2023-09-10T00:13:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f019bfff640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 0x7f0184068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f018c083890 con 0x7f01a40af770 2023-09-10T00:13:47.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f01a2d9d640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 0x7f0184068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.005+0000 7f01a2d9d640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 0x7f0184068010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f01940af000 tx=0x7f019401b0b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.009+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f01a415b0a0 con 0x7f01a40af770 2023-09-10T00:13:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.149+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01a415b0a0 con 0x7f01a40af770 2023-09-10T00:13:47.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.149+0000 7f019bfff640 1 -- 172.21.15.84:0/958229532 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01a415b0a0 con 0x7f01a40af770 2023-09-10T00:13:47.156 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:47.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 msgr2=0x7f0184068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 0x7f0184068010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f01940af000 tx=0x7f019401b0b0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 msgr2=0x7f01a4157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b550 tx=0x7f018c00ba10 comp rx=0 tx=0).stop 2023-09-10T00:13:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 shutdown_connections 2023-09-10T00:13:47.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0184065b50 0x7f0184068010 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01a40cbd60 0x7f01a4157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a40af770 0x7f01a4157850 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 --2- 172.21.15.84:0/958229532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f01a406fa60 0x7f01a41534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 >> 172.21.15.84:0/958229532 conn(0x7f01a40aec00 msgr2=0x7f01a413c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 shutdown_connections 2023-09-10T00:13:47.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.153+0000 7f01a9052640 1 -- 172.21.15.84:0/958229532 wait complete. 2023-09-10T00:13:47.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 -- 172.21.15.84:0/2566208546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0880cbd60 msgr2=0x7fe0881591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 --2- 172.21.15.84:0/2566208546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0880cbd60 0x7fe0881591a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe08806dc90 tx=0x7fe08001cd30 comp rx=0 tx=0).stop 2023-09-10T00:13:47.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 -- 172.21.15.84:0/2566208546 shutdown_connections 2023-09-10T00:13:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 --2- 172.21.15.84:0/2566208546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0880cbd60 0x7fe0881591a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 --2- 172.21.15.84:0/2566208546 >> v2:172.21.15.100:3300/0 conn(0x7fe08806fa60 0x7fe0880ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 -- 172.21.15.84:0/2566208546 >> 172.21.15.84:0/2566208546 conn(0x7fe0880aec00 msgr2=0x7fe0880cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 -- 172.21.15.84:0/2566208546 shutdown_connections 2023-09-10T00:13:47.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.281+0000 7fe09007e640 1 -- 172.21.15.84:0/2566208546 wait complete. 2023-09-10T00:13:47.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 Processor -- start 2023-09-10T00:13:47.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- start start 2023-09-10T00:13:47.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 0x7fe088158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0880cbd60 0x7fe088138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08813a6b0 con 0x7fe08806fa60 2023-09-10T00:13:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088158940 con 0x7fe0880af770 2023-09-10T00:13:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880adb90 con 0x7fe0880cbd60 2023-09-10T00:13:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49508/0 (socket says 172.21.15.84:49508) 2023-09-10T00:13:47.292 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 -- 172.21.15.84:0/1029323609 learned_addr learned my addr 172.21.15.84:0/1029323609 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:47.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08e61b640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0880cbd60 0x7fe088138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08d619640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 0x7fe088158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 -- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0880cbd60 msgr2=0x7fe088138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0880cbd60 0x7fe088138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.293 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 -- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 msgr2=0x7fe088158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 0x7fe088158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 -- 172.21.15.84:0/1029323609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800098e0 con 0x7fe08806fa60 2023-09-10T00:13:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08d619640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 0x7fe088158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe08de1a640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e970 tx=0x7fe08400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.294 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084009730 con 0x7fe08806fa60 2023-09-10T00:13:47.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe08400cd80 con 0x7fe08806fa60 2023-09-10T00:13:47.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08813e020 con 0x7fe08806fa60 2023-09-10T00:13:47.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084005280 con 0x7fe08806fa60 2023-09-10T00:13:47.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0880ad0b0 con 0x7fe08806fa60 2023-09-10T00:13:47.295 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0880713a0 con 0x7fe08806fa60 2023-09-10T00:13:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.285+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe0840053e0 con 0x7fe08806fa60 2023-09-10T00:13:47.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.289+0000 7fe07e7fc640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 0x7fe06c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.289+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe084014070 con 0x7fe08806fa60 2023-09-10T00:13:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.289+0000 7fe08d619640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 0x7fe06c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.289+0000 7fe08d619640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 0x7fe06c067fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0880ae2f0 tx=0x7fe078009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.293+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe0840517d0 con 0x7fe08806fa60 2023-09-10T00:13:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.433+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0880cc330 con 0x7fe08806fa60 2023-09-10T00:13:47.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe07e7fc640 1 -- 172.21.15.84:0/1029323609 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe084054df0 con 0x7fe08806fa60 2023-09-10T00:13:47.440 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:47.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 msgr2=0x7fe06c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 0x7fe06c067fe0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe0880ae2f0 tx=0x7fe078009040 comp rx=0 tx=0).stop 2023-09-10T00:13:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 msgr2=0x7fe08813a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e970 tx=0x7fe08400ee30 comp rx=0 tx=0).stop 2023-09-10T00:13:47.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 shutdown_connections 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe06c065b20 0x7fe06c067fe0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0880cbd60 0x7fe088138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880af770 0x7fe088158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 --2- 172.21.15.84:0/1029323609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe08806fa60 0x7fe08813a170 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 >> 172.21.15.84:0/1029323609 conn(0x7fe0880aec00 msgr2=0x7fe0880b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.443 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 shutdown_connections 2023-09-10T00:13:47.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.437+0000 7fe09007e640 1 -- 172.21.15.84:0/1029323609 wait complete. 2023-09-10T00:13:47.457 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- 172.21.15.84:0/2609755427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c06fa60 msgr2=0x7f203c0ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 --2- 172.21.15.84:0/2609755427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c06fa60 0x7f203c0ca550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2038009900 tx=0x7f203801c860 comp rx=0 tx=0).stop 2023-09-10T00:13:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- 172.21.15.84:0/2609755427 shutdown_connections 2023-09-10T00:13:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 --2- 172.21.15.84:0/2609755427 >> v2:172.21.15.100:3300/0 conn(0x7f203c0af770 0x7f203c06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 --2- 172.21.15.84:0/2609755427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c06fa60 0x7f203c0ca550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- 172.21.15.84:0/2609755427 >> 172.21.15.84:0/2609755427 conn(0x7f203c0aec00 msgr2=0x7f203c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- 172.21.15.84:0/2609755427 shutdown_connections 2023-09-10T00:13:47.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- 172.21.15.84:0/2609755427 wait complete. 2023-09-10T00:13:47.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 Processor -- start 2023-09-10T00:13:47.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.581+0000 7f2043c28640 1 -- start start 2023-09-10T00:13:47.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c0af770 0x7f203c1367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f203c0cbd60 0x7f203c137470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1550a0 con 0x7f203c06fa60 2023-09-10T00:13:47.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c136d30 con 0x7f203c0cbd60 2023-09-10T00:13:47.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0ad680 con 0x7f203c0af770 2023-09-10T00:13:47.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49510/0 (socket says 172.21.15.84:49510) 2023-09-10T00:13:47.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 -- 172.21.15.84:0/3662457641 learned_addr learned my addr 172.21.15.84:0/3662457641 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:47.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20411c3640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c0af770 0x7f203c1367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20421c5640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f203c0cbd60 0x7f203c137470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 -- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c0af770 msgr2=0x7f203c1367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c0af770 0x7f203c1367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 -- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f203c0cbd60 msgr2=0x7f203c137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f203c0cbd60 0x7f203c137470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 -- 172.21.15.84:0/3662457641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009560 con 0x7f203c06fa60 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20419c4640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c10 tx=0x7f20380a56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20380ba070 con 0x7f203c06fa60 2023-09-10T00:13:47.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2038003710 con 0x7f203c06fa60 2023-09-10T00:13:47.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c135d10 con 0x7f203c06fa60 2023-09-10T00:13:47.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038003b20 con 0x7f203c06fa60 2023-09-10T00:13:47.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c1362d0 con 0x7f203c06fa60 2023-09-10T00:13:47.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c135b70 con 0x7f203c06fa60 2023-09-10T00:13:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f20380b4040 con 0x7f203c06fa60 2023-09-10T00:13:47.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 0x7f2020067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20411c3640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 0x7f2020067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.585+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f203811db70 con 0x7f203c06fa60 2023-09-10T00:13:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.589+0000 7f20411c3640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 0x7f2020067fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f203c0ab6a0 tx=0x7f202c0091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.589+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f203c135b70 con 0x7f203c06fa60 2023-09-10T00:13:47.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f203c135b70 con 0x7f203c06fa60 2023-09-10T00:13:47.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f20327fc640 1 -- 172.21.15.84:0/3662457641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f203c135b70 con 0x7f203c06fa60 2023-09-10T00:13:47.746 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:47.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 msgr2=0x7f2020067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 0x7f2020067fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f203c0ab6a0 tx=0x7f202c0091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 msgr2=0x7f203c1520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2038000c10 tx=0x7f20380a56d0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 shutdown_connections 2023-09-10T00:13:47.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2020065b20 0x7f2020067fe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f203c0cbd60 0x7f203c137470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f203c0af770 0x7f203c1367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.741+0000 7f2043c28640 1 --2- 172.21.15.84:0/3662457641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f203c06fa60 0x7f203c1520f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.745+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 >> 172.21.15.84:0/3662457641 conn(0x7f203c0aec00 msgr2=0x7f203c15b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.745+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 shutdown_connections 2023-09-10T00:13:47.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.745+0000 7f2043c28640 1 -- 172.21.15.84:0/3662457641 wait complete. 2023-09-10T00:13:47.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/2967721670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6028004d10 msgr2=0x7f6028005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 --2- 172.21.15.84:0/2967721670 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6028004d10 0x7f6028005190 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6038009ee0 tx=0x7f603801d610 comp rx=0 tx=0).stop 2023-09-10T00:13:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 -- 172.21.15.84:0/2967721670 reap_dead start 2023-09-10T00:13:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/2967721670 shutdown_connections 2023-09-10T00:13:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/2967721670 >> 172.21.15.84:0/2967721670 conn(0x7f60400cd570 msgr2=0x7f60400cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:47.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/2967721670 shutdown_connections 2023-09-10T00:13:47.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/2967721670 wait complete. 2023-09-10T00:13:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 Processor -- start 2023-09-10T00:13:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- start start 2023-09-10T00:13:47.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 0x7f60401e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 0x7f6040143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60401440c0 con 0x7f60400c6dc0 2023-09-10T00:13:47.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60401425a0 con 0x7f6028004d10 2023-09-10T00:13:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6040142880 con 0x7f60400c6960 2023-09-10T00:13:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49516/0 (socket says 172.21.15.84:49516) 2023-09-10T00:13:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 -- 172.21.15.84:0/3984505576 learned_addr learned my addr 172.21.15.84:0/3984505576 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:47.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603e59c640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 0x7f60401e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603dd9b640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 0x7f6040143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 -- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 msgr2=0x7f6040143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 0x7f6040143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 -- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 msgr2=0x7f60401e3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:47.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 0x7f60401e3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 -- 172.21.15.84:0/3984505576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040142b60 con 0x7f60400c6dc0 2023-09-10T00:13:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603dd9b640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 0x7f6040143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603e59c640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 0x7f60401e3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f603ed9d640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f603801d080 tx=0x7f6038004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380b7070 con 0x7f60400c6dc0 2023-09-10T00:13:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6038003980 con 0x7f60400c6dc0 2023-09-10T00:13:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6040142e40 con 0x7f60400c6dc0 2023-09-10T00:13:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038003d30 con 0x7f60400c6dc0 2023-09-10T00:13:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.881+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60401e3f40 con 0x7f60400c6dc0 2023-09-10T00:13:47.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604006c610 con 0x7f60400c6dc0 2023-09-10T00:13:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f60380a79c0 con 0x7f60400c6dc0 2023-09-10T00:13:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f602effd640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 0x7f6020067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f603811e4b0 con 0x7f60400c6dc0 2023-09-10T00:13:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f603e59c640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 0x7f6020067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:47.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.885+0000 7f603e59c640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 0x7f6020067fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f60300017b0 tx=0x7f6030009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:47.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:47.889+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f60380eb9b0 con 0x7f60400c6dc0 2023-09-10T00:13:48.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.029+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f60401432f0 con 0x7f60400c6dc0 2023-09-10T00:13:48.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.029+0000 7f602effd640 1 -- 172.21.15.84:0/3984505576 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60380c10a0 con 0x7f60400c6dc0 2023-09-10T00:13:48.037 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 msgr2=0x7f6020067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 0x7f6020067fe0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f60300017b0 tx=0x7f6030009040 comp rx=0 tx=0).stop 2023-09-10T00:13:48.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 msgr2=0x7f6040143b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f603801d080 tx=0x7f6038004f10 comp rx=0 tx=0).stop 2023-09-10T00:13:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 shutdown_connections 2023-09-10T00:13:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6020065b20 0x7f6020067fe0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60400c6dc0 0x7f6040143b80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60400c6960 0x7f6040143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 --2- 172.21.15.84:0/3984505576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6028004d10 0x7f60401e3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 >> 172.21.15.84:0/3984505576 conn(0x7f60400cd570 msgr2=0x7f60400b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 shutdown_connections 2023-09-10T00:13:48.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.033+0000 7f6044c81640 1 -- 172.21.15.84:0/3984505576 wait complete. 2023-09-10T00:13:48.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3794440988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 msgr2=0x7f66680695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- 172.21.15.84:0/3794440988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66680695b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6664009900 tx=0x7f666401f070 comp rx=0 tx=0).stop 2023-09-10T00:13:48.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3794440988 shutdown_connections 2023-09-10T00:13:48.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- 172.21.15.84:0/3794440988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66680b6740 0x7f66680b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- 172.21.15.84:0/3794440988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66680695b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3794440988 >> 172.21.15.84:0/3794440988 conn(0x7f66680d0b30 msgr2=0x7f66680d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3794440988 shutdown_connections 2023-09-10T00:13:48.170 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3794440988 wait complete. 2023-09-10T00:13:48.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 Processor -- start 2023-09-10T00:13:48.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- start start 2023-09-10T00:13:48.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66680b2af0 0x7f6668149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66680b6740 0x7f6668139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.174 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666813a490 con 0x7f666815ad80 2023-09-10T00:13:48.175 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668139f00 con 0x7f66680b6740 2023-09-10T00:13:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666813a1b0 con 0x7f66680b2af0 2023-09-10T00:13:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.176 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49534/0 (socket says 172.21.15.84:49534) 2023-09-10T00:13:48.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 -- 172.21.15.84:0/3670706038 learned_addr learned my addr 172.21.15.84:0/3670706038 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:48.177 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 -- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66680b2af0 msgr2=0x7f6668149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66680b2af0 0x7f6668149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 -- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66680b6740 msgr2=0x7f6668139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66680b6740 0x7f6668139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.178 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 -- 172.21.15.84:0/3670706038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664009560 con 0x7f666815ad80 2023-09-10T00:13:48.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f666ebfb640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f666000c780 tx=0x7f666000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6660003d90 con 0x7f666815ad80 2023-09-10T00:13:48.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f666000ce90 con 0x7f666815ad80 2023-09-10T00:13:48.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66680c45e0 con 0x7f666815ad80 2023-09-10T00:13:48.179 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66600052d0 con 0x7f666815ad80 2023-09-10T00:13:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66680c4ba0 con 0x7f666815ad80 2023-09-10T00:13:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.165+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66680c4dc0 con 0x7f666815ad80 2023-09-10T00:13:48.180 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.169+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6660005430 con 0x7f666815ad80 2023-09-10T00:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.169+0000 7f665effd640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 0x7f664c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.169+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6660083130 con 0x7f666815ad80 2023-09-10T00:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.169+0000 7f666e3fa640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 0x7f664c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.181 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.169+0000 7f666e3fa640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 0x7f664c067fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66640b2000 tx=0x7f666401be10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.182 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.173+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6660050750 con 0x7f666815ad80 2023-09-10T00:13:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6668073390 con 0x7f666815ad80 2023-09-10T00:13:48.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f665effd640 1 -- 172.21.15.84:0/3670706038 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6660053d70 con 0x7f666815ad80 2023-09-10T00:13:48.341 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:48.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 msgr2=0x7f664c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 0x7f664c067fe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66640b2000 tx=0x7f666401be10 comp rx=0 tx=0).stop 2023-09-10T00:13:48.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 msgr2=0x7f66681399c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f666000c780 tx=0x7f666000cc40 comp rx=0 tx=0).stop 2023-09-10T00:13:48.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 shutdown_connections 2023-09-10T00:13:48.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f664c065b20 0x7f664c067fe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f666815ad80 0x7f66681399c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66680b6740 0x7f6668139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 --2- 172.21.15.84:0/3670706038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66680b2af0 0x7f6668149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 >> 172.21.15.84:0/3670706038 conn(0x7f66680d0b30 msgr2=0x7f66680cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 shutdown_connections 2023-09-10T00:13:48.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.337+0000 7f667065e640 1 -- 172.21.15.84:0/3670706038 wait complete. 2023-09-10T00:13:48.358 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2023-09-10T00:13:48.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:48.359 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-09-10T00:13:48.372 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:48.373 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T00:13:48.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:48.374 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-10T00:13:48.421 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:48.422 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:48.428 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:48.429 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:48.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 -- 172.21.15.84:0/2019319750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ffc0039b0 msgr2=0x7f4ffc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2019319750 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ffc0039b0 0x7f4ffc003dd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f500c0014e0 tx=0x7f500c01c5b0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f501633c640 1 -- 172.21.15.84:0/2019319750 reap_dead start 2023-09-10T00:13:48.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 -- 172.21.15.84:0/2019319750 shutdown_connections 2023-09-10T00:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 -- 172.21.15.84:0/2019319750 >> 172.21.15.84:0/2019319750 conn(0x7f50100cca70 msgr2=0x7f50100cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 -- 172.21.15.84:0/2019319750 shutdown_connections 2023-09-10T00:13:48.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.601+0000 7f5017d9f640 1 -- 172.21.15.84:0/2019319750 wait complete. 2023-09-10T00:13:48.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 Processor -- start 2023-09-10T00:13:48.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- start start 2023-09-10T00:13:48.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50101f4070 0x7f50101609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5010159c50 0x7f501006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010151330 con 0x7f501006c020 2023-09-10T00:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5010157f20 con 0x7f5010159c50 2023-09-10T00:13:48.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501006c4a0 con 0x7f50101f4070 2023-09-10T00:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49560/0 (socket says 172.21.15.84:49560) 2023-09-10T00:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 -- 172.21.15.84:0/2199681881 learned_addr learned my addr 172.21.15.84:0/2199681881 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:48.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5015b3b640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50101f4070 0x7f50101609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501533a640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5010159c50 0x7f501006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 -- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50101f4070 msgr2=0x7f50101609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50101f4070 0x7f50101609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 -- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5010159c50 msgr2=0x7f501006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5010159c50 0x7f501006bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 -- 172.21.15.84:0/2199681881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50101f4450 con 0x7f501006c020 2023-09-10T00:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f501633c640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f501006dcb0 tx=0x7f5008010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500800ee10 con 0x7f501006c020 2023-09-10T00:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5008004c20 con 0x7f501006c020 2023-09-10T00:13:48.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5010160f30 con 0x7f501006c020 2023-09-10T00:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008003980 con 0x7f501006c020 2023-09-10T00:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50101517f0 con 0x7f501006c020 2023-09-10T00:13:48.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5010151a10 con 0x7f501006c020 2023-09-10T00:13:48.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5008003ae0 con 0x7f501006c020 2023-09-10T00:13:48.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.605+0000 7f50067fc640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 0x7f4ff4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.609+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5008083da0 con 0x7f501006c020 2023-09-10T00:13:48.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.609+0000 7f5015b3b640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 0x7f4ff4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.609+0000 7f5015b3b640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 0x7f4ff4068010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0057b0 tx=0x7f500c019350 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.617 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.613+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5008051330 con 0x7f501006c020 2023-09-10T00:13:48.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.765+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f501014b410 con 0x7f501006c020 2023-09-10T00:13:48.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.765+0000 7f50067fc640 1 -- 172.21.15.84:0/2199681881 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f501014b410 con 0x7f501006c020 2023-09-10T00:13:48.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:48.772 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 msgr2=0x7f4ff4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 0x7f4ff4068010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0057b0 tx=0x7f500c019350 comp rx=0 tx=0).stop 2023-09-10T00:13:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 msgr2=0x7f501015f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f501006dcb0 tx=0x7f5008010e80 comp rx=0 tx=0).stop 2023-09-10T00:13:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 shutdown_connections 2023-09-10T00:13:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4ff4065b50 0x7f4ff4068010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501006c020 0x7f501015f740 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5010159c50 0x7f501006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 --2- 172.21.15.84:0/2199681881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f50101f4070 0x7f50101609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 >> 172.21.15.84:0/2199681881 conn(0x7f50100cca70 msgr2=0x7f501014cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 shutdown_connections 2023-09-10T00:13:48.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.769+0000 7f5017d9f640 1 -- 172.21.15.84:0/2199681881 wait complete. 2023-09-10T00:13:48.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:48.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 -- 172.21.15.84:0/435015735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 msgr2=0x7fde0815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 --2- 172.21.15.84:0/435015735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde0815b540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fde0806f9f0 tx=0x7fddf801c7e0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 -- 172.21.15.84:0/435015735 shutdown_connections 2023-09-10T00:13:48.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 --2- 172.21.15.84:0/435015735 >> v2:172.21.15.100:3300/0 conn(0x7fde0806cae0 0x7fde080ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 --2- 172.21.15.84:0/435015735 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde08157f00 0x7fde0806c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 --2- 172.21.15.84:0/435015735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde0815b540 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 -- 172.21.15.84:0/435015735 >> 172.21.15.84:0/435015735 conn(0x7fde080aec00 msgr2=0x7fde080cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:48.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 -- 172.21.15.84:0/435015735 shutdown_connections 2023-09-10T00:13:48.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.909+0000 7fde0cc48640 1 -- 172.21.15.84:0/435015735 wait complete. 2023-09-10T00:13:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 Processor -- start 2023-09-10T00:13:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- start start 2023-09-10T00:13:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde0806cae0 0x7fde081f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde08157f00 0x7fde0814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0814cb70 con 0x7fde0814eb10 2023-09-10T00:13:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081f2e10 con 0x7fde08157f00 2023-09-10T00:13:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080ade70 con 0x7fde0806cae0 2023-09-10T00:13:48.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49584/0 (socket says 172.21.15.84:49584) 2023-09-10T00:13:48.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 -- 172.21.15.84:0/1883205838 learned_addr learned my addr 172.21.15.84:0/1883205838 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:48.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0659c640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde0806cae0 0x7fde081f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 -- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde0806cae0 msgr2=0x7fde081f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde0806cae0 0x7fde081f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde06d9d640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde08157f00 0x7fde0814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 -- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde08157f00 msgr2=0x7fde0814aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde08157f00 0x7fde0814aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 -- 172.21.15.84:0/1883205838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009560 con 0x7fde0814eb10 2023-09-10T00:13:48.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde05d9b640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00d720 tx=0x7fddfc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc009bd0 con 0x7fde0814eb10 2023-09-10T00:13:48.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fddfc009e20 con 0x7fde0814eb10 2023-09-10T00:13:48.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0814bf60 con 0x7fde0814eb10 2023-09-10T00:13:48.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc005280 con 0x7fde0814eb10 2023-09-10T00:13:48.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0814c520 con 0x7fde0814eb10 2023-09-10T00:13:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.913+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde080713a0 con 0x7fde0814eb10 2023-09-10T00:13:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.917+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fddfc0053e0 con 0x7fde0814eb10 2023-09-10T00:13:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.917+0000 7fddf6ffd640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 0x7fdde8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.917+0000 7fde0659c640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 0x7fdde8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.917+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fddfc0837e0 con 0x7fde0814eb10 2023-09-10T00:13:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.917+0000 7fde0659c640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 0x7fdde8067fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf80af000 tx=0x7fddf801b020 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:48.921+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fddfc050d70 con 0x7fde0814eb10 2023-09-10T00:13:49.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.061+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde081636c0 con 0x7fde0814eb10 2023-09-10T00:13:49.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.061+0000 7fddf6ffd640 1 -- 172.21.15.84:0/1883205838 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddfc0170a0 con 0x7fde0814eb10 2023-09-10T00:13:49.066 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:49.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 msgr2=0x7fdde8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 0x7fdde8067fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fddf80af000 tx=0x7fddf801b020 comp rx=0 tx=0).stop 2023-09-10T00:13:49.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 msgr2=0x7fde08140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00d720 tx=0x7fddfc00dbe0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 shutdown_connections 2023-09-10T00:13:49.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fdde8065b20 0x7fdde8067fe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde08157f00 0x7fde0814aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0814eb10 0x7fde08140f10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 --2- 172.21.15.84:0/1883205838 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde0806cae0 0x7fde081f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 >> 172.21.15.84:0/1883205838 conn(0x7fde080aec00 msgr2=0x7fde08159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 shutdown_connections 2023-09-10T00:13:49.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.065+0000 7fde0cc48640 1 -- 172.21.15.84:0/1883205838 wait complete. 2023-09-10T00:13:49.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:49.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- 172.21.15.84:0/3525080982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 msgr2=0x7fa59c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3525080982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa59c00b990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8001d70 tx=0x7fa5a801cae0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- 172.21.15.84:0/3525080982 shutdown_connections 2023-09-10T00:13:49.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3525080982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa59c00b990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- 172.21.15.84:0/3525080982 >> 172.21.15.84:0/3525080982 conn(0x7fa5b00ce890 msgr2=0x7fa5b00ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- 172.21.15.84:0/3525080982 shutdown_connections 2023-09-10T00:13:49.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- 172.21.15.84:0/3525080982 wait complete. 2023-09-10T00:13:49.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 Processor -- start 2023-09-10T00:13:49.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- start start 2023-09-10T00:13:49.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b01e2b00 0x7fa5b01e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5b00a6260 0x7fa5b00a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01e43b0 con 0x7fa59c0052b0 2023-09-10T00:13:49.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01e3830 con 0x7fa5b01e2b00 2023-09-10T00:13:49.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b8221640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01e3b10 con 0x7fa5b00a6260 2023-09-10T00:13:49.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49606/0 (socket says 172.21.15.84:49606) 2023-09-10T00:13:49.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 -- 172.21.15.84:0/3937656712 learned_addr learned my addr 172.21.15.84:0/3937656712 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:49.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b57bc640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b01e2b00 0x7fa5b01e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b67be640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5b00a6260 0x7fa5b00a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 -- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5b00a6260 msgr2=0x7fa5b00a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5b00a6260 0x7fa5b00a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 -- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b01e2b00 msgr2=0x7fa5b01e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b01e2b00 0x7fa5b01e2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 -- 172.21.15.84:0/3937656712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b01e3df0 con 0x7fa59c0052b0 2023-09-10T00:13:49.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5b5fbd640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000fc0 tx=0x7fa5ac00fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.209+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0118a0 con 0x7fa59c0052b0 2023-09-10T00:13:49.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5ac011af0 con 0x7fa59c0052b0 2023-09-10T00:13:49.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b01e40d0 con 0x7fa59c0052b0 2023-09-10T00:13:49.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac011ea0 con 0x7fa59c0052b0 2023-09-10T00:13:49.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b00a6c30 con 0x7fa59c0052b0 2023-09-10T00:13:49.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b006f2a0 con 0x7fa59c0052b0 2023-09-10T00:13:49.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa5ac012470 con 0x7fa59c0052b0 2023-09-10T00:13:49.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5a67fc640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 0x7fa594067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa5ac086bb0 con 0x7fa59c0052b0 2023-09-10T00:13:49.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5b57bc640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 0x7fa594067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.213+0000 7fa5b57bc640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 0x7fa594067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b0f10 tx=0x7fa5a000f4d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.217+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa5ac0541d0 con 0x7fa59c0052b0 2023-09-10T00:13:49.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5b0073400 con 0x7fa59c0052b0 2023-09-10T00:13:49.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5a67fc640 1 -- 172.21.15.84:0/3937656712 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5ac0577f0 con 0x7fa59c0052b0 2023-09-10T00:13:49.361 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:49.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 msgr2=0x7fa594067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 0x7fa594067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b0f10 tx=0x7fa5a000f4d0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 msgr2=0x7fa5b00c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac000fc0 tx=0x7fa5ac00fa30 comp rx=0 tx=0).stop 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 shutdown_connections 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa594065b20 0x7fa594067fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5b00a6260 0x7fa5b00a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b01e2b00 0x7fa5b01e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.357+0000 7fa5b8221640 1 --2- 172.21.15.84:0/3937656712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa59c0052b0 0x7fa5b00c47f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.361+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 >> 172.21.15.84:0/3937656712 conn(0x7fa5b00ce890 msgr2=0x7fa5b00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.361+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 shutdown_connections 2023-09-10T00:13:49.365 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.361+0000 7fa5b8221640 1 -- 172.21.15.84:0/3937656712 wait complete. 2023-09-10T00:13:49.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 -- 172.21.15.84:0/1836372950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 msgr2=0x7f957c06c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 --2- 172.21.15.84:0/1836372950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c06c710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f957400ad90 tx=0x7f957401dc60 comp rx=0 tx=0).stop 2023-09-10T00:13:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 -- 172.21.15.84:0/1836372950 shutdown_connections 2023-09-10T00:13:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 --2- 172.21.15.84:0/1836372950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c06c710 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 --2- 172.21.15.84:0/1836372950 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c06fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 -- 172.21.15.84:0/1836372950 >> 172.21.15.84:0/1836372950 conn(0x7f957c0aec00 msgr2=0x7f957c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 -- 172.21.15.84:0/1836372950 shutdown_connections 2023-09-10T00:13:49.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.497+0000 7f958207f640 1 -- 172.21.15.84:0/1836372950 wait complete. 2023-09-10T00:13:49.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 Processor -- start 2023-09-10T00:13:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- start start 2023-09-10T00:13:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f957c158230 0x7f957c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c1549f0 con 0x7f957c06c280 2023-09-10T00:13:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c14ef80 con 0x7f957c158230 2023-09-10T00:13:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c14f260 con 0x7f957c06fa60 2023-09-10T00:13:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49618/0 (socket says 172.21.15.84:49618) 2023-09-10T00:13:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 -- 172.21.15.84:0/2766340505 learned_addr learned my addr 172.21.15.84:0/2766340505 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9572ffd640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957bfff640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f957c158230 0x7f957c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 -- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 msgr2=0x7f957c1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.510 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c1544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 -- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f957c158230 msgr2=0x7f957c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f957c158230 0x7f957c150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 -- 172.21.15.84:0/2766340505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957400a9f0 con 0x7f957c06c280 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9572ffd640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f957b7fe640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c970 tx=0x7f956c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c007bb0 con 0x7f957c06c280 2023-09-10T00:13:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f956c007e00 con 0x7f957c06c280 2023-09-10T00:13:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c14f540 con 0x7f957c06c280 2023-09-10T00:13:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956c005280 con 0x7f957c06c280 2023-09-10T00:13:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c14fb00 con 0x7f957c06c280 2023-09-10T00:13:49.512 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c14fd20 con 0x7f957c06c280 2023-09-10T00:13:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.501+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f956c0053e0 con 0x7f957c06c280 2023-09-10T00:13:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.505+0000 7f9578ff9640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 0x7f955c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.505+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f956c083d20 con 0x7f957c06c280 2023-09-10T00:13:49.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.505+0000 7f9572ffd640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 0x7f955c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.505+0000 7f9572ffd640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 0x7f955c067fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f957c151e70 tx=0x7f9564009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.509+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f956c0512b0 con 0x7f957c06c280 2023-09-10T00:13:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f957c0713a0 con 0x7f957c06c280 2023-09-10T00:13:49.660 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f9578ff9640 1 -- 172.21.15.84:0/2766340505 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f956c01d070 con 0x7f957c06c280 2023-09-10T00:13:49.661 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:49.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 msgr2=0x7f955c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 0x7f955c067fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f957c151e70 tx=0x7f9564009040 comp rx=0 tx=0).stop 2023-09-10T00:13:49.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 msgr2=0x7f957c1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c970 tx=0x7f956c00ce30 comp rx=0 tx=0).stop 2023-09-10T00:13:49.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 shutdown_connections 2023-09-10T00:13:49.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f955c065b20 0x7f955c067fe0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f957c158230 0x7f957c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f957c06fa60 0x7f957c1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 --2- 172.21.15.84:0/2766340505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f957c06c280 0x7f957c1468e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 >> 172.21.15.84:0/2766340505 conn(0x7f957c0aec00 msgr2=0x7f957c0695b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 shutdown_connections 2023-09-10T00:13:49.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.657+0000 7f958207f640 1 -- 172.21.15.84:0/2766340505 wait complete. 2023-09-10T00:13:49.678 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:49.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 -- 172.21.15.84:0/4191285617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95e0004ac0 msgr2=0x7f95e0004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/4191285617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95e0004ac0 0x7f95e0004ee0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f95e40016b0 tx=0x7f95e401c770 comp rx=0 tx=0).stop 2023-09-10T00:13:49.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f3fff640 1 -- 172.21.15.84:0/4191285617 reap_dead start 2023-09-10T00:13:49.806 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 -- 172.21.15.84:0/4191285617 shutdown_connections 2023-09-10T00:13:49.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 -- 172.21.15.84:0/4191285617 >> 172.21.15.84:0/4191285617 conn(0x7f95f40aec00 msgr2=0x7f95f40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 -- 172.21.15.84:0/4191285617 shutdown_connections 2023-09-10T00:13:49.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.797+0000 7f95f9b8d640 1 -- 172.21.15.84:0/4191285617 wait complete. 2023-09-10T00:13:49.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 Processor -- start 2023-09-10T00:13:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- start start 2023-09-10T00:13:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95e0004ac0 0x7f95f4145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 0x7f95f40ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4152690 con 0x7f95f4153fc0 2023-09-10T00:13:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40addd0 con 0x7f95e0004ac0 2023-09-10T00:13:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4146380 con 0x7f95f40ad330 2023-09-10T00:13:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49626/0 (socket says 172.21.15.84:49626) 2023-09-10T00:13:49.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 -- 172.21.15.84:0/3148681601 learned_addr learned my addr 172.21.15.84:0/3148681601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:49.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95eaffd640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 0x7f95f40ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f37fe640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95e0004ac0 0x7f95f4145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 -- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 msgr2=0x7f95f40ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.810 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 0x7f95f40ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 -- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95e0004ac0 msgr2=0x7f95f4145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95e0004ac0 0x7f95f4145e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 -- 172.21.15.84:0/3148681601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4152b20 con 0x7f95f4153fc0 2023-09-10T00:13:49.811 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95eaffd640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 0x7f95f40ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f3fff640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f95f40cd620 tx=0x7f95ec00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00aa20 con 0x7f95f4153fc0 2023-09-10T00:13:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f95ec00ac70 con 0x7f95f4153fc0 2023-09-10T00:13:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f4151d60 con 0x7f95f4153fc0 2023-09-10T00:13:49.812 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0070d0 con 0x7f95f4153fc0 2023-09-10T00:13:49.813 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4152320 con 0x7f95f4153fc0 2023-09-10T00:13:49.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f40713a0 con 0x7f95f4153fc0 2023-09-10T00:13:49.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f95ec007230 con 0x7f95f4153fc0 2023-09-10T00:13:49.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.801+0000 7f95f0ff9640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 0x7f95d4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:49.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.805+0000 7f95f37fe640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 0x7f95d4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:49.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.805+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95ec0834d0 con 0x7f95f4153fc0 2023-09-10T00:13:49.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.805+0000 7f95f37fe640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 0x7f95d4068010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f95e4001680 tx=0x7f95e4019510 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:49.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.809+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f95ec050a60 con 0x7f95f4153fc0 2023-09-10T00:13:49.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.949+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95f4070d10 con 0x7f95f4153fc0 2023-09-10T00:13:49.954 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.949+0000 7f95f0ff9640 1 -- 172.21.15.84:0/3148681601 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95ec0170a0 con 0x7f95f4153fc0 2023-09-10T00:13:49.954 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:49.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 msgr2=0x7f95d4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 0x7f95d4068010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f95e4001680 tx=0x7f95e4019510 comp rx=0 tx=0).stop 2023-09-10T00:13:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 msgr2=0x7f95f4154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:49.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f95f40cd620 tx=0x7f95ec00cd00 comp rx=0 tx=0).stop 2023-09-10T00:13:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 shutdown_connections 2023-09-10T00:13:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f95d4065b50 0x7f95d4068010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.958 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95f4153fc0 0x7f95f4154440 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f95f40ad330 0x7f95f40ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 --2- 172.21.15.84:0/3148681601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95e0004ac0 0x7f95f4145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:49.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 >> 172.21.15.84:0/3148681601 conn(0x7f95f40aec00 msgr2=0x7f95f41510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 shutdown_connections 2023-09-10T00:13:49.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:49.953+0000 7f95f9b8d640 1 -- 172.21.15.84:0/3148681601 wait complete. 2023-09-10T00:13:49.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:50.091 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- 172.21.15.84:0/1842170381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27641549b0 msgr2=0x7f27640c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- 172.21.15.84:0/1842170381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27641549b0 0x7f27640c7d50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27640ac920 tx=0x7f275401c830 comp rx=0 tx=0).stop 2023-09-10T00:13:50.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- 172.21.15.84:0/1842170381 shutdown_connections 2023-09-10T00:13:50.092 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- 172.21.15.84:0/1842170381 >> v2:172.21.15.100:3300/0 conn(0x7f27640cbd30 0x7f27640707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- 172.21.15.84:0/1842170381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27641549b0 0x7f27640c7d50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- 172.21.15.84:0/1842170381 >> 172.21.15.84:0/1842170381 conn(0x7f27640cd0e0 msgr2=0x7f27640cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- 172.21.15.84:0/1842170381 shutdown_connections 2023-09-10T00:13:50.093 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- 172.21.15.84:0/1842170381 wait complete. 2023-09-10T00:13:50.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 Processor -- start 2023-09-10T00:13:50.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- start start 2023-09-10T00:13:50.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2764070360 0x7f276409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.094 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f27641549b0 0x7f276409c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276406d780 con 0x7f27640cbd30 2023-09-10T00:13:50.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640c7350 con 0x7f2764070360 2023-09-10T00:13:50.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2769ca4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276406cde0 con 0x7f27641549b0 2023-09-10T00:13:50.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2762ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2762ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36946/0 (socket says 172.21.15.84:36946) 2023-09-10T00:13:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2762ffd640 1 -- 172.21.15.84:0/3784814248 learned_addr learned my addr 172.21.15.84:0/3784814248 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f2763fff640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f27641549b0 0x7f276409c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.081+0000 7f27637fe640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2764070360 0x7f276409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 -- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f27641549b0 msgr2=0x7f276409c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.096 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f27641549b0 0x7f276409c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 -- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2764070360 msgr2=0x7f276409b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2764070360 0x7f276409b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 -- 172.21.15.84:0/3784814248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754009560 con 0x7f27640cbd30 2023-09-10T00:13:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2762ffd640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f275800c450 tx=0x7f275800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758012830 con 0x7f27640cbd30 2023-09-10T00:13:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276406d0c0 con 0x7f27640cbd30 2023-09-10T00:13:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2758012aa0 con 0x7f27640cbd30 2023-09-10T00:13:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758011380 con 0x7f27640cbd30 2023-09-10T00:13:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27640c6b40 con 0x7f27640cbd30 2023-09-10T00:13:50.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764072b50 con 0x7f27640cbd30 2023-09-10T00:13:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f27580114e0 con 0x7f27640cbd30 2023-09-10T00:13:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 0x7f2750067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2758083800 con 0x7f27640cbd30 2023-09-10T00:13:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f27637fe640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 0x7f2750067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.085+0000 7f27637fe640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 0x7f2750067fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27540af000 tx=0x7f275401b070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.100 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.089+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2758050d10 con 0x7f27640cbd30 2023-09-10T00:13:50.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27640c7900 con 0x7f27640cbd30 2023-09-10T00:13:50.261 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f274bfff640 1 -- 172.21.15.84:0/3784814248 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2758054330 con 0x7f27640cbd30 2023-09-10T00:13:50.261 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:50.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 msgr2=0x7f2750067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 0x7f2750067fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27540af000 tx=0x7f275401b070 comp rx=0 tx=0).stop 2023-09-10T00:13:50.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 msgr2=0x7f276409bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f275800c450 tx=0x7f275800c910 comp rx=0 tx=0).stop 2023-09-10T00:13:50.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 shutdown_connections 2023-09-10T00:13:50.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2750065b20 0x7f2750067fe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f27641549b0 0x7f276409c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27640cbd30 0x7f276409bb70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 --2- 172.21.15.84:0/3784814248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2764070360 0x7f276409b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 >> 172.21.15.84:0/3784814248 conn(0x7f27640cd0e0 msgr2=0x7f27640ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 shutdown_connections 2023-09-10T00:13:50.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.257+0000 7f2769ca4640 1 -- 172.21.15.84:0/3784814248 wait complete. 2023-09-10T00:13:50.279 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T00:13:50.280 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T00:13:50.286 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/1074463013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 msgr2=0x7f7e6415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.412 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/1074463013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e6415a1e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009840 tx=0x7f7e5801c730 comp rx=0 tx=0).stop 2023-09-10T00:13:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/1074463013 shutdown_connections 2023-09-10T00:13:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/1074463013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e6415a1e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/1074463013 >> 172.21.15.84:0/1074463013 conn(0x7f7e640cb7c0 msgr2=0x7f7e640cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/1074463013 shutdown_connections 2023-09-10T00:13:50.413 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/1074463013 wait complete. 2023-09-10T00:13:50.415 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 Processor -- start 2023-09-10T00:13:50.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- start start 2023-09-10T00:13:50.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 0x7f7e641f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.416 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 0x7f7e641f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6414e390 con 0x7f7e640c9b60 2023-09-10T00:13:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641f6380 con 0x7f7e64159020 2023-09-10T00:13:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e641f3850 con 0x7f7e640b0790 2023-09-10T00:13:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.417 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36956/0 (socket says 172.21.15.84:36956) 2023-09-10T00:13:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 -- 172.21.15.84:0/3320088457 learned_addr learned my addr 172.21.15.84:0/3320088457 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e68a94640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 0x7f7e641f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e69295640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 0x7f7e641f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 -- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 msgr2=0x7f7e641f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.418 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 0x7f7e641f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 -- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 msgr2=0x7f7e641f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 0x7f7e641f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 -- 172.21.15.84:0/3320088457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580094a0 con 0x7f7e640c9b60 2023-09-10T00:13:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e69295640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 0x7f7e641f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:50.419 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e68a94640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 0x7f7e641f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e63fff640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c3c0 tx=0x7f7e5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50004230 con 0x7f7e640c9b60 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e50004480 con 0x7f7e640c9b60 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e641f3b30 con 0x7f7e640c9b60 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e50003860 con 0x7f7e640c9b60 2023-09-10T00:13:50.420 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.409+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e641f68b0 con 0x7f7e640c9b60 2023-09-10T00:13:50.421 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e641f6aa0 con 0x7f7e640c9b60 2023-09-10T00:13:50.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7e500039c0 con 0x7f7e640c9b60 2023-09-10T00:13:50.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e617fa640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 0x7f7e48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e50082bf0 con 0x7f7e640c9b60 2023-09-10T00:13:50.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e68a94640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 0x7f7e48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.413+0000 7f7e68a94640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 0x7f7e48067fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e580af000 tx=0x7f7e5801af70 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.423 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.417+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7e50050180 con 0x7f7e640c9b60 2023-09-10T00:13:50.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.569+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e640c9f40 con 0x7f7e640c9b60 2023-09-10T00:13:50.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e617fa640 1 -- 172.21.15.84:0/3320088457 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f7e640c9f40 con 0x7f7e640c9b60 2023-09-10T00:13:50.577 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:50.578 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:50.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 msgr2=0x7f7e48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 0x7f7e48067fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e580af000 tx=0x7f7e5801af70 comp rx=0 tx=0).stop 2023-09-10T00:13:50.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 msgr2=0x7f7e64148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000c3c0 tx=0x7f7e5000c880 comp rx=0 tx=0).stop 2023-09-10T00:13:50.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 shutdown_connections 2023-09-10T00:13:50.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e48065b20 0x7f7e48067fe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e64159020 0x7f7e641f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e640c9b60 0x7f7e64148b80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 --2- 172.21.15.84:0/3320088457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e640b0790 0x7f7e641f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.573+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 >> 172.21.15.84:0/3320088457 conn(0x7f7e640cb7c0 msgr2=0x7f7e64156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.577+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 shutdown_connections 2023-09-10T00:13:50.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.577+0000 7f7e6acf8640 1 -- 172.21.15.84:0/3320088457 wait complete. 2023-09-10T00:13:50.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:50.597 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- 172.21.15.84:0/1657391238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 msgr2=0x7f5c58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.717 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1657391238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c58004c50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5c540016b0 tx=0x7f5c5401c780 comp rx=0 tx=0).stop 2023-09-10T00:13:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- 172.21.15.84:0/1657391238 shutdown_connections 2023-09-10T00:13:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1657391238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c58004c50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- 172.21.15.84:0/1657391238 >> 172.21.15.84:0/1657391238 conn(0x7f5c6c0cd570 msgr2=0x7f5c6c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- 172.21.15.84:0/1657391238 shutdown_connections 2023-09-10T00:13:50.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- 172.21.15.84:0/1657391238 wait complete. 2023-09-10T00:13:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 Processor -- start 2023-09-10T00:13:50.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- start start 2023-09-10T00:13:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c6c1429c0 0x7f5c6c1e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 0x7f5c6c0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c0b5140 con 0x7f5c580047d0 2023-09-10T00:13:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1e0210 con 0x7f5c6c0b4770 2023-09-10T00:13:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c7085b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c1e04f0 con 0x7f5c6c1429c0 2023-09-10T00:13:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36970/0 (socket says 172.21.15.84:36970) 2023-09-10T00:13:50.723 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 -- 172.21.15.84:0/1747494395 learned_addr learned my addr 172.21.15.84:0/1747494395 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c61d9b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c6c1429c0 0x7f5c6c1e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6ad9d640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 0x7f5c6c0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 -- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c6c1429c0 msgr2=0x7f5c6c1e4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c6c1429c0 0x7f5c6c1e4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 -- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 msgr2=0x7f5c6c0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 0x7f5c6c0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6a59c640 1 -- 172.21.15.84:0/1747494395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c1e07d0 con 0x7f5c580047d0 2023-09-10T00:13:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.713+0000 7f5c6ad9d640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 0x7f5c6c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c6a59c640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00d6d0 tx=0x7f5c5c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c004230 con 0x7f5c580047d0 2023-09-10T00:13:50.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c5c0044a0 con 0x7f5c580047d0 2023-09-10T00:13:50.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c1e0ab0 con 0x7f5c580047d0 2023-09-10T00:13:50.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c009a60 con 0x7f5c580047d0 2023-09-10T00:13:50.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c1f4710 con 0x7f5c580047d0 2023-09-10T00:13:50.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c06c610 con 0x7f5c580047d0 2023-09-10T00:13:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5c5c009bc0 con 0x7f5c580047d0 2023-09-10T00:13:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 0x7f5c4c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c5c083a40 con 0x7f5c580047d0 2023-09-10T00:13:50.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c61d9b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 0x7f5c4c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.717+0000 7f5c61d9b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 0x7f5c4c067fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001680 tx=0x7f5c54019520 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:50.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.721+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5c5c089020 con 0x7f5c580047d0 2023-09-10T00:13:50.865 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.861+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c6c073400 con 0x7f5c580047d0 2023-09-10T00:13:50.866 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.861+0000 7f5c637fe640 1 -- 172.21.15.84:0/1747494395 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c5c0200a0 con 0x7f5c580047d0 2023-09-10T00:13:50.866 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:50.868 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 msgr2=0x7f5c4c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 0x7f5c4c067fe0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5c54001680 tx=0x7f5c54019520 comp rx=0 tx=0).stop 2023-09-10T00:13:50.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 msgr2=0x7f5c6c1f41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:50.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00d6d0 tx=0x7f5c5c00db90 comp rx=0 tx=0).stop 2023-09-10T00:13:50.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 shutdown_connections 2023-09-10T00:13:50.869 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5c4c065b20 0x7f5c4c067fe0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c6c0b4770 0x7f5c6c0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5c6c1429c0 0x7f5c6c1e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 --2- 172.21.15.84:0/1747494395 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5c580047d0 0x7f5c6c1f41d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:50.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 >> 172.21.15.84:0/1747494395 conn(0x7f5c6c0cd570 msgr2=0x7f5c6c1520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:50.870 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 shutdown_connections 2023-09-10T00:13:50.871 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:50.865+0000 7f5c7085b640 1 -- 172.21.15.84:0/1747494395 wait complete. 2023-09-10T00:13:50.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/2212209419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af006ccb0 msgr2=0x7f0af00ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- 172.21.15.84:0/2212209419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af006ccb0 0x7f0af00ab480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009c80 tx=0x7f0ae801ccc0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/2212209419 shutdown_connections 2023-09-10T00:13:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- 172.21.15.84:0/2212209419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af006ccb0 0x7f0af00ab480 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- 172.21.15.84:0/2212209419 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af014eb10 0x7f0af015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/2212209419 >> 172.21.15.84:0/2212209419 conn(0x7f0af00aec00 msgr2=0x7f0af00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/2212209419 shutdown_connections 2023-09-10T00:13:51.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/2212209419 wait complete. 2023-09-10T00:13:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 Processor -- start 2023-09-10T00:13:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- start start 2023-09-10T00:13:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af006ccb0 0x7f0af0151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 0x7f0af00aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af01570c0 con 0x7f0af0157f00 2023-09-10T00:13:51.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00ab480 con 0x7f0af014eb10 2023-09-10T00:13:51.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0157b00 con 0x7f0af006ccb0 2023-09-10T00:13:51.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36980/0 (socket says 172.21.15.84:36980) 2023-09-10T00:13:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 -- 172.21.15.84:0/3209894748 learned_addr learned my addr 172.21.15.84:0/3209894748 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aeeffd640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af006ccb0 0x7f0af0151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0ae7fff640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 0x7f0af00aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 -- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af006ccb0 msgr2=0x7f0af0151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af006ccb0 0x7f0af0151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 -- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 msgr2=0x7f0af00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 0x7f0af00aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 -- 172.21.15.84:0/3209894748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80098e0 con 0x7f0af0157f00 2023-09-10T00:13:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0ae7fff640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 0x7f0af00aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0aef7fe640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0ae801a8f0 tx=0x7f0ae8009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8004e60 con 0x7f0af0157f00 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ae8004000 con 0x7f0af0157f00 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af00a5c60 con 0x7f0af0157f00 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80043d0 con 0x7f0af0157f00 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.001+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0157820 con 0x7f0af0157f00 2023-09-10T00:13:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af0157200 con 0x7f0af0157f00 2023-09-10T00:13:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0ae80b4040 con 0x7f0af0157f00 2023-09-10T00:13:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0ae77fe640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 0x7f0ad0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ae811dab0 con 0x7f0af0157f00 2023-09-10T00:13:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0aeeffd640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 0x7f0ad0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.005+0000 7f0aeeffd640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 0x7f0ad0067fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00058d0 tx=0x7f0ae0005860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.009+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0ae80eb0d0 con 0x7f0af0157f00 2023-09-10T00:13:51.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.145+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0af0073400 con 0x7f0af0157f00 2023-09-10T00:13:51.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0ae77fe640 1 -- 172.21.15.84:0/3209894748 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ae80b2020 con 0x7f0af0157f00 2023-09-10T00:13:51.152 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:51.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 msgr2=0x7f0ad0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 0x7f0ad0067fe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00058d0 tx=0x7f0ae0005860 comp rx=0 tx=0).stop 2023-09-10T00:13:51.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 msgr2=0x7f0af00a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0ae801a8f0 tx=0x7f0ae8009390 comp rx=0 tx=0).stop 2023-09-10T00:13:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 shutdown_connections 2023-09-10T00:13:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0ad0065b20 0x7f0ad0067fe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0af0157f00 0x7f0af00a5720 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0af014eb10 0x7f0af00aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 --2- 172.21.15.84:0/3209894748 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0af006ccb0 0x7f0af0151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 >> 172.21.15.84:0/3209894748 conn(0x7f0af00aec00 msgr2=0x7f0af00b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 shutdown_connections 2023-09-10T00:13:51.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.149+0000 7f0af545d640 1 -- 172.21.15.84:0/3209894748 wait complete. 2023-09-10T00:13:51.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:51.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/1793647909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500ceb70 msgr2=0x7f2e500cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- 172.21.15.84:0/1793647909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500ceb70 0x7f2e500cefd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2e500cb2f0 tx=0x7f2e4801f050 comp rx=0 tx=0).stop 2023-09-10T00:13:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/1793647909 shutdown_connections 2023-09-10T00:13:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- 172.21.15.84:0/1793647909 >> v2:172.21.15.100:3300/0 conn(0x7f2e500b3c20 0x7f2e500b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- 172.21.15.84:0/1793647909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500ceb70 0x7f2e500cefd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/1793647909 >> 172.21.15.84:0/1793647909 conn(0x7f2e500cd570 msgr2=0x7f2e500cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/1793647909 shutdown_connections 2023-09-10T00:13:51.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/1793647909 wait complete. 2023-09-10T00:13:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 Processor -- start 2023-09-10T00:13:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- start start 2023-09-10T00:13:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e500b3c20 0x7f2e500c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2e500ceb70 0x7f2e5014e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50155470 con 0x7f2e500b2570 2023-09-10T00:13:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e50155c80 con 0x7f2e500b3c20 2023-09-10T00:13:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e501e0e20 con 0x7f2e500ceb70 2023-09-10T00:13:51.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36990/0 (socket says 172.21.15.84:36990) 2023-09-10T00:13:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 -- 172.21.15.84:0/2515649254 learned_addr learned my addr 172.21.15.84:0/2515649254 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 -- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2e500ceb70 msgr2=0x7f2e5014e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2e500ceb70 0x7f2e5014e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e554ec640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e500b3c20 0x7f2e500c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 -- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e500b3c20 msgr2=0x7f2e500c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e500b3c20 0x7f2e500c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 -- 172.21.15.84:0/2515649254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e48009560 con 0x7f2e500b2570 2023-09-10T00:13:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e55ced640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000b410 tx=0x7f2e4000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40004020 con 0x7f2e500b2570 2023-09-10T00:13:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e40004270 con 0x7f2e500b2570 2023-09-10T00:13:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40011890 con 0x7f2e500b2570 2023-09-10T00:13:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e501556c0 con 0x7f2e500b2570 2023-09-10T00:13:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.293+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e501e0a80 con 0x7f2e500b2570 2023-09-10T00:13:51.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5014eef0 con 0x7f2e500b2570 2023-09-10T00:13:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2e40003600 con 0x7f2e500b2570 2023-09-10T00:13:51.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e467fc640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 0x7f2e34067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e554ec640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 0x7f2e34067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2e40082f70 con 0x7f2e500b2570 2023-09-10T00:13:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.297+0000 7f2e554ec640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 0x7f2e34067fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e480b2000 tx=0x7f2e4801d890 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.301+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2e400b3db0 con 0x7f2e500b2570 2023-09-10T00:13:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e5006c610 con 0x7f2e500b2570 2023-09-10T00:13:51.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e467fc640 1 -- 172.21.15.84:0/2515649254 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e5014eef0 con 0x7f2e500b2570 2023-09-10T00:13:51.461 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 msgr2=0x7f2e34067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 0x7f2e34067fe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e480b2000 tx=0x7f2e4801d890 comp rx=0 tx=0).stop 2023-09-10T00:13:51.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 msgr2=0x7f2e501e0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000b410 tx=0x7f2e4000b8d0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 shutdown_connections 2023-09-10T00:13:51.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2e34065b20 0x7f2e34067fe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2e500ceb70 0x7f2e5014e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e500b3c20 0x7f2e500c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 --2- 172.21.15.84:0/2515649254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2e500b2570 0x7f2e501e0070 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 >> 172.21.15.84:0/2515649254 conn(0x7f2e500cd570 msgr2=0x7f2e500d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 shutdown_connections 2023-09-10T00:13:51.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.457+0000 7f2e57f51640 1 -- 172.21.15.84:0/2515649254 wait complete. 2023-09-10T00:13:51.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:51.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- 172.21.15.84:0/3543637356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240004d10 msgr2=0x7fc240005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3543637356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc240004d10 0x7fc240005190 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc25000c5d0 tx=0x7fc25001d360 comp rx=0 tx=0).stop 2023-09-10T00:13:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25cdc9640 1 -- 172.21.15.84:0/3543637356 reap_dead start 2023-09-10T00:13:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- 172.21.15.84:0/3543637356 shutdown_connections 2023-09-10T00:13:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- 172.21.15.84:0/3543637356 >> 172.21.15.84:0/3543637356 conn(0x7fc2580cd570 msgr2=0x7fc2580cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- 172.21.15.84:0/3543637356 shutdown_connections 2023-09-10T00:13:51.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- 172.21.15.84:0/3543637356 wait complete. 2023-09-10T00:13:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 Processor -- start 2023-09-10T00:13:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- start start 2023-09-10T00:13:51.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc240004d10 0x7fc2581f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc258153d40 0x7fc2581f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc258152720 con 0x7fc2581541c0 2023-09-10T00:13:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc258152a00 con 0x7fc240004d10 2023-09-10T00:13:51.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25e82c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc258152ce0 con 0x7fc258153d40 2023-09-10T00:13:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25cdc9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25cdc9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37010/0 (socket says 172.21.15.84:37010) 2023-09-10T00:13:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.597+0000 7fc25cdc9640 1 -- 172.21.15.84:0/3937407859 learned_addr learned my addr 172.21.15.84:0/3937407859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc257fff640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc240004d10 0x7fc2581f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc2577fe640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc258153d40 0x7fc2581f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 -- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc258153d40 msgr2=0x7fc2581f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc258153d40 0x7fc2581f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 -- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc240004d10 msgr2=0x7fc2581f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc240004d10 0x7fc2581f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.608 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 -- 172.21.15.84:0/3937407859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258152fc0 con 0x7fc2581541c0 2023-09-10T00:13:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25cdc9640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc25001dc00 tx=0x7fc250004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250006310 con 0x7fc2581541c0 2023-09-10T00:13:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2500064b0 con 0x7fc2581541c0 2023-09-10T00:13:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2581532a0 con 0x7fc2581541c0 2023-09-10T00:13:51.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2500068c0 con 0x7fc2581541c0 2023-09-10T00:13:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2581f11a0 con 0x7fc2581541c0 2023-09-10T00:13:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc258153490 con 0x7fc2581541c0 2023-09-10T00:13:51.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc2500ae440 con 0x7fc2581541c0 2023-09-10T00:13:51.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 0x7fc244068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc25011e360 con 0x7fc2581541c0 2023-09-10T00:13:51.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc257fff640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 0x7fc244068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.601+0000 7fc257fff640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 0x7fc244068010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc248009b70 tx=0x7fc248005750 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.605+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc2500eb940 con 0x7fc2581541c0 2023-09-10T00:13:51.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.753+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2580cf510 con 0x7fc2581541c0 2023-09-10T00:13:51.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc254ff9640 1 -- 172.21.15.84:0/3937407859 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2580cf510 con 0x7fc2581541c0 2023-09-10T00:13:51.760 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:51.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 msgr2=0x7fc244068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 0x7fc244068010 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc248009b70 tx=0x7fc248005750 comp rx=0 tx=0).stop 2023-09-10T00:13:51.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 msgr2=0x7fc2581f0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc25001dc00 tx=0x7fc250004f60 comp rx=0 tx=0).stop 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 shutdown_connections 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc244065b50 0x7fc244068010 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2581541c0 0x7fc2581f0c60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc258153d40 0x7fc2581f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.763 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 --2- 172.21.15.84:0/3937407859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc240004d10 0x7fc2581f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 >> 172.21.15.84:0/3937407859 conn(0x7fc2580cd570 msgr2=0x7fc258158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 shutdown_connections 2023-09-10T00:13:51.764 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.757+0000 7fc25e82c640 1 -- 172.21.15.84:0/3937407859 wait complete. 2023-09-10T00:13:51.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-10T00:13:51.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 -- 172.21.15.84:0/4145948446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 msgr2=0x7f74d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 --2- 172.21.15.84:0/4145948446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74d8004c50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009b60 tx=0x7f74d401d290 comp rx=0 tx=0).stop 2023-09-10T00:13:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74ead9d640 1 -- 172.21.15.84:0/4145948446 reap_dead start 2023-09-10T00:13:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 -- 172.21.15.84:0/4145948446 shutdown_connections 2023-09-10T00:13:51.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 -- 172.21.15.84:0/4145948446 >> 172.21.15.84:0/4145948446 conn(0x7f74ec0ca240 msgr2=0x7f74ec0ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:51.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 -- 172.21.15.84:0/4145948446 shutdown_connections 2023-09-10T00:13:51.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.885+0000 7f74f0d62640 1 -- 172.21.15.84:0/4145948446 wait complete. 2023-09-10T00:13:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 Processor -- start 2023-09-10T00:13:51.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- start start 2023-09-10T00:13:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74ec1e2e30 0x7f74ec1f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74ec1e32b0 0x7f74ec1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec06b7f0 con 0x7f74d80047d0 2023-09-10T00:13:51.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec06b230 con 0x7f74ec1e32b0 2023-09-10T00:13:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec06b510 con 0x7f74ec1e2e30 2023-09-10T00:13:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37024/0 (socket says 172.21.15.84:37024) 2023-09-10T00:13:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 -- 172.21.15.84:0/117231270 learned_addr learned my addr 172.21.15.84:0/117231270 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:51.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 -- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74ec1e2e30 msgr2=0x7f74ec1f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e9d9b640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74ec1e2e30 0x7f74ec1f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ead9d640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74ec1e32b0 0x7f74ec1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74ec1e2e30 0x7f74ec1f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 -- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74ec1e32b0 msgr2=0x7f74ec1f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74ec1e32b0 0x7f74ec1f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 -- 172.21.15.84:0/117231270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0a9970 con 0x7f74d80047d0 2023-09-10T00:13:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74ea59c640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f74e4003a30 tx=0x7f74e400e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4010e70 con 0x7f74d80047d0 2023-09-10T00:13:51.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74e4013570 con 0x7f74d80047d0 2023-09-10T00:13:51.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec0a9c50 con 0x7f74d80047d0 2023-09-10T00:13:51.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4013980 con 0x7f74d80047d0 2023-09-10T00:13:51.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec069e40 con 0x7f74d80047d0 2023-09-10T00:13:51.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec0a9e90 con 0x7f74d80047d0 2023-09-10T00:13:51.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f74e400f040 con 0x7f74d80047d0 2023-09-10T00:13:51.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74e4087400 con 0x7f74d80047d0 2023-09-10T00:13:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.889+0000 7f74e9d9b640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.893+0000 7f74e9d9b640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 0x7f74cc067fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74d40ae000 tx=0x7f74d401a030 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:51.893+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f74ec0a9e90 con 0x7f74d80047d0 2023-09-10T00:13:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.045+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74ec0a9e90 con 0x7f74d80047d0 2023-09-10T00:13:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.045+0000 7f74e2ffd640 1 -- 172.21.15.84:0/117231270 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74ec0a9e90 con 0x7f74d80047d0 2023-09-10T00:13:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2023-09-10T00:13:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 msgr2=0x7f74cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 0x7f74cc067fe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74d40ae000 tx=0x7f74d401a030 comp rx=0 tx=0).stop 2023-09-10T00:13:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 msgr2=0x7f74ec14c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f74e4003a30 tx=0x7f74e400e650 comp rx=0 tx=0).stop 2023-09-10T00:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 shutdown_connections 2023-09-10T00:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f74cc065b20 0x7f74cc067fe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74ec1e32b0 0x7f74ec1f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74ec1e2e30 0x7f74ec1f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 --2- 172.21.15.84:0/117231270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74d80047d0 0x7f74ec14c7f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 >> 172.21.15.84:0/117231270 conn(0x7f74ec0ca240 msgr2=0x7f74ec0aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 shutdown_connections 2023-09-10T00:13:52.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.049+0000 7f74f0d62640 1 -- 172.21.15.84:0/117231270 wait complete. 2023-09-10T00:13:52.068 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2023-09-10T00:13:52.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:52.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-09-10T00:13:52.084 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:52.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T00:13:52.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:13:52.086 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-10T00:13:52.132 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-09-10T00:13:52.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- 172.21.15.84:0/425216093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 msgr2=0x7f11080707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.262 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 --2- 172.21.15.84:0/425216093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11080707f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f110806de30 tx=0x7f110001db80 comp rx=0 tx=0).stop 2023-09-10T00:13:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- 172.21.15.84:0/425216093 shutdown_connections 2023-09-10T00:13:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 --2- 172.21.15.84:0/425216093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11080707f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 --2- 172.21.15.84:0/425216093 >> v2:172.21.15.100:3300/0 conn(0x7f11080ade00 0x7f110806a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- 172.21.15.84:0/425216093 >> 172.21.15.84:0/425216093 conn(0x7f11080cca70 msgr2=0x7f11080cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.263 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- 172.21.15.84:0/425216093 shutdown_connections 2023-09-10T00:13:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- 172.21.15.84:0/425216093 wait complete. 2023-09-10T00:13:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 Processor -- start 2023-09-10T00:13:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.257+0000 7f110f55f640 1 -- start start 2023-09-10T00:13:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.266 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11080ade00 0x7f110814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 0x7f110814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11080c05b0 con 0x7f1108070360 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11081f8370 con 0x7f1108158210 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11080cb3c0 con 0x7f11080ade00 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.267 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37042/0 (socket says 172.21.15.84:37042) 2023-09-10T00:13:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 -- 172.21.15.84:0/2524907354 learned_addr learned my addr 172.21.15.84:0/2524907354 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110dafc640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 0x7f110814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110cafa640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11080ade00 0x7f110814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 -- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11080ade00 msgr2=0x7f110814bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11080ade00 0x7f110814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 -- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 msgr2=0x7f110814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 0x7f110814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 -- 172.21.15.84:0/2524907354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110000a9f0 con 0x7f1108070360 2023-09-10T00:13:52.269 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110dafc640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 0x7f110814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110d2fb640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f110400c9a0 tx=0x7f110400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104007bb0 con 0x7f1108070360 2023-09-10T00:13:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1104007e20 con 0x7f1108070360 2023-09-10T00:13:52.270 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11080cb6a0 con 0x7f1108070360 2023-09-10T00:13:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104005280 con 0x7f1108070360 2023-09-10T00:13:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11080c0240 con 0x7f1108070360 2023-09-10T00:13:52.271 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11080712c0 con 0x7f1108070360 2023-09-10T00:13:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f11040053e0 con 0x7f1108070360 2023-09-10T00:13:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 0x7f10ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1104083f50 con 0x7f1108070360 2023-09-10T00:13:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.261+0000 7f110cafa640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 0x7f10ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.265+0000 7f110cafa640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 0x7f10ec067fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11081f7380 tx=0x7f10f8008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.265+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1104051570 con 0x7f1108070360 2023-09-10T00:13:52.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.457+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1108073400 con 0x7f1108070360 2023-09-10T00:13:52.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.457+0000 7f10fdffb640 1 -- 172.21.15.84:0/2524907354 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f110401d020 con 0x7f1108070360 2023-09-10T00:13:52.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:52.464 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:52.464 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 msgr2=0x7f10ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 0x7f10ec067fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f11081f7380 tx=0x7f10f8008040 comp rx=0 tx=0).stop 2023-09-10T00:13:52.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 msgr2=0x7f11081f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f110400c9a0 tx=0x7f110400ce60 comp rx=0 tx=0).stop 2023-09-10T00:13:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 shutdown_connections 2023-09-10T00:13:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f10ec065b20 0x7f10ec067fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1108158210 0x7f110814ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11080ade00 0x7f110814bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 --2- 172.21.15.84:0/2524907354 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108070360 0x7f11081f7e30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 >> 172.21.15.84:0/2524907354 conn(0x7f11080cca70 msgr2=0x7f110806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 shutdown_connections 2023-09-10T00:13:52.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.461+0000 7f110f55f640 1 -- 172.21.15.84:0/2524907354 wait complete. 2023-09-10T00:13:52.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- 172.21.15.84:0/2740944311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815ab80 msgr2=0x7f0ba80cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 --2- 172.21.15.84:0/2740944311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815ab80 0x7f0ba80cbb20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80cead0 tx=0x7f0ba401f050 comp rx=0 tx=0).stop 2023-09-10T00:13:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- 172.21.15.84:0/2740944311 shutdown_connections 2023-09-10T00:13:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 --2- 172.21.15.84:0/2740944311 >> v2:172.21.15.100:3300/0 conn(0x7f0ba815af60 0x7f0ba806a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 --2- 172.21.15.84:0/2740944311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815ab80 0x7f0ba80cbb20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- 172.21.15.84:0/2740944311 >> 172.21.15.84:0/2740944311 conn(0x7f0ba80b25b0 msgr2=0x7f0ba80b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- 172.21.15.84:0/2740944311 shutdown_connections 2023-09-10T00:13:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- 172.21.15.84:0/2740944311 wait complete. 2023-09-10T00:13:52.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 Processor -- start 2023-09-10T00:13:52.609 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.601+0000 7f0bafcab640 1 -- start start 2023-09-10T00:13:52.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ba80afba0 0x7f0ba80aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ba815ab80 0x7f0ba80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.610 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba81e4bb0 con 0x7f0ba815af60 2023-09-10T00:13:52.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80ca720 con 0x7f0ba815ab80 2023-09-10T00:13:52.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba80af220 con 0x7f0ba80afba0 2023-09-10T00:13:52.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.611 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37062/0 (socket says 172.21.15.84:37062) 2023-09-10T00:13:52.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 -- 172.21.15.84:0/449633831 learned_addr learned my addr 172.21.15.84:0/449633831 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:52.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 -- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ba80afba0 msgr2=0x7f0ba80aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bada47640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ba80afba0 0x7f0ba80aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.612 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ba80afba0 0x7f0ba80aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 -- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ba815ab80 msgr2=0x7f0ba80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ba815ab80 0x7f0ba80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 -- 172.21.15.84:0/449633831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009560 con 0x7f0ba815af60 2023-09-10T00:13:52.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bae248640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000c7b0 tx=0x7f0ba000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0004b70 con 0x7f0ba815af60 2023-09-10T00:13:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ba0004dc0 con 0x7f0ba815af60 2023-09-10T00:13:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba815dff0 con 0x7f0ba815af60 2023-09-10T00:13:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000aab0 con 0x7f0ba815af60 2023-09-10T00:13:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba81e47d0 con 0x7f0ba815af60 2023-09-10T00:13:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba81e4cf0 con 0x7f0ba815af60 2023-09-10T00:13:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0ba000ac10 con 0x7f0ba815af60 2023-09-10T00:13:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 0x7f0b8c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ba0083a90 con 0x7f0ba815af60 2023-09-10T00:13:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bada47640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 0x7f0b8c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.605+0000 7f0bada47640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 0x7f0b8c068010 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40b2000 tx=0x7f0ba401d890 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.609+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0ba81e4cf0 con 0x7f0ba815af60 2023-09-10T00:13:52.759 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.753+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ba81e4cf0 con 0x7f0ba815af60 2023-09-10T00:13:52.762 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.757+0000 7f0b9e7fc640 1 -- 172.21.15.84:0/449633831 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f0ba81e4cf0 con 0x7f0ba815af60 2023-09-10T00:13:52.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:52.763 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:52.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 msgr2=0x7f0b8c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 0x7f0b8c068010 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40b2000 tx=0x7f0ba401d890 comp rx=0 tx=0).stop 2023-09-10T00:13:52.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 msgr2=0x7f0ba80b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.765 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000c7b0 tx=0x7f0ba000cc70 comp rx=0 tx=0).stop 2023-09-10T00:13:52.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 shutdown_connections 2023-09-10T00:13:52.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0b8c065b50 0x7f0b8c068010 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ba815af60 0x7f0ba80b1e80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.766 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ba815ab80 0x7f0ba80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 --2- 172.21.15.84:0/449633831 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ba80afba0 0x7f0ba80aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 >> 172.21.15.84:0/449633831 conn(0x7f0ba80b25b0 msgr2=0x7f0ba815a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 shutdown_connections 2023-09-10T00:13:52.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.761+0000 7f0bafcab640 1 -- 172.21.15.84:0/449633831 wait complete. 2023-09-10T00:13:52.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:12:39.810536+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:12:40.802500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-09-10T00:12:44.588878+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-10T00:13:52.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:13:52.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/4026320730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb490004d10 msgr2=0x7fb490005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/4026320730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb490004d10 0x7fb490005190 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009f10 tx=0x7fb49c01d5f0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 -- 172.21.15.84:0/4026320730 reap_dead start 2023-09-10T00:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/4026320730 shutdown_connections 2023-09-10T00:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/4026320730 >> 172.21.15.84:0/4026320730 conn(0x7fb4a40aec00 msgr2=0x7fb4a40cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:52.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/4026320730 shutdown_connections 2023-09-10T00:13:52.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/4026320730 wait complete. 2023-09-10T00:13:52.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 Processor -- start 2023-09-10T00:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- start start 2023-09-10T00:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 0x7fb4a41f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 0x7fb4a40aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a40aaa00 con 0x7fb4a40aa580 2023-09-10T00:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a414a6c0 con 0x7fb4a41f1e60 2023-09-10T00:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a414a9a0 con 0x7fb490004d10 2023-09-10T00:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37072/0 (socket says 172.21.15.84:37072) 2023-09-10T00:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 -- 172.21.15.84:0/922924257 learned_addr learned my addr 172.21.15.84:0/922924257 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4a9ce7640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 0x7fb4a41f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4a94e6640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 0x7fb4a40aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 -- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 msgr2=0x7fb4a41f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 0x7fb4a41f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 -- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 msgr2=0x7fb4a40aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 0x7fb4a40aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 -- 172.21.15.84:0/922924257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a414ac80 con 0x7fb4a40aa580 2023-09-10T00:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4a9ce7640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 0x7fb4a41f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:52.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4a94e6640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 0x7fb4a40aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4aa4e8640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009f10 tx=0x7fb49c01be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0b7070 con 0x7fb4a40aa580 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb49c009200 con 0x7fb4a40aa580 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a414af60 con 0x7fb4a40aa580 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c003ba0 con 0x7fb4a40aa580 2023-09-10T00:13:52.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.893+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a41f22e0 con 0x7fb4a40aa580 2023-09-10T00:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a40713a0 con 0x7fb4a40aa580 2023-09-10T00:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb49c003d00 con 0x7fb4a40aa580 2023-09-10T00:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb49a7fc640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 0x7fb488067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb49c11e6a0 con 0x7fb4a40aa580 2023-09-10T00:13:52.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb4a9ce7640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 0x7fb488067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:52.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.897+0000 7fb4a9ce7640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 0x7fb488067fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0005d10 tx=0x7fb4a0005c60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:52.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:52.901+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb49c0ebcc0 con 0x7fb4a40aa580 2023-09-10T00:13:53.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4a40c8c30 con 0x7fb4a40aa580 2023-09-10T00:13:53.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb49a7fc640 1 -- 172.21.15.84:0/922924257 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb49c0c10a0 con 0x7fb4a40aa580 2023-09-10T00:13:53.056 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:13:53.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 msgr2=0x7fb488067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 0x7fb488067fe0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0005d10 tx=0x7fb4a0005c60 comp rx=0 tx=0).stop 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 msgr2=0x7fb4a41e22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009f10 tx=0x7fb49c01be30 comp rx=0 tx=0).stop 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 shutdown_connections 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb488065b20 0x7fb488067fe0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4a40aa580 0x7fb4a41e22e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4a41f1e60 0x7fb4a40aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 --2- 172.21.15.84:0/922924257 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb490004d10 0x7fb4a41f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 >> 172.21.15.84:0/922924257 conn(0x7fb4a40aec00 msgr2=0x7fb4a414e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 shutdown_connections 2023-09-10T00:13:53.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.053+0000 7fb4abf4b640 1 -- 172.21.15.84:0/922924257 wait complete. 2023-09-10T00:13:53.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T00:13:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- 172.21.15.84:0/2543061976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900ceb70 msgr2=0x7f45900cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- 172.21.15.84:0/2543061976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900ceb70 0x7f45900cefd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f45900cb2f0 tx=0x7f458001efd0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- 172.21.15.84:0/2543061976 shutdown_connections 2023-09-10T00:13:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- 172.21.15.84:0/2543061976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900ceb70 0x7f45900cefd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- 172.21.15.84:0/2543061976 >> v2:172.21.15.100:3300/0 conn(0x7f45900b3c20 0x7f45900b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- 172.21.15.84:0/2543061976 >> 172.21.15.84:0/2543061976 conn(0x7f45900cd570 msgr2=0x7f45900cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- 172.21.15.84:0/2543061976 shutdown_connections 2023-09-10T00:13:53.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- 172.21.15.84:0/2543061976 wait complete. 2023-09-10T00:13:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 Processor -- start 2023-09-10T00:13:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- start start 2023-09-10T00:13:53.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45900b2570 0x7f45901e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 0x7f45900c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45901542e0 con 0x7f45900b3c20 2023-09-10T00:13:53.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590153660 con 0x7f45900b2570 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4597cfa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590153940 con 0x7f45900ceb70 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37090/0 (socket says 172.21.15.84:37090) 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 -- 172.21.15.84:0/979075832 learned_addr learned my addr 172.21.15.84:0/979075832 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4596297640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 0x7f45900c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595a96640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45900b2570 0x7f45901e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 -- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 msgr2=0x7f45900c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 0x7f45900c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 -- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45900b2570 msgr2=0x7f45901e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45900b2570 0x7f45901e2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 -- 172.21.15.84:0/979075832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800094a0 con 0x7f45900b3c20 2023-09-10T00:13:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4596297640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 0x7f45900c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.201+0000 7f4595295640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4580000c10 tx=0x7f4580005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580004230 con 0x7f45900b3c20 2023-09-10T00:13:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4580004480 con 0x7f45900b3c20 2023-09-10T00:13:53.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4590153c20 con 0x7f45900b3c20 2023-09-10T00:13:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580004ab0 con 0x7f45900b3c20 2023-09-10T00:13:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45901532f0 con 0x7f45900b3c20 2023-09-10T00:13:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459006c610 con 0x7f45900b3c20 2023-09-10T00:13:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4580004c10 con 0x7f45900b3c20 2023-09-10T00:13:53.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 0x7f4574067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4580121840 con 0x7f45900b3c20 2023-09-10T00:13:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f4595a96640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 0x7f4574067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.205+0000 7f4595a96640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 0x7f4574067fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f458c001280 tx=0x7f458c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.209+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f45800eedd0 con 0x7f45900b3c20 2023-09-10T00:13:53.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.349+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4590073400 con 0x7f45900b3c20 2023-09-10T00:13:53.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f45867fc640 1 -- 172.21.15.84:0/979075832 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45800f23f0 con 0x7f45900b3c20 2023-09-10T00:13:53.356 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:53.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 msgr2=0x7f4574067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 0x7f4574067fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f458c001280 tx=0x7f458c009040 comp rx=0 tx=0).stop 2023-09-10T00:13:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 msgr2=0x7f45900c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4580000c10 tx=0x7f4580005730 comp rx=0 tx=0).stop 2023-09-10T00:13:53.358 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 shutdown_connections 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4574065b20 0x7f4574067fe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45900ceb70 0x7f45900c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45900b3c20 0x7f45900c66e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 --2- 172.21.15.84:0/979075832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45900b2570 0x7f45901e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 >> 172.21.15.84:0/979075832 conn(0x7f45900cd570 msgr2=0x7f45900c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.359 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 shutdown_connections 2023-09-10T00:13:53.360 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.353+0000 7f4597cfa640 1 -- 172.21.15.84:0/979075832 wait complete. 2023-09-10T00:13:53.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T00:13:53.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- 172.21.15.84:0/1463369691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe580047d0 msgr2=0x7fbe58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/1463369691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe580047d0 0x7fbe58004c50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c260 tx=0x7fbe5c01f740 comp rx=0 tx=0).stop 2023-09-10T00:13:53.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- 172.21.15.84:0/1463369691 shutdown_connections 2023-09-10T00:13:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/1463369691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe580047d0 0x7fbe58004c50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- 172.21.15.84:0/1463369691 >> 172.21.15.84:0/1463369691 conn(0x7fbe6c0af250 msgr2=0x7fbe6c0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- 172.21.15.84:0/1463369691 shutdown_connections 2023-09-10T00:13:53.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- 172.21.15.84:0/1463369691 wait complete. 2023-09-10T00:13:53.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 Processor -- start 2023-09-10T00:13:53.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.493+0000 7fbe73fa4640 1 -- start start 2023-09-10T00:13:53.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe580047d0 0x7fbe6c0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe6c1ecf50 0x7fbe6c1f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c5ba0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c2200 con 0x7fbe580047d0 2023-09-10T00:13:53.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c55e0 con 0x7fbe6c1ecf50 2023-09-10T00:13:53.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37102/0 (socket says 172.21.15.84:37102) 2023-09-10T00:13:53.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 -- 172.21.15.84:0/4270202520 learned_addr learned my addr 172.21.15.84:0/4270202520 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:53.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 -- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe6c1ecf50 msgr2=0x7fbe6c1f0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe72541640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe6c1ecf50 0x7fbe6c1f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe6c1ecf50 0x7fbe6c1f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 -- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe580047d0 msgr2=0x7fbe6c0c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe71d40640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe580047d0 0x7fbe6c0c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe580047d0 0x7fbe6c0c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 -- 172.21.15.84:0/4270202520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0c58c0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe7153f640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c001940 tx=0x7fbe5c001480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c0bd070 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.505 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe5c0036f0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c0c1e90 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c003ae0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c0c5210 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c0c2390 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fbe5c0b5050 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 0x7fbe50068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe5c1207a0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe71d40640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 0x7fbe50068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.497+0000 7fbe71d40640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 0x7fbe50068010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0631b0 tx=0x7fbe680091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.501+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fbe5c0eddc0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.645+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe6c073400 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.651 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe627fc640 1 -- 172.21.15.84:0/4270202520 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe5c0f13e0 con 0x7fbe6c0c3f00 2023-09-10T00:13:53.652 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T00:13:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 msgr2=0x7fbe50068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 0x7fbe50068010 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0631b0 tx=0x7fbe680091e0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 msgr2=0x7fbe6c1eca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.654 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c001940 tx=0x7fbe5c001480 comp rx=0 tx=0).stop 2023-09-10T00:13:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 shutdown_connections 2023-09-10T00:13:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fbe50065b50 0x7fbe50068010 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbe6c1ecf50 0x7fbe6c1f0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbe6c0c3f00 0x7fbe6c1eca10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.655 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 --2- 172.21.15.84:0/4270202520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe580047d0 0x7fbe6c0c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 >> 172.21.15.84:0/4270202520 conn(0x7fbe6c0af250 msgr2=0x7fbe6c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 shutdown_connections 2023-09-10T00:13:53.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.649+0000 7fbe73fa4640 1 -- 172.21.15.84:0/4270202520 wait complete. 2023-09-10T00:13:53.669 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-09-10T00:13:53.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/202000058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806c280 msgr2=0x7f29a806c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- 172.21.15.84:0/202000058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806c280 0x7f29a806c710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f29a806b130 tx=0x7f29a001ccf0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/202000058 shutdown_connections 2023-09-10T00:13:53.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- 172.21.15.84:0/202000058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806c280 0x7f29a806c710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- 172.21.15.84:0/202000058 >> v2:172.21.15.100:3300/0 conn(0x7f29a8158230 0x7f29a80695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/202000058 >> 172.21.15.84:0/202000058 conn(0x7f29a80aec00 msgr2=0x7f29a80cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/202000058 shutdown_connections 2023-09-10T00:13:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/202000058 wait complete. 2023-09-10T00:13:53.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 Processor -- start 2023-09-10T00:13:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- start start 2023-09-10T00:13:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a806c280 0x7f29a8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a8158230 0x7f29a80af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8159530 con 0x7f29a806fa60 2023-09-10T00:13:53.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8159200 con 0x7f29a806c280 2023-09-10T00:13:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8153760 con 0x7f29a8158230 2023-09-10T00:13:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37132/0 (socket says 172.21.15.84:37132) 2023-09-10T00:13:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 -- 172.21.15.84:0/232051715 learned_addr learned my addr 172.21.15.84:0/232051715 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:53.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 -- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a8158230 msgr2=0x7f29a80af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29acad4640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a806c280 0x7f29a8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29ad2d5640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a8158230 0x7f29a80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a8158230 0x7f29a80af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 -- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a806c280 msgr2=0x7f29a8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a806c280 0x7f29a8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 -- 172.21.15.84:0/232051715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00098e0 con 0x7f29a806fa60 2023-09-10T00:13:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a7fff640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c940 tx=0x7f299c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c004220 con 0x7f29a806fa60 2023-09-10T00:13:53.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f299c004470 con 0x7f29a806fa60 2023-09-10T00:13:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a8153a40 con 0x7f29a806fa60 2023-09-10T00:13:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c007bf0 con 0x7f29a806fa60 2023-09-10T00:13:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a8153250 con 0x7f29a806fa60 2023-09-10T00:13:53.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.781+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a8153530 con 0x7f29a806fa60 2023-09-10T00:13:53.799 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.785+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f299c007d50 con 0x7f29a806fa60 2023-09-10T00:13:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.785+0000 7f29a57fa640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 0x7f2994067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.785+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f299c083b50 con 0x7f29a806fa60 2023-09-10T00:13:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.785+0000 7f29acad4640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 0x7f2994067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.785+0000 7f29acad4640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 0x7f2994067fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2998003d60 tx=0x7f2998009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:53.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.789+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f299c0510e0 con 0x7f29a806fa60 2023-09-10T00:13:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f29a80713a0 con 0x7f29a806fa60 2023-09-10T00:13:53.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29a57fa640 1 -- 172.21.15.84:0/232051715 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f299c01d0a0 con 0x7f29a806fa60 2023-09-10T00:13:53.934 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T00:13:53.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 msgr2=0x7f2994067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 0x7f2994067fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2998003d60 tx=0x7f2998009040 comp rx=0 tx=0).stop 2023-09-10T00:13:53.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 msgr2=0x7f29a81599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:53.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c940 tx=0x7f299c00ce00 comp rx=0 tx=0).stop 2023-09-10T00:13:53.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 shutdown_connections 2023-09-10T00:13:53.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f2994065b20 0x7f2994067fe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f29a8158230 0x7f29a80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29a806fa60 0x7f29a81599c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 --2- 172.21.15.84:0/232051715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29a806c280 0x7f29a8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:53.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.929+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 >> 172.21.15.84:0/232051715 conn(0x7f29a80aec00 msgr2=0x7f29a806fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:53.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.933+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 shutdown_connections 2023-09-10T00:13:53.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:53.933+0000 7f29aed38640 1 -- 172.21.15.84:0/232051715 wait complete. 2023-09-10T00:13:53.951 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/1127874786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 msgr2=0x7f9b6c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 --2- 172.21.15.84:0/1127874786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b6c004c50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9b680016b0 tx=0x7f9b6801c7a0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7ffff640 1 -- 172.21.15.84:0/1127874786 reap_dead start 2023-09-10T00:13:54.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/1127874786 shutdown_connections 2023-09-10T00:13:54.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/1127874786 >> 172.21.15.84:0/1127874786 conn(0x7f9b800cd0e0 msgr2=0x7f9b800cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/1127874786 shutdown_connections 2023-09-10T00:13:54.066 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/1127874786 wait complete. 2023-09-10T00:13:54.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 Processor -- start 2023-09-10T00:13:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- start start 2023-09-10T00:13:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b800adab0 0x7f9b800adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b8014a520 0x7f9b8014a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8014aee0 con 0x7f9b6c0047d0 2023-09-10T00:13:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800ad620 con 0x7f9b8014a520 2023-09-10T00:13:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800aca50 con 0x7f9b800adab0 2023-09-10T00:13:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37156/0 (socket says 172.21.15.84:37156) 2023-09-10T00:13:54.071 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 -- 172.21.15.84:0/50727736 learned_addr learned my addr 172.21.15.84:0/50727736 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b77fff640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b800adab0 0x7f9b800adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7ffff640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b8014a520 0x7f9b8014a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 -- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b800adab0 msgr2=0x7f9b800adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b800adab0 0x7f9b800adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 -- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b8014a520 msgr2=0x7f9b8014a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b8014a520 0x7f9b8014a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 -- 172.21.15.84:0/50727736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800accf0 con 0x7f9b6c0047d0 2023-09-10T00:13:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7f7fe640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000f420 tx=0x7f9b7000f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700084e0 con 0x7f9b6c0047d0 2023-09-10T00:13:54.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9b70006720 con 0x7f9b6c0047d0 2023-09-10T00:13:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800acfd0 con 0x7f9b6c0047d0 2023-09-10T00:13:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70006b30 con 0x7f9b6c0047d0 2023-09-10T00:13:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.061+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b801ef420 con 0x7f9b6c0047d0 2023-09-10T00:13:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b80072b50 con 0x7f9b6c0047d0 2023-09-10T00:13:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9b70006c90 con 0x7f9b6c0047d0 2023-09-10T00:13:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b7cff9640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 0x7f9b60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9b70085ea0 con 0x7f9b6c0047d0 2023-09-10T00:13:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b77fff640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 0x7f9b60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.065+0000 7f9b77fff640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 0x7f9b60067fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9b68001680 tx=0x7f9b68019540 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.069+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9b70053430 con 0x7f9b6c0047d0 2023-09-10T00:13:54.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b8009b080 con 0x7f9b6c0047d0 2023-09-10T00:13:54.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b7cff9640 1 -- 172.21.15.84:0/50727736 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f9b7001a090 con 0x7f9b6c0047d0 2023-09-10T00:13:54.246 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:54.246 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:54.246 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:54.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 msgr2=0x7f9b60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 0x7f9b60067fe0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9b68001680 tx=0x7f9b68019540 comp rx=0 tx=0).stop 2023-09-10T00:13:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 msgr2=0x7f9b801eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9b7000f420 tx=0x7f9b7000f8e0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 shutdown_connections 2023-09-10T00:13:54.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9b60065b20 0x7f9b60067fe0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b8014a520 0x7f9b8014a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9b800adab0 0x7f9b800adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 --2- 172.21.15.84:0/50727736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b6c0047d0 0x7f9b801eeee0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.241+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 >> 172.21.15.84:0/50727736 conn(0x7f9b800cd0e0 msgr2=0x7f9b800b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.245+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 shutdown_connections 2023-09-10T00:13:54.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.245+0000 7f9b85e36640 1 -- 172.21.15.84:0/50727736 wait complete. 2023-09-10T00:13:54.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/3434665604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc158a90 msgr2=0x7f46fc0c01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.376 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- 172.21.15.84:0/3434665604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc158a90 0x7f46fc0c01c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009840 tx=0x7f46ec01c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/3434665604 shutdown_connections 2023-09-10T00:13:54.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- 172.21.15.84:0/3434665604 >> v2:172.21.15.100:3300/0 conn(0x7f46fc0c0700 0x7f46fc0b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- 172.21.15.84:0/3434665604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc158a90 0x7f46fc0c01c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/3434665604 >> 172.21.15.84:0/3434665604 conn(0x7f46fc0cca70 msgr2=0x7f46fc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/3434665604 shutdown_connections 2023-09-10T00:13:54.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/3434665604 wait complete. 2023-09-10T00:13:54.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 Processor -- start 2023-09-10T00:13:54.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- start start 2023-09-10T00:13:54.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 0x7f46fc14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 0x7f46fc14e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.380 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14f8c0 con 0x7f46fc158a90 2023-09-10T00:13:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14fba0 con 0x7f46fc0b1cd0 2023-09-10T00:13:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14fe80 con 0x7f46fc0c0700 2023-09-10T00:13:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.381 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37172/0 (socket says 172.21.15.84:37172) 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 -- 172.21.15.84:0/1492136111 learned_addr learned my addr 172.21.15.84:0/1492136111 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47008e9640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 0x7f46fc14e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47010ea640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 0x7f46fc14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 -- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 msgr2=0x7f46fc14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 0x7f46fc14e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 -- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 msgr2=0x7f46fc14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 0x7f46fc14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 -- 172.21.15.84:0/1492136111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec0094a0 con 0x7f46fc158a90 2023-09-10T00:13:54.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47008e9640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 0x7f46fc14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:54.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47010ea640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 0x7f46fc14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:13:54.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f47018eb640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f46f400cb40 tx=0x7f46f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400aa50 con 0x7f46fc158a90 2023-09-10T00:13:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f46f400aca0 con 0x7f46fc158a90 2023-09-10T00:13:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc150160 con 0x7f46fc158a90 2023-09-10T00:13:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4012680 con 0x7f46fc158a90 2023-09-10T00:13:54.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.373+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc0c6920 con 0x7f46fc158a90 2023-09-10T00:13:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc0c1f40 con 0x7f46fc158a90 2023-09-10T00:13:54.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f46f401a3b0 con 0x7f46fc158a90 2023-09-10T00:13:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f46f1ffb640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 0x7f46e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46f4083810 con 0x7f46fc158a90 2023-09-10T00:13:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f47010ea640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 0x7f46e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.377+0000 7f47010ea640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 0x7f46e0067fe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0af000 tx=0x7f46ec01b010 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.381+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f46f4050db0 con 0x7f46fc158a90 2023-09-10T00:13:54.544 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.541+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46fc0712c0 con 0x7f46fc158a90 2023-09-10T00:13:54.547 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.541+0000 7f46f1ffb640 1 -- 172.21.15.84:0/1492136111 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7f46f40543d0 con 0x7f46fc158a90 2023-09-10T00:13:54.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:54.548 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 msgr2=0x7f46e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 0x7f46e0067fe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0af000 tx=0x7f46ec01b010 comp rx=0 tx=0).stop 2023-09-10T00:13:54.550 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 msgr2=0x7f46fc155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f46f400cb40 tx=0x7f46f400cc30 comp rx=0 tx=0).stop 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 shutdown_connections 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f46e0065b20 0x7f46e0067fe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46fc158a90 0x7f46fc155610 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46fc0c0700 0x7f46fc14e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.551 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 --2- 172.21.15.84:0/1492136111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46fc0b1cd0 0x7f46fc14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 >> 172.21.15.84:0/1492136111 conn(0x7f46fc0cca70 msgr2=0x7f46fc0c1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 shutdown_connections 2023-09-10T00:13:54.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.545+0000 7f470334e640 1 -- 172.21.15.84:0/1492136111 wait complete. 2023-09-10T00:13:54.566 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-10T00:13:54.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 -- 172.21.15.84:0/2514635593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5980b1cd0 msgr2=0x7fe59806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 --2- 172.21.15.84:0/2514635593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5980b1cd0 0x7fe59806fad0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe5980c6c30 tx=0x7fe59001cb30 comp rx=0 tx=0).stop 2023-09-10T00:13:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 -- 172.21.15.84:0/2514635593 shutdown_connections 2023-09-10T00:13:54.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 --2- 172.21.15.84:0/2514635593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5980b1cd0 0x7fe59806fad0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 --2- 172.21.15.84:0/2514635593 >> v2:172.21.15.100:3300/0 conn(0x7fe5980affe0 0x7fe5980b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 -- 172.21.15.84:0/2514635593 >> 172.21.15.84:0/2514635593 conn(0x7fe5980cca70 msgr2=0x7fe5980cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 -- 172.21.15.84:0/2514635593 shutdown_connections 2023-09-10T00:13:54.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.681+0000 7fe59f991640 1 -- 172.21.15.84:0/2514635593 wait complete. 2023-09-10T00:13:54.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 Processor -- start 2023-09-10T00:13:54.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- start start 2023-09-10T00:13:54.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980affe0 0x7fe5980c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5980b1cd0 0x7fe5980caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598157a10 con 0x7fe598158a90 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598156e90 con 0x7fe5980affe0 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe598157170 con 0x7fe5980b1cd0 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37178/0 (socket says 172.21.15.84:37178) 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 -- 172.21.15.84:0/301087728 learned_addr learned my addr 172.21.15.84:0/301087728 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:54.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59cf2c640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5980b1cd0 0x7fe5980caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59d72d640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980affe0 0x7fe5980c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 -- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5980b1cd0 msgr2=0x7fe5980caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5980b1cd0 0x7fe5980caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 -- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980affe0 msgr2=0x7fe5980c0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980affe0 0x7fe5980c0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 -- 172.21.15.84:0/301087728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe590009820 con 0x7fe598158a90 2023-09-10T00:13:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59df2e640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe5900b0040 tx=0x7fe5900a5b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590004160 con 0x7fe598158a90 2023-09-10T00:13:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5900043b0 con 0x7fe598158a90 2023-09-10T00:13:54.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe598157450 con 0x7fe598158a90 2023-09-10T00:13:54.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590004760 con 0x7fe598158a90 2023-09-10T00:13:54.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe598156b40 con 0x7fe598158a90 2023-09-10T00:13:54.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.685+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5980712c0 con 0x7fe598158a90 2023-09-10T00:13:54.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe5900b4040 con 0x7fe598158a90 2023-09-10T00:13:54.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe58dffb640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 0x7fe57c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:54.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe59011ed80 con 0x7fe598158a90 2023-09-10T00:13:54.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe59d72d640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 0x7fe57c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:54.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe59d72d640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 0x7fe57c068010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:54.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.689+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe5900ec480 con 0x7fe598158a90 2023-09-10T00:13:54.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.877+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5980ad4b0 con 0x7fe598158a90 2023-09-10T00:13:54.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe58dffb640 1 -- 172.21.15.84:0/301087728 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe5900b2090 con 0x7fe598158a90 2023-09-10T00:13:54.884 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:54.884 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:54.885 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 msgr2=0x7fe57c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 0x7fe57c068010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).stop 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 msgr2=0x7fe5980cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe5900b0040 tx=0x7fe5900a5b80 comp rx=0 tx=0).stop 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 shutdown_connections 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe57c065b50 0x7fe57c068010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe598158a90 0x7fe5980cafb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe5980b1cd0 0x7fe5980caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 --2- 172.21.15.84:0/301087728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5980affe0 0x7fe5980c0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 >> 172.21.15.84:0/301087728 conn(0x7fe5980cca70 msgr2=0x7fe598155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 shutdown_connections 2023-09-10T00:13:54.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:54.881+0000 7fe59f991640 1 -- 172.21.15.84:0/301087728 wait complete. 2023-09-10T00:13:54.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:13:55.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/3176013401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 msgr2=0x7f4464003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 --2- 172.21.15.84:0/3176013401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f4464003df0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4474009b60 tx=0x7f447401d220 comp rx=0 tx=0).stop 2023-09-10T00:13:55.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/3176013401 shutdown_connections 2023-09-10T00:13:55.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 --2- 172.21.15.84:0/3176013401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f4464003df0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/3176013401 >> 172.21.15.84:0/3176013401 conn(0x7f44780cd590 msgr2=0x7f44780cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/3176013401 shutdown_connections 2023-09-10T00:13:55.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/3176013401 wait complete. 2023-09-10T00:13:55.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 Processor -- start 2023-09-10T00:13:55.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- start start 2023-09-10T00:13:55.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f44780c45e0 0x7f44780b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 0x7f4478148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4478149330 con 0x7f44640039d0 2023-09-10T00:13:55.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c4a40 con 0x7f4478148990 2023-09-10T00:13:55.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44780c4ce0 con 0x7f44780c45e0 2023-09-10T00:13:55.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37186/0 (socket says 172.21.15.84:37186) 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 -- 172.21.15.84:0/659547285 learned_addr learned my addr 172.21.15.84:0/659547285 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d9e4640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 0x7f4478148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447c9e2640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f44780c45e0 0x7f44780b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 -- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f44780c45e0 msgr2=0x7f44780b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f44780c45e0 0x7f44780b07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 -- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 msgr2=0x7f4478148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 0x7f4478148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 -- 172.21.15.84:0/659547285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780c4fc0 con 0x7f44640039d0 2023-09-10T00:13:55.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d9e4640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 0x7f4478148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:55.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447d1e3640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4474009a80 tx=0x7f4474005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474004230 con 0x7f44640039d0 2023-09-10T00:13:55.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44740044a0 con 0x7f44640039d0 2023-09-10T00:13:55.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.021+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44780c52a0 con 0x7f44640039d0 2023-09-10T00:13:55.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474004930 con 0x7f44640039d0 2023-09-10T00:13:55.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44780c8f50 con 0x7f44640039d0 2023-09-10T00:13:55.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447806c610 con 0x7f44640039d0 2023-09-10T00:13:55.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f44740b3070 con 0x7f44640039d0 2023-09-10T00:13:55.034 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f446dffb640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 0x7f445c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f447c9e2640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 0x7f445c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f447411e490 con 0x7f44640039d0 2023-09-10T00:13:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.025+0000 7f447c9e2640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 0x7f445c067fe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4468000f70 tx=0x7f4468000ee0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.029+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f44740eba30 con 0x7f44640039d0 2023-09-10T00:13:55.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44780c5bb0 con 0x7f44640039d0 2023-09-10T00:13:55.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f446dffb640 1 -- 172.21.15.84:0/659547285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f44740ef050 con 0x7f44640039d0 2023-09-10T00:13:55.205 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:55.206 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2802318475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2802318475},{"type":"v1","addr":"172.21.15.100:6835","nonce":2802318475}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1139663989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1139663989},{"type":"v1","addr":"172.21.15.100:6833","nonce":1139663989}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4365,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/837812044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":837812044},{"type":"v1","addr":"172.21.15.84:6835","nonce":837812044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:12:41.835038+0000","modified":"2023-09-10T00:13:04.568178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4374":{"gid":4374,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6837/1785947719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1785947719},{"type":"v1","addr":"172.21.15.84:6837","nonce":1785947719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-10T00:13:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2023-09-10T00:13:55.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 msgr2=0x7f445c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 0x7f445c067fe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4468000f70 tx=0x7f4468000ee0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 msgr2=0x7f44780ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4474009a80 tx=0x7f4474005590 comp rx=0 tx=0).stop 2023-09-10T00:13:55.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 shutdown_connections 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f445c065b20 0x7f445c067fe0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478148990 0x7f4478148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f44780c45e0 0x7f44780b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 --2- 172.21.15.84:0/659547285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f44640039d0 0x7f44780ca460 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 >> 172.21.15.84:0/659547285 conn(0x7f44780cd590 msgr2=0x7f447815e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 shutdown_connections 2023-09-10T00:13:55.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.201+0000 7f447f447640 1 -- 172.21.15.84:0/659547285 wait complete. 2023-09-10T00:13:55.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:13:55.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.333+0000 7fd975aa7640 1 -- 172.21.15.84:0/3608120368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd97006fad0 msgr2=0x7fd97006ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.333+0000 7fd975aa7640 1 --2- 172.21.15.84:0/3608120368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd97006fad0 0x7fd97006ff60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd968009bc0 tx=0x7fd96801cb10 comp rx=0 tx=0).stop 2023-09-10T00:13:55.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/3608120368 shutdown_connections 2023-09-10T00:13:55.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 --2- 172.21.15.84:0/3608120368 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd97006fad0 0x7fd97006ff60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/3608120368 >> 172.21.15.84:0/3608120368 conn(0x7fd9700cca70 msgr2=0x7fd9700cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/3608120368 shutdown_connections 2023-09-10T00:13:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/3608120368 wait complete. 2023-09-10T00:13:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 Processor -- start 2023-09-10T00:13:55.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- start start 2023-09-10T00:13:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd97006fad0 0x7fd970147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 0x7fd9700c1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701484b0 con 0x7fd9700affe0 2023-09-10T00:13:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700c9ad0 con 0x7fd970158a90 2023-09-10T00:13:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700c9db0 con 0x7fd97006fad0 2023-09-10T00:13:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37210/0 (socket says 172.21.15.84:37210) 2023-09-10T00:13:55.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 -- 172.21.15.84:0/196315875 learned_addr learned my addr 172.21.15.84:0/196315875 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96f7fe640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd97006fad0 0x7fd970147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96ffff640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 0x7fd9700c1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 -- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd97006fad0 msgr2=0x7fd970147f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd97006fad0 0x7fd970147f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 -- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 msgr2=0x7fd9700c1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 0x7fd9700c1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 -- 172.21.15.84:0/196315875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009820 con 0x7fd9700affe0 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96ffff640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 0x7fd9700c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd96effd640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c490 tx=0x7fd958001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958003600 con 0x7fd9700affe0 2023-09-10T00:13:55.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd958003780 con 0x7fd9700affe0 2023-09-10T00:13:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700ca090 con 0x7fd9700affe0 2023-09-10T00:13:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958003bd0 con 0x7fd9700affe0 2023-09-10T00:13:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9700ca650 con 0x7fd9700affe0 2023-09-10T00:13:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.337+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9700712c0 con 0x7fd9700affe0 2023-09-10T00:13:55.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.341+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd958003d30 con 0x7fd9700affe0 2023-09-10T00:13:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.341+0000 7fd967fff640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 0x7fd950067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.341+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd958082f20 con 0x7fd9700affe0 2023-09-10T00:13:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.341+0000 7fd96f7fe640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 0x7fd950067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.341+0000 7fd96f7fe640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 0x7fd950067fe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd960000f70 tx=0x7fd960009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.345+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd958050420 con 0x7fd9700affe0 2023-09-10T00:13:55.494 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.489+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd970073400 con 0x7fd9700affe0 2023-09-10T00:13:55.496 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd967fff640 1 -- 172.21.15.84:0/196315875 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18665 (secure 0 0 0) 0x7fd958017070 con 0x7fd9700affe0 2023-09-10T00:13:55.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:13:55.496 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":28,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:13:23.332113+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:12:39.810536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-10T00:12:40.802500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-09-10T00:12:44.588878+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:13:55.498 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 msgr2=0x7fd950067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 0x7fd950067fe0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd960000f70 tx=0x7fd960009040 comp rx=0 tx=0).stop 2023-09-10T00:13:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 msgr2=0x7fd9700c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c490 tx=0x7fd958001e80 comp rx=0 tx=0).stop 2023-09-10T00:13:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 shutdown_connections 2023-09-10T00:13:55.499 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd950065b20 0x7fd950067fe0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd970158a90 0x7fd9700c1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd9700affe0 0x7fd9700c0b10 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 --2- 172.21.15.84:0/196315875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd97006fad0 0x7fd970147f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.500 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 >> 172.21.15.84:0/196315875 conn(0x7fd9700cca70 msgr2=0x7fd97015b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 shutdown_connections 2023-09-10T00:13:55.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.493+0000 7fd975aa7640 1 -- 172.21.15.84:0/196315875 wait complete. 2023-09-10T00:13:55.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-10T00:13:55.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- 172.21.15.84:0/471819568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf0158bd0 msgr2=0x7f4cf006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/471819568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf0158bd0 0x7f4cf006d2a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009840 tx=0x7f4cd801c740 comp rx=0 tx=0).stop 2023-09-10T00:13:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- 172.21.15.84:0/471819568 shutdown_connections 2023-09-10T00:13:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/471819568 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf00b06f0 0x7f4cf00b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/471819568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf0158bd0 0x7f4cf006d2a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- 172.21.15.84:0/471819568 >> 172.21.15.84:0/471819568 conn(0x7f4cf00c9500 msgr2=0x7f4cf00c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.639 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- 172.21.15.84:0/471819568 shutdown_connections 2023-09-10T00:13:55.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- 172.21.15.84:0/471819568 wait complete. 2023-09-10T00:13:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 Processor -- start 2023-09-10T00:13:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.633+0000 7f4cf57bf640 1 -- start start 2023-09-10T00:13:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf00afe90 0x7f4cf01514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf0158bd0 0x7f4cf00c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01519f0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0150410 con 0x7f4cf00afe90 2023-09-10T00:13:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01506f0 con 0x7f4cf0158bd0 2023-09-10T00:13:55.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37218/0 (socket says 172.21.15.84:37218) 2023-09-10T00:13:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 -- 172.21.15.84:0/922871281 learned_addr learned my addr 172.21.15.84:0/922871281 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 -- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf0158bd0 msgr2=0x7f4cf00c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cef7fe640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf0158bd0 0x7f4cf00c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ceeffd640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf00afe90 0x7f4cf01514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf0158bd0 0x7f4cf00c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 -- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf00afe90 msgr2=0x7f4cf01514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf00afe90 0x7f4cf01514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 -- 172.21.15.84:0/922871281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd80094a0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce7fff640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c480 tx=0x7f4ce000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0012830 con 0x7f4cf00b06f0 2023-09-10T00:13:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4ce0012a80 con 0x7f4cf00b06f0 2023-09-10T00:13:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf01509d0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0011380 con 0x7f4cf00b06f0 2023-09-10T00:13:55.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0150f90 con 0x7f4cf00b06f0 2023-09-10T00:13:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf006bdd0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4ce00114e0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 0x7f4cd0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4ce0083770 con 0x7f4cf00b06f0 2023-09-10T00:13:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.637+0000 7f4ceeffd640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 0x7f4cd0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.641+0000 7f4ceeffd640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 0x7f4cd0067fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80af000 tx=0x7f4cd801af80 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.648 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.641+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4ce0050d90 con 0x7f4cf00b06f0 2023-09-10T00:13:55.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.833+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4cf01511b0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.837 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-09-10T00:13:55.833+0000 7fd319008640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-10T00:13:55.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.837+0000 7f4ce77fe640 1 -- 172.21.15.84:0/922871281 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ce00543b0 con 0x7f4cf00b06f0 2023-09-10T00:13:55.840 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-10T00:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 msgr2=0x7f4cd0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 0x7f4cd0067fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80af000 tx=0x7f4cd801af80 comp rx=0 tx=0).stop 2023-09-10T00:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 msgr2=0x7f4cf0162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c480 tx=0x7f4ce000c940 comp rx=0 tx=0).stop 2023-09-10T00:13:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 shutdown_connections 2023-09-10T00:13:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4cd0065b20 0x7f4cd0067fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4cf0158bd0 0x7f4cf00c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cf00b06f0 0x7f4cf0162df0 secure :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000c480 tx=0x7f4ce000c940 comp rx=0 tx=0).stop 2023-09-10T00:13:55.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 --2- 172.21.15.84:0/922871281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf00afe90 0x7f4cf01514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 >> 172.21.15.84:0/922871281 conn(0x7f4cf00c9500 msgr2=0x7f4cf00ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 shutdown_connections 2023-09-10T00:13:55.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.841+0000 7f4cf57bf640 1 -- 172.21.15.84:0/922871281 wait complete. 2023-09-10T00:13:55.847 INFO:tasks.ceph.mds.c.smithi084.stderr: -4355> 2023-09-10T00:12:46.427+0000 7f6a65eda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-10T00:13:55.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-10T00:13:55.892 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-09-10T00:13:55.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 -- 172.21.15.84:0/3293838840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 msgr2=0x7f038c15b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3293838840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c15b540 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0374009930 tx=0x7f037401c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 -- 172.21.15.84:0/3293838840 shutdown_connections 2023-09-10T00:13:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3293838840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c15b540 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3293838840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 0x7f038c0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 -- 172.21.15.84:0/3293838840 >> 172.21.15.84:0/3293838840 conn(0x7f038c0aec00 msgr2=0x7f038c0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 -- 172.21.15.84:0/3293838840 shutdown_connections 2023-09-10T00:13:55.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.973+0000 7f0390ee4640 1 -- 172.21.15.84:0/3293838840 wait complete. 2023-09-10T00:13:55.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 Processor -- start 2023-09-10T00:13:55.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- start start 2023-09-10T00:13:55.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 0x7f038c145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c144280 con 0x7f038c14eb10 2023-09-10T00:13:55.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1444d0 con 0x7f038c06ccb0 2023-09-10T00:13:55.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c1447b0 con 0x7f038c157f00 2023-09-10T00:13:55.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37240/0 (socket says 172.21.15.84:37240) 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 -- 172.21.15.84:0/3629029478 learned_addr learned my addr 172.21.15.84:0/3629029478 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f038a59c640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f038ad9d640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 0x7f038c145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 -- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 msgr2=0x7f038c145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 0x7f038c145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 -- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 msgr2=0x7f038c141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 -- 172.21.15.84:0/3629029478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384009820 con 0x7f038c14eb10 2023-09-10T00:13:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0381d9b640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f037401a400 tx=0x7f03740a5780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740042c0 con 0x7f038c14eb10 2023-09-10T00:13:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0374004510 con 0x7f038c14eb10 2023-09-10T00:13:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0374009560 con 0x7f038c14eb10 2023-09-10T00:13:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0374003860 con 0x7f038c14eb10 2023-09-10T00:13:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c144d70 con 0x7f038c14eb10 2023-09-10T00:13:55.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c0713a0 con 0x7f038c14eb10 2023-09-10T00:13:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f03740b4070 con 0x7f038c14eb10 2023-09-10T00:13:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 0x7f036c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f037411cee0 con 0x7f038c14eb10 2023-09-10T00:13:55.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.977+0000 7f038a59c640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 0x7f036c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.981+0000 7f038a59c640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 0x7f036c067fe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f038c0c8de0 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:55.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:55.981+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f03740ea430 con 0x7f038c14eb10 2023-09-10T00:13:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.169+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f038c073400 con 0x7f038c14eb10 2023-09-10T00:13:56.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.841+0000 7f03837fe640 1 -- 172.21.15.84:0/3629029478 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03740eda50 con 0x7f038c14eb10 2023-09-10T00:13:56.848 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 msgr2=0x7f036c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 0x7f036c067fe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f038c0c8de0 tx=0x7f037c009040 comp rx=0 tx=0).stop 2023-09-10T00:13:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 msgr2=0x7f038c143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:56.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f037401a400 tx=0x7f03740a5780 comp rx=0 tx=0).stop 2023-09-10T00:13:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 shutdown_connections 2023-09-10T00:13:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f036c065b20 0x7f036c067fe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:56.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f038c157f00 0x7f038c145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f038c14eb10 0x7f038c143020 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 --2- 172.21.15.84:0/3629029478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f038c06ccb0 0x7f038c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:56.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 >> 172.21.15.84:0/3629029478 conn(0x7f038c0aec00 msgr2=0x7f038c0c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 shutdown_connections 2023-09-10T00:13:56.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:56.845+0000 7f0390ee4640 1 -- 172.21.15.84:0/3629029478 wait complete. 2023-09-10T00:13:56.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-10T00:13:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 -- 172.21.15.84:0/1906497387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 msgr2=0x7ff564071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 --2- 172.21.15.84:0/1906497387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff564071190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff554009900 tx=0x7ff55401c830 comp rx=0 tx=0).stop 2023-09-10T00:13:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 -- 172.21.15.84:0/1906497387 shutdown_connections 2023-09-10T00:13:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 --2- 172.21.15.84:0/1906497387 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff564071190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 --2- 172.21.15.84:0/1906497387 >> v2:172.21.15.100:3300/0 conn(0x7ff56415abb0 0x7ff564070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 -- 172.21.15.84:0/1906497387 >> 172.21.15.84:0/1906497387 conn(0x7ff5640cd810 msgr2=0x7ff5640cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 -- 172.21.15.84:0/1906497387 shutdown_connections 2023-09-10T00:13:57.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.041+0000 7ff56b261640 1 -- 172.21.15.84:0/1906497387 wait complete. 2023-09-10T00:13:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 Processor -- start 2023-09-10T00:13:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- start start 2023-09-10T00:13:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff56414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff56415abb0 0x7ff56415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56415a430 con 0x7ff5640c85d0 2023-09-10T00:13:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564158ba0 con 0x7ff56415abb0 2023-09-10T00:13:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff564158df0 con 0x7ff5640c8030 2023-09-10T00:13:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:57.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37254/0 (socket says 172.21.15.84:37254) 2023-09-10T00:13:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 -- 172.21.15.84:0/3843242913 learned_addr learned my addr 172.21.15.84:0/3843242913 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff568ffd640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff56414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5697fe640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff56415abb0 0x7ff56415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 -- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 msgr2=0x7ff56414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff56414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 -- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff56415abb0 msgr2=0x7ff56415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff56415abb0 0x7ff56415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 -- 172.21.15.84:0/3843242913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554009560 con 0x7ff5640c85d0 2023-09-10T00:13:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff563fff640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c4d0 tx=0x7ff55800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580052d0 con 0x7ff5640c85d0 2023-09-10T00:13:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff558005430 con 0x7ff5640c85d0 2023-09-10T00:13:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558012890 con 0x7ff5640c85d0 2023-09-10T00:13:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5641590d0 con 0x7ff5640c85d0 2023-09-10T00:13:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff564159690 con 0x7ff5640c85d0 2023-09-10T00:13:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5640722f0 con 0x7ff5640c85d0 2023-09-10T00:13:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff558003600 con 0x7ff5640c85d0 2023-09-10T00:13:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.045+0000 7ff5617fa640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 0x7ff550067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.049+0000 7ff568ffd640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 0x7ff550067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.049+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7ff558083350 con 0x7ff5640c85d0 2023-09-10T00:13:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.049+0000 7ff568ffd640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 0x7ff550067fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5640cdd30 tx=0x7ff55c009500 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.053+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff558050890 con 0x7ff5640c85d0 2023-09-10T00:13:57.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.209+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5640b3790 con 0x7ff5640c85d0 2023-09-10T00:13:57.847 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.841+0000 7ff5617fa640 1 -- 172.21.15.84:0/3843242913 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff558053eb0 con 0x7ff5640c85d0 2023-09-10T00:13:57.848 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 msgr2=0x7ff550067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 0x7ff550067fe0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff5640cdd30 tx=0x7ff55c009500 comp rx=0 tx=0).stop 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 msgr2=0x7ff56415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff55800c4d0 tx=0x7ff55800c990 comp rx=0 tx=0).stop 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 shutdown_connections 2023-09-10T00:13:57.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff550065b20 0x7ff550067fe0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff56415abb0 0x7ff56415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff5640c85d0 0x7ff56415be90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 --2- 172.21.15.84:0/3843242913 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff5640c8030 0x7ff56414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 >> 172.21.15.84:0/3843242913 conn(0x7ff5640cd810 msgr2=0x7ff56406b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 shutdown_connections 2023-09-10T00:13:57.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.845+0000 7ff56b261640 1 -- 172.21.15.84:0/3843242913 wait complete. 2023-09-10T00:13:57.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-10T00:13:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/2686539504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f253815aed0 msgr2=0x7f25380695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:57.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 --2- 172.21.15.84:0/2686539504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f253815aed0 0x7f25380695b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f253401c850 comp rx=0 tx=0).stop 2023-09-10T00:13:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/2686539504 shutdown_connections 2023-09-10T00:13:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 --2- 172.21.15.84:0/2686539504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f253815aed0 0x7f25380695b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/2686539504 >> 172.21.15.84:0/2686539504 conn(0x7f25380b25b0 msgr2=0x7f25380b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/2686539504 shutdown_connections 2023-09-10T00:13:57.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/2686539504 wait complete. 2023-09-10T00:13:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 Processor -- start 2023-09-10T00:13:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- start start 2023-09-10T00:13:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538069af0 0x7f25380c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f253814e680 0x7f253815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:58.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380c5190 con 0x7f25380d0550 2023-09-10T00:13:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25380c5470 con 0x7f2538069af0 2023-09-10T00:13:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380c5750 con 0x7f253814e680 2023-09-10T00:13:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37276/0 (socket says 172.21.15.84:37276) 2023-09-10T00:13:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 -- 172.21.15.84:0/4291518686 learned_addr learned my addr 172.21.15.84:0/4291518686 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 -- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f253814e680 msgr2=0x7f253815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f253814e680 0x7f253815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 -- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538069af0 msgr2=0x7f25380c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538069af0 0x7f25380c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 -- 172.21.15.84:0/4291518686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009560 con 0x7f25380d0550 2023-09-10T00:13:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f253d6be640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f252800c490 tx=0x7f2528001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528003600 con 0x7f25380d0550 2023-09-10T00:13:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2528003780 con 0x7f25380d0550 2023-09-10T00:13:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528003bd0 con 0x7f25380d0550 2023-09-10T00:13:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25380c5a30 con 0x7f25380d0550 2023-09-10T00:13:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25380c8c60 con 0x7f25380d0550 2023-09-10T00:13:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.993+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253804d8c0 con 0x7f25380d0550 2023-09-10T00:13:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.997+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2528003d30 con 0x7f25380d0550 2023-09-10T00:13:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.997+0000 7f252e7fc640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 0x7f251c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.997+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f25280829b0 con 0x7f25380d0550 2023-09-10T00:13:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.997+0000 7f253debf640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 0x7f251c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:58.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:57.997+0000 7f253debf640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 0x7f251c067fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25340af000 tx=0x7f25340195f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:58.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.001+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f25280500b0 con 0x7f25380d0550 2023-09-10T00:13:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.141+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25380c52d0 con 0x7f25380d0550 2023-09-10T00:13:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.845+0000 7f252e7fc640 1 -- 172.21.15.84:0/4291518686 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f25380c52d0 con 0x7f25380d0550 2023-09-10T00:13:58.851 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-09-10T00:13:58.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 msgr2=0x7f251c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:58.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 0x7f251c067fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25340af000 tx=0x7f25340195f0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 msgr2=0x7f2538159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:58.855 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f252800c490 tx=0x7f2528001e80 comp rx=0 tx=0).stop 2023-09-10T00:13:58.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 shutdown_connections 2023-09-10T00:13:58.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f251c065b20 0x7f251c067fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f253814e680 0x7f253815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25380d0550 0x7f2538159b50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.856 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 --2- 172.21.15.84:0/4291518686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538069af0 0x7f25380c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:58.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 >> 172.21.15.84:0/4291518686 conn(0x7f25380b25b0 msgr2=0x7f25380b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:58.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 shutdown_connections 2023-09-10T00:13:58.857 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:58.849+0000 7f2540123640 1 -- 172.21.15.84:0/4291518686 wait complete. 2023-09-10T00:13:58.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-09-10T00:13:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/3832516685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c069810 msgr2=0x7fef1c06c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- 172.21.15.84:0/3832516685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c069810 0x7fef1c06c360 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fef14009840 tx=0x7fef1401c7d0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/3832516685 shutdown_connections 2023-09-10T00:13:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- 172.21.15.84:0/3832516685 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c1597b0 0x7fef1c1628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- 172.21.15.84:0/3832516685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c069810 0x7fef1c06c360 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/3832516685 >> 172.21.15.84:0/3832516685 conn(0x7fef1c0aea00 msgr2=0x7fef1c0aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/3832516685 shutdown_connections 2023-09-10T00:13:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/3832516685 wait complete. 2023-09-10T00:13:59.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 Processor -- start 2023-09-10T00:13:59.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- start start 2023-09-10T00:13:59.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 0x7fef1c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:59.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c069bf0 0x7fef1c14e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1573a0 con 0x7fef1c1597b0 2023-09-10T00:13:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c145c80 con 0x7fef1c069bf0 2023-09-10T00:13:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c14dc20 con 0x7fef1c069810 2023-09-10T00:13:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:59.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37302/0 (socket says 172.21.15.84:37302) 2023-09-10T00:13:59.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 -- 172.21.15.84:0/2787494792 learned_addr learned my addr 172.21.15.84:0/2787494792 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:13:59.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef223ac640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 0x7fef1c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:59.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef21bab640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c069bf0 0x7fef1c14e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:59.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 -- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 msgr2=0x7fef1c145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:59.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 0x7fef1c145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 -- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c069bf0 msgr2=0x7fef1c14e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:59.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c069bf0 0x7fef1c14e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 -- 172.21.15.84:0/2787494792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef140094a0 con 0x7fef1c1597b0 2023-09-10T00:13:59.020 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef223ac640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 0x7fef1c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:13:59.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef22bad640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b970 tx=0x7fef1800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:59.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800cb40 con 0x7fef1c1597b0 2023-09-10T00:13:59.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fef1800cdb0 con 0x7fef1c1597b0 2023-09-10T00:13:59.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c14e880 con 0x7fef1c1597b0 2023-09-10T00:13:59.021 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef180146a0 con 0x7fef1c1597b0 2023-09-10T00:13:59.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.009+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c156ce0 con 0x7fef1c1597b0 2023-09-10T00:13:59.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef1c065f30 con 0x7fef1c1597b0 2023-09-10T00:13:59.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fef1801d3b0 con 0x7fef1c1597b0 2023-09-10T00:13:59.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef12ffd640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 0x7fef00068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:13:59.022 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fef180835a0 con 0x7fef1c1597b0 2023-09-10T00:13:59.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef223ac640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 0x7fef00068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:13:59.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.013+0000 7fef223ac640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 0x7fef00068010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef140af000 tx=0x7fef1401b010 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:13:59.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.017+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fef18050e00 con 0x7fef1c1597b0 2023-09-10T00:13:59.173 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.169+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef1c0722f0 con 0x7fef1c1597b0 2023-09-10T00:13:59.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.885+0000 7fef12ffd640 1 -- 172.21.15.84:0/2787494792 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7fef18054420 con 0x7fef1c1597b0 2023-09-10T00:13:59.890 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data_ec' removed 2023-09-10T00:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 msgr2=0x7fef00068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 0x7fef00068010 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fef140af000 tx=0x7fef1401b010 comp rx=0 tx=0).stop 2023-09-10T00:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 msgr2=0x7fef1c0ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:13:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fef1800b970 tx=0x7fef1800be30 comp rx=0 tx=0).stop 2023-09-10T00:13:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 shutdown_connections 2023-09-10T00:13:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fef00065b50 0x7fef00068010 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fef1c1597b0 0x7fef1c0ad6a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef1c069bf0 0x7fef1c14e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 --2- 172.21.15.84:0/2787494792 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef1c069810 0x7fef1c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:13:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 >> 172.21.15.84:0/2787494792 conn(0x7fef1c0aea00 msgr2=0x7fef1c151410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:13:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.889+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 shutdown_connections 2023-09-10T00:13:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:13:59.893+0000 7fef24610640 1 -- 172.21.15.84:0/2787494792 wait complete. 2023-09-10T00:13:59.918 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-10T00:13:59.918 INFO:tasks.ceph.mds.a:Stopping old one... 2023-09-10T00:13:59.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-10T00:13:59.919 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:59.919 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-10T00:13:59.920 INFO:tasks.ceph.mds.c:Stopping old one... 2023-09-10T00:13:59.920 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-10T00:13:59.920 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:59.920 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-10T00:13:59.921 INFO:tasks.ceph.mds.b:Stopping old one... 2023-09-10T00:13:59.921 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-10T00:13:59.921 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:59.922 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-10T00:13:59.922 INFO:tasks.ceph.mds.d:Stopping old one... 2023-09-10T00:13:59.922 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-10T00:13:59.922 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T00:13:59.929 INFO:tasks.ceph.mds.a:Stopped 2023-09-10T00:13:59.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-10T00:13:59.933 INFO:tasks.ceph.mds.c:Stopped 2023-09-10T00:13:59.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-10T00:13:59.936 INFO:tasks.ceph.mds.b:Stopped 2023-09-10T00:13:59.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-10T00:13:59.943 INFO:tasks.ceph.mds.d:Stopped 2023-09-10T00:13:59.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-10T00:13:59.980 INFO:tasks.ceph.mds.a:Started 2023-09-10T00:13:59.981 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:59.982 INFO:tasks.ceph.mds.c:Started 2023-09-10T00:13:59.982 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:59.987 INFO:tasks.ceph.mds.b:Started 2023-09-10T00:13:59.988 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:59.989 INFO:tasks.ceph.mds.d:Started 2023-09-10T00:13:59.990 DEBUG:teuthology.parallel:result is None 2023-09-10T00:13:59.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-09-10T00:14:00.049 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-09-10T00:14:00.049 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2023-09-10T00:14:00.055 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2023-09-10T00:14:00.062 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2023-09-10T00:14:00.114 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 -- 172.21.15.84:0/1311782823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f271006a5c0 msgr2=0x7f271006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:00.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 --2- 172.21.15.84:0/1311782823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f271006a5c0 0x7f271006aa50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2710072c30 tx=0x7f270801cd60 comp rx=0 tx=0).stop 2023-09-10T00:14:00.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 -- 172.21.15.84:0/1311782823 shutdown_connections 2023-09-10T00:14:00.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 --2- 172.21.15.84:0/1311782823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f271006a5c0 0x7f271006aa50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.115 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 --2- 172.21.15.84:0/1311782823 >> v2:172.21.15.100:3300/0 conn(0x7f27100c8a20 0x7f27100c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 --2- 172.21.15.84:0/1311782823 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 0x7f27100cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 -- 172.21.15.84:0/1311782823 >> 172.21.15.84:0/1311782823 conn(0x7f271006fe90 msgr2=0x7f27100702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:00.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 -- 172.21.15.84:0/1311782823 shutdown_connections 2023-09-10T00:14:00.116 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.109+0000 7f2715237640 1 -- 172.21.15.84:0/1311782823 wait complete. 2023-09-10T00:14:00.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 Processor -- start 2023-09-10T00:14:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- start start 2023-09-10T00:14:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 0x7f271015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 0x7f271013ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710147f10 con 0x7f27100c8a20 2023-09-10T00:14:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710152c80 con 0x7f271006a5c0 2023-09-10T00:14:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2710149490 con 0x7f2710157bf0 2023-09-10T00:14:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46310/0 (socket says 172.21.15.84:46310) 2023-09-10T00:14:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 -- 172.21.15.84:0/1791016275 learned_addr learned my addr 172.21.15.84:0/1791016275 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270ed9d640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 0x7f271015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270f59e640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 0x7f271013ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 -- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 msgr2=0x7f271013ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 0x7f271013ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 -- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 msgr2=0x7f271015fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 0x7f271015fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 -- 172.21.15.84:0/1791016275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080098e0 con 0x7f27100c8a20 2023-09-10T00:14:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270ed9d640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 0x7f271015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:14:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270e59c640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f270400d7a0 tx=0x7f270400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704009c30 con 0x7f27100c8a20 2023-09-10T00:14:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2704009e80 con 0x7f27100c8a20 2023-09-10T00:14:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2710146ee0 con 0x7f27100c8a20 2023-09-10T00:14:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040106a0 con 0x7f27100c8a20 2023-09-10T00:14:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2710149a10 con 0x7f27100c8a20 2023-09-10T00:14:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2710073390 con 0x7f27100c8a20 2023-09-10T00:14:00.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f2704010800 con 0x7f27100c8a20 2023-09-10T00:14:00.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 0x7f26fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:00.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2704083760 con 0x7f27100c8a20 2023-09-10T00:14:00.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.113+0000 7f270ed9d640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 0x7f26fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:00.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.117+0000 7f270ed9d640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 0x7f26fc067fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f270000bbd0 tx=0x7f270000b5b0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:00.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.117+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f2704051150 con 0x7f27100c8a20 2023-09-10T00:14:00.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.285+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f271014a9d0 con 0x7f27100c8a20 2023-09-10T00:14:00.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.913+0000 7f26f77fe640 1 -- 172.21.15.84:0/1791016275 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2704054770 con 0x7f27100c8a20 2023-09-10T00:14:00.918 INFO:teuthology.orchestra.run.smithi084.stderr: removed all blocklist entries 2023-09-10T00:14:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 msgr2=0x7f26fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 0x7f26fc067fe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f270000bbd0 tx=0x7f270000b5b0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 msgr2=0x7f27101479d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f270400d7a0 tx=0x7f270400dc60 comp rx=0 tx=0).stop 2023-09-10T00:14:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 shutdown_connections 2023-09-10T00:14:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f26fc065b20 0x7f26fc067fe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2710157bf0 0x7f271013ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.924 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27100c8a20 0x7f27101479d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 --2- 172.21.15.84:0/1791016275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f271006a5c0 0x7f271015fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:00.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 >> 172.21.15.84:0/1791016275 conn(0x7f271006fe90 msgr2=0x7f2710070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 shutdown_connections 2023-09-10T00:14:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:00.917+0000 7f2715237640 1 -- 172.21.15.84:0/1791016275 wait complete. 2023-09-10T00:14:00.945 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-09-10T00:14:01.068 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/3738950785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc06fad0 msgr2=0x7f66bc06ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/3738950785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc06fad0 0x7f66bc06ff40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009900 tx=0x7f66ac01c890 comp rx=0 tx=0).stop 2023-09-10T00:14:01.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/3738950785 shutdown_connections 2023-09-10T00:14:01.069 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/3738950785 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc0b08f0 0x7f66bc0b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/3738950785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc06fad0 0x7f66bc06ff40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/3738950785 >> 172.21.15.84:0/3738950785 conn(0x7f66bc0cca70 msgr2=0x7f66bc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:01.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/3738950785 shutdown_connections 2023-09-10T00:14:01.070 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/3738950785 wait complete. 2023-09-10T00:14:01.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 Processor -- start 2023-09-10T00:14:01.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- start start 2023-09-10T00:14:01.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 0x7f66bc151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc1577f0 0x7f66bc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc154fb0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc154430 con 0x7f66bc06fad0 2023-09-10T00:14:01.074 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc154710 con 0x7f66bc1577f0 2023-09-10T00:14:01.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46326/0 (socket says 172.21.15.84:46326) 2023-09-10T00:14:01.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 -- 172.21.15.84:0/509420865 learned_addr learned my addr 172.21.15.84:0/509420865 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:01.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c258e640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc1577f0 0x7f66bc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c1d8d640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 0x7f66bc151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 -- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc1577f0 msgr2=0x7f66bc15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc1577f0 0x7f66bc15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 -- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 msgr2=0x7f66bc151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 0x7f66bc151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 -- 172.21.15.84:0/509420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009560 con 0x7f66bc0b08f0 2023-09-10T00:14:01.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c1d8d640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 0x7f66bc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:01.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c158c640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f66ac01a4c0 tx=0x7f66ac0a58c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0052f0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f66ac005540 con 0x7f66bc0b08f0 2023-09-10T00:14:01.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc1549f0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac004930 con 0x7f66bc0b08f0 2023-09-10T00:14:01.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.065+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc1520f0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc0712c0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f66ac0b4070 con 0x7f66bc0b08f0 2023-09-10T00:14:01.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66b27fc640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 0x7f66a0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f66ac11d360 con 0x7f66bc0b08f0 2023-09-10T00:14:01.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66c1d8d640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 0x7f66a0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.069+0000 7f66c1d8d640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 0x7f66a0068010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000f70 tx=0x7f66b8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.073+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f66ac0eada0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.281+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f66bc073400 con 0x7f66bc0b08f0 2023-09-10T00:14:01.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66b27fc640 1 -- 172.21.15.84:0/509420865 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f66ac0ee3c0 con 0x7f66bc0b08f0 2023-09-10T00:14:01.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:01.288 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:14:01.288 INFO:teuthology.orchestra.run.smithi084.stdout: "auth_dump": [ 2023-09-10T00:14:01.288 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.a", 2023-09-10T00:14:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1k3Tr8HxAA0cnWpoM86V6vYdWRBhfOHw==", 2023-09-10T00:14:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.289 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-10T00:14:01.290 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-10T00:14:01.290 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.290 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.b", 2023-09-10T00:14:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1kzT3eLhAAcUxdejvOMuHW4lFJQT0Wsg==", 2023-09-10T00:14:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.291 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.292 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.c", 2023-09-10T00:14:01.293 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1kXIKeKBAAIIFJve06bjSGXxxsZnWInw==", 2023-09-10T00:14:01.293 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.293 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.293 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-10T00:14:01.293 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mds.d", 2023-09-10T00:14:01.294 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1kHh5CNxAAHjOTlqwuFOTGcWML7+sL4A==", 2023-09-10T00:14:01.295 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-10T00:14:01.295 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-10T00:14:01.295 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.0", 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDBCf1kmqsuBhAA6aIdLqWEQPTmm5MXHSgVyA==", 2023-09-10T00:14:01.296 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.297 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.298 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.1", 2023-09-10T00:14:01.298 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDECf1kMCr8DhAAXgaK7bstEyOonwTUynAQqw==", 2023-09-10T00:14:01.298 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.298 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.299 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.2", 2023-09-10T00:14:01.300 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDHCf1kIMgpGBAAbM7SJ/0EuDC01g1+iUuGoQ==", 2023-09-10T00:14:01.300 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.300 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.300 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.3", 2023-09-10T00:14:01.301 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDKCf1km5faIxAAFCyuZ2ioyU8GEH4MtQLToA==", 2023-09-10T00:14:01.302 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.302 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.302 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.302 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.302 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.303 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.303 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.4", 2023-09-10T00:14:01.303 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDQCf1kGFm5IBAADJJuQhHg1qQ2g/UCrCzERA==", 2023-09-10T00:14:01.303 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.304 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.304 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.304 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.304 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.305 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.305 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.5", 2023-09-10T00:14:01.305 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDTCf1kDC1GNRAAkmkQ5mGoyiACvSYQtRY8BA==", 2023-09-10T00:14:01.305 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.305 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.306 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.306 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.306 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.306 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.6", 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDXCf1kmUYeAxAAU8IgpMBSarKo/IhAHVQrwA==", 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.307 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.308 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.308 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.308 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "osd.7", 2023-09-10T00:14:01.308 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDaCf1kP5UeChAAsxKkaHL0Alich5xIqPVkzA==", 2023-09-10T00:14:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow profile osd", 2023-09-10T00:14:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile osd", 2023-09-10T00:14:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.309 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.0", 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC+Cf1kBBJYARAANCeEIrMyww1eYb9zY89mOw==", 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.310 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-10T00:14:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-10T00:14:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-10T00:14:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.1", 2023-09-10T00:14:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC+Cf1kS6Y0CRAAM7iIvJZgkrE9YGUqMAcUAg==", 2023-09-10T00:14:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.312 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.313 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.314 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.2", 2023-09-10T00:14:01.314 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC+Cf1kkuRgBhAAl82p1/o/1kGlYwhjvZtBAw==", 2023-09-10T00:14:01.314 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.314 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.314 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.315 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.3", 2023-09-10T00:14:01.316 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC+Cf1kkKVpDhAAEf1/3Usl9gjL2BFeNzew/Q==", 2023-09-10T00:14:01.316 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow", 2023-09-10T00:14:01.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow r", 2023-09-10T00:14:01.316 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow rw", 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow rwx" 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.admin", 2023-09-10T00:14:01.317 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1kXXTnCBAAvC+YwpJbv/67jZ/pSq7qFg==", 2023-09-10T00:14:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-10T00:14:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr": "allow *", 2023-09-10T00:14:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow *", 2023-09-10T00:14:01.318 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mds", 2023-09-10T00:14:01.319 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1kYgg4HRAAhM9QxF/gvM1W6m7hn+5AUQ==", 2023-09-10T00:14:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mds" 2023-09-10T00:14:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.320 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-mgr", 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1kAhI4HRAA9CSy8dl6gYBktE+1fk255g==", 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-mgr" 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-osd", 2023-09-10T00:14:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1kjBk4HRAAO2kH7n+E57K1p+vtM+TtYg==", 2023-09-10T00:14:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.322 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-osd" 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd", 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1kLiE4HRAAAuN7FAQiQGIDQ4uF5O8QTw==", 2023-09-10T00:14:01.323 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd" 2023-09-10T00:14:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.324 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1kByo4HRAAs6tjdWr2FWUcbe/uhxdGxA==", 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.325 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.326 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "client.bootstrap-rgw", 2023-09-10T00:14:01.326 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQDgCf1k4DE4HRAAq7kBSBFQKxtlNFKChg1+tA==", 2023-09-10T00:14:01.326 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.326 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile bootstrap-rgw" 2023-09-10T00:14:01.326 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.327 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.327 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.x", 2023-09-10T00:14:01.327 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1kwOH3HBAAYdUDq79JbDK0Hu473+S/fg==", 2023-09-10T00:14:01.327 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:01.328 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:01.329 INFO:teuthology.orchestra.run.smithi084.stdout: "entity": "mgr.y", 2023-09-10T00:14:01.329 INFO:teuthology.orchestra.run.smithi084.stdout: "key": "AQC9Cf1klfxTGhAAAEc2uIskIMw1yfAErIi9Zg==", 2023-09-10T00:14:01.329 INFO:teuthology.orchestra.run.smithi084.stdout: "caps": { 2023-09-10T00:14:01.329 INFO:teuthology.orchestra.run.smithi084.stdout: "mds": "allow *", 2023-09-10T00:14:01.329 INFO:teuthology.orchestra.run.smithi084.stdout: "mon": "allow profile mgr", 2023-09-10T00:14:01.330 INFO:teuthology.orchestra.run.smithi084.stdout: "osd": "allow *" 2023-09-10T00:14:01.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.330 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:01.330 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2023-09-10T00:14:01.330 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:14:01.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 msgr2=0x7f66a0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 0x7f66a0068010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f66b8000f70 tx=0x7f66b8009040 comp rx=0 tx=0).stop 2023-09-10T00:14:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 msgr2=0x7f66bc159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f66ac01a4c0 tx=0x7f66ac0a58c0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 shutdown_connections 2023-09-10T00:14:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f66a0065b50 0x7f66a0068010 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f66bc1577f0 0x7f66bc15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f66bc0b08f0 0x7f66bc159bf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 --2- 172.21.15.84:0/509420865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66bc06fad0 0x7f66bc151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 >> 172.21.15.84:0/509420865 conn(0x7f66bc0cca70 msgr2=0x7f66bc0c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 shutdown_connections 2023-09-10T00:14:01.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.285+0000 7f66c3ff1640 1 -- 172.21.15.84:0/509420865 wait complete. 2023-09-10T00:14:01.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-09-10T00:14:01.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- 172.21.15.84:0/1547124011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c0b06f0 msgr2=0x7fb21c0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 --2- 172.21.15.84:0/1547124011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c0b06f0 0x7fb21c0b0b40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009900 tx=0x7fb20c01c7c0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- 172.21.15.84:0/1547124011 shutdown_connections 2023-09-10T00:14:01.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 --2- 172.21.15.84:0/1547124011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c0b06f0 0x7fb21c0b0b40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- 172.21.15.84:0/1547124011 >> 172.21.15.84:0/1547124011 conn(0x7fb21c0c9500 msgr2=0x7fb21c0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:01.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- 172.21.15.84:0/1547124011 shutdown_connections 2023-09-10T00:14:01.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- 172.21.15.84:0/1547124011 wait complete. 2023-09-10T00:14:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 Processor -- start 2023-09-10T00:14:01.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.457+0000 7fb22115d640 1 -- start start 2023-09-10T00:14:01.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb21c0afe90 0x7fb21c14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb21c0b06f0 0x7fb21c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c6350 con 0x7fb21c158bd0 2023-09-10T00:14:01.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c6e90 con 0x7fb21c0b06f0 2023-09-10T00:14:01.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0c5ab0 con 0x7fb21c0afe90 2023-09-10T00:14:01.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46350/0 (socket says 172.21.15.84:46350) 2023-09-10T00:14:01.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 -- 172.21.15.84:0/1112589545 learned_addr learned my addr 172.21.15.84:0/1112589545 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 -- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb21c0afe90 msgr2=0x7fb21c14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb21c0afe90 0x7fb21c14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 -- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb21c0b06f0 msgr2=0x7fb21c14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb21c0b06f0 0x7fb21c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 -- 172.21.15.84:0/1112589545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009560 con 0x7fb21c158bd0 2023-09-10T00:14:01.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21b59e640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb20c01a3f0 tx=0x7fb20c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c004510 con 0x7fb21c158bd0 2023-09-10T00:14:01.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb20c005120 con 0x7fb21c158bd0 2023-09-10T00:14:01.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c0c5d90 con 0x7fb21c158bd0 2023-09-10T00:14:01.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c005510 con 0x7fb21c158bd0 2023-09-10T00:14:01.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c14de00 con 0x7fb21c158bd0 2023-09-10T00:14:01.470 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c073390 con 0x7fb21c158bd0 2023-09-10T00:14:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fb20c0b4070 con 0x7fb21c158bd0 2023-09-10T00:14:01.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 0x7fb1fc068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb20c11dd80 con 0x7fb21c158bd0 2023-09-10T00:14:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.461+0000 7fb21ad9d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 0x7fb1fc068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.472 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.465+0000 7fb21ad9d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 0x7fb1fc068010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb214007fd0 tx=0x7fb214007d40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.465+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fb20c0eb9c0 con 0x7fb21c158bd0 2023-09-10T00:14:01.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.681+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb21c06aec0 con 0x7fb21c158bd0 2023-09-10T00:14:01.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb2137fe640 1 -- 172.21.15.84:0/1112589545 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb20c0b20a0 con 0x7fb21c158bd0 2023-09-10T00:14:01.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 msgr2=0x7fb1fc068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 0x7fb1fc068010 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb214007fd0 tx=0x7fb214007d40 comp rx=0 tx=0).stop 2023-09-10T00:14:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 msgr2=0x7fb21c1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb20c01a3f0 tx=0x7fb20c004060 comp rx=0 tx=0).stop 2023-09-10T00:14:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 shutdown_connections 2023-09-10T00:14:01.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fb1fc065b50 0x7fb1fc068010 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb21c158bd0 0x7fb21c1502e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb21c0b06f0 0x7fb21c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 --2- 172.21.15.84:0/1112589545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb21c0afe90 0x7fb21c14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 >> 172.21.15.84:0/1112589545 conn(0x7fb21c0c9500 msgr2=0x7fb21c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:01.692 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 shutdown_connections 2023-09-10T00:14:01.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.685+0000 7fb22115d640 1 -- 172.21.15.84:0/1112589545 wait complete. 2023-09-10T00:14:01.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-09-10T00:14:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 -- 172.21.15.84:0/15706324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 msgr2=0x7f21e00cf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 --2- 172.21.15.84:0/15706324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e00cf6f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009900 tx=0x7f21d001f0b0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 -- 172.21.15.84:0/15706324 shutdown_connections 2023-09-10T00:14:01.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 --2- 172.21.15.84:0/15706324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e00cf6f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 --2- 172.21.15.84:0/15706324 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 0x7f21e00695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 -- 172.21.15.84:0/15706324 >> 172.21.15.84:0/15706324 conn(0x7f21e00d0b30 msgr2=0x7f21e00d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:01.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 -- 172.21.15.84:0/15706324 shutdown_connections 2023-09-10T00:14:01.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.825+0000 7f21e6951640 1 -- 172.21.15.84:0/15706324 wait complete. 2023-09-10T00:14:01.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 Processor -- start 2023-09-10T00:14:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- start start 2023-09-10T00:14:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 0x7f21e00c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 0x7f21e00c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0150c20 con 0x7f21e00b2cc0 2023-09-10T00:14:01.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0150ea0 con 0x7f21e00b6740 2023-09-10T00:14:01.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0151180 con 0x7f21e015ad80 2023-09-10T00:14:01.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46368/0 (socket says 172.21.15.84:46368) 2023-09-10T00:14:01.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 -- 172.21.15.84:0/2590019221 learned_addr learned my addr 172.21.15.84:0/2590019221 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:01.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21df7fe640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 0x7f21e00c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e4eee640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 0x7f21e00c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 -- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 msgr2=0x7f21e00c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 0x7f21e00c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 -- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 msgr2=0x7f21e00c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:01.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 0x7f21e00c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:01.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 -- 172.21.15.84:0/2590019221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0009560 con 0x7f21e00b2cc0 2023-09-10T00:14:01.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21df7fe640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 0x7f21e00c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:01.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dffff640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f21d800ccb0 tx=0x7f21d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8004b30 con 0x7f21e00b2cc0 2023-09-10T00:14:01.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21d8004d80 con 0x7f21e00b2cc0 2023-09-10T00:14:01.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e0151460 con 0x7f21e00b2cc0 2023-09-10T00:14:01.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8005280 con 0x7f21e00b2cc0 2023-09-10T00:14:01.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e00c8de0 con 0x7f21e00b2cc0 2023-09-10T00:14:01.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.829+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e014a9c0 con 0x7f21e00b2cc0 2023-09-10T00:14:01.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.833+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f21d80053e0 con 0x7f21e00b2cc0 2023-09-10T00:14:01.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.833+0000 7f21dcff9640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 0x7f21c0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:01.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.833+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f21d8083c80 con 0x7f21e00b2cc0 2023-09-10T00:14:01.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.833+0000 7f21df7fe640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 0x7f21c0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:01.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.833+0000 7f21df7fe640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 0x7f21c0067fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21e00cab40 tx=0x7f21c8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:01.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:01.837+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f21e014a9c0 con 0x7f21e00b2cc0 2023-09-10T00:14:02.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.049+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f21e014a9c0 con 0x7f21e00b2cc0 2023-09-10T00:14:02.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21dcff9640 1 -- 172.21.15.84:0/2590019221 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f21e014a9c0 con 0x7f21e00b2cc0 2023-09-10T00:14:02.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 msgr2=0x7f21c0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 0x7f21c0067fe0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21e00cab40 tx=0x7f21c8009040 comp rx=0 tx=0).stop 2023-09-10T00:14:02.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 msgr2=0x7f21e0149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f21d800ccb0 tx=0x7f21d800a620 comp rx=0 tx=0).stop 2023-09-10T00:14:02.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 shutdown_connections 2023-09-10T00:14:02.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f21c0065b20 0x7f21c0067fe0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f21e015ad80 0x7f21e00c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21e00b6740 0x7f21e00c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 --2- 172.21.15.84:0/2590019221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f21e00b2cc0 0x7f21e0149ee0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 >> 172.21.15.84:0/2590019221 conn(0x7f21e00d0b30 msgr2=0x7f21e00b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 shutdown_connections 2023-09-10T00:14:02.065 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.057+0000 7f21e6951640 1 -- 172.21.15.84:0/2590019221 wait complete. 2023-09-10T00:14:02.079 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-09-10T00:14:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 -- 172.21.15.84:0/142077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5668158b60 msgr2=0x7f56680c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 --2- 172.21.15.84:0/142077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5668158b60 0x7f56680c7240 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5658009840 tx=0x7f565801c7d0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 -- 172.21.15.84:0/142077267 shutdown_connections 2023-09-10T00:14:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 --2- 172.21.15.84:0/142077267 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5668158b60 0x7f56680c7240 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 --2- 172.21.15.84:0/142077267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 0x7f5668158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 -- 172.21.15.84:0/142077267 >> 172.21.15.84:0/142077267 conn(0x7f56680c9500 msgr2=0x7f56680c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 -- 172.21.15.84:0/142077267 shutdown_connections 2023-09-10T00:14:02.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.197+0000 7f566cd4c640 1 -- 172.21.15.84:0/142077267 wait complete. 2023-09-10T00:14:02.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 Processor -- start 2023-09-10T00:14:02.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- start start 2023-09-10T00:14:02.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 0x7f566814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 0x7f566806a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566814fc30 con 0x7f56680af4d0 2023-09-10T00:14:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56680c4890 con 0x7f5668158b60 2023-09-10T00:14:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56680c3c80 con 0x7f566806bba0 2023-09-10T00:14:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46390/0 (socket says 172.21.15.84:46390) 2023-09-10T00:14:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 -- 172.21.15.84:0/708880386 learned_addr learned my addr 172.21.15.84:0/708880386 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5666d9d640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 0x7f566806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 -- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 msgr2=0x7f566814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566659c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 0x7f566814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 0x7f566814f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 -- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 msgr2=0x7f566806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 0x7f566806a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 -- 172.21.15.84:0/708880386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580094a0 con 0x7f56680af4d0 2023-09-10T00:14:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5666d9d640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 0x7f566806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:02.212 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f5665d9b640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f565000c970 tx=0x7f565000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650007bb0 con 0x7f56680af4d0 2023-09-10T00:14:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5650007e00 con 0x7f56680af4d0 2023-09-10T00:14:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5650005280 con 0x7f56680af4d0 2023-09-10T00:14:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56680c3f60 con 0x7f56680af4d0 2023-09-10T00:14:02.213 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56680c4520 con 0x7f56680af4d0 2023-09-10T00:14:02.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.201+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56680c4a40 con 0x7f56680af4d0 2023-09-10T00:14:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.205+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f56500053e0 con 0x7f56680af4d0 2023-09-10T00:14:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.205+0000 7f565effd640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 0x7f5648067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.205+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f56500839a0 con 0x7f56680af4d0 2023-09-10T00:14:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.205+0000 7f566659c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 0x7f5648067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.205+0000 7f566659c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 0x7f5648067fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56600012f0 tx=0x7f5660009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.209+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5650051570 con 0x7f56680af4d0 2023-09-10T00:14:02.422 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.417+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5668160e90 con 0x7f56680af4d0 2023-09-10T00:14:02.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.421+0000 7f565effd640 1 -- 172.21.15.84:0/708880386 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5650054b90 con 0x7f56680af4d0 2023-09-10T00:14:02.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 msgr2=0x7f5648067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 0x7f5648067fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56600012f0 tx=0x7f5660009040 comp rx=0 tx=0).stop 2023-09-10T00:14:02.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 msgr2=0x7f5668069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f565000c970 tx=0x7f565000ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 shutdown_connections 2023-09-10T00:14:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5648065b20 0x7f5648067fe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5668158b60 0x7f566806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56680af4d0 0x7f5668069dc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 --2- 172.21.15.84:0/708880386 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f566806bba0 0x7f566814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 >> 172.21.15.84:0/708880386 conn(0x7f56680c9500 msgr2=0x7f56680c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 shutdown_connections 2023-09-10T00:14:02.431 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.425+0000 7f566cd4c640 1 -- 172.21.15.84:0/708880386 wait complete. 2023-09-10T00:14:02.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-09-10T00:14:02.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- 172.21.15.84:0/2202841523 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 msgr2=0x7f170c06a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 --2- 172.21.15.84:0/2202841523 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c06a0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009c80 tx=0x7f16f401ccf0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- 172.21.15.84:0/2202841523 shutdown_connections 2023-09-10T00:14:02.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 --2- 172.21.15.84:0/2202841523 >> v2:172.21.15.100:3300/0 conn(0x7f170c070360 0x7f170c070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 --2- 172.21.15.84:0/2202841523 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c06a0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- 172.21.15.84:0/2202841523 >> 172.21.15.84:0/2202841523 conn(0x7f170c0ccf20 msgr2=0x7f170c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- 172.21.15.84:0/2202841523 shutdown_connections 2023-09-10T00:14:02.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- 172.21.15.84:0/2202841523 wait complete. 2023-09-10T00:14:02.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 Processor -- start 2023-09-10T00:14:02.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.569+0000 7f1710bda640 1 -- start start 2023-09-10T00:14:02.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c13dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c152fc0 0x7f170c0c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c07f0 con 0x7f170c070360 2023-09-10T00:14:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c0c5c40 con 0x7f170c152fc0 2023-09-10T00:14:02.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c154c20 con 0x7f170c06c430 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46398/0 (socket says 172.21.15.84:46398) 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 -- 172.21.15.84:0/423871976 learned_addr learned my addr 172.21.15.84:0/423871976 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f170ad9d640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c152fc0 0x7f170c0c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f170a59c640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c13dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 -- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 msgr2=0x7f170c13dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c13dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 -- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c152fc0 msgr2=0x7f170c0c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c152fc0 0x7f170c0c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 -- 172.21.15.84:0/423871976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40098e0 con 0x7f170c070360 2023-09-10T00:14:02.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1709d9b640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f16f4000f90 tx=0x7f16f4004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4003d90 con 0x7f170c070360 2023-09-10T00:14:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f16f40ae730 con 0x7f170c070360 2023-09-10T00:14:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c154f00 con 0x7f170c070360 2023-09-10T00:14:02.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f40aeb00 con 0x7f170c070360 2023-09-10T00:14:02.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c1554c0 con 0x7f170c070360 2023-09-10T00:14:02.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c0c5e00 con 0x7f170c070360 2023-09-10T00:14:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f16f40b4040 con 0x7f170c070360 2023-09-10T00:14:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 0x7f16ec068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f16f411e740 con 0x7f170c070360 2023-09-10T00:14:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.573+0000 7f170a59c640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 0x7f16ec068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.577+0000 7f170a59c640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 0x7f16ec068010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17040015b0 tx=0x7f1704009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.577+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f16f40ec3c0 con 0x7f170c070360 2023-09-10T00:14:02.800 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.797+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f170c1556b0 con 0x7f170c070360 2023-09-10T00:14:02.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1702ffd640 1 -- 172.21.15.84:0/423871976 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f16f40b20a0 con 0x7f170c070360 2023-09-10T00:14:02.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 msgr2=0x7f16ec068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 0x7f16ec068010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f17040015b0 tx=0x7f1704009040 comp rx=0 tx=0).stop 2023-09-10T00:14:02.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 msgr2=0x7f170c0c02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.807 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f16f4000f90 tx=0x7f16f4004e40 comp rx=0 tx=0).stop 2023-09-10T00:14:02.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 shutdown_connections 2023-09-10T00:14:02.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f16ec065b50 0x7f16ec068010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c152fc0 0x7f170c0c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f170c070360 0x7f170c0c02b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.808 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 --2- 172.21.15.84:0/423871976 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f170c06c430 0x7f170c13dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 >> 172.21.15.84:0/423871976 conn(0x7f170c0ccf20 msgr2=0x7f170c15b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 shutdown_connections 2023-09-10T00:14:02.809 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.801+0000 7f1710bda640 1 -- 172.21.15.84:0/423871976 wait complete. 2023-09-10T00:14:02.824 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-09-10T00:14:02.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2799460641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 msgr2=0x7f5588003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2799460641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f5588003da0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f559800bb10 tx=0x7f559801cd80 comp rx=0 tx=0).stop 2023-09-10T00:14:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a2468640 1 -- 172.21.15.84:0/2799460641 reap_dead start 2023-09-10T00:14:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2799460641 shutdown_connections 2023-09-10T00:14:02.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2799460641 >> 172.21.15.84:0/2799460641 conn(0x7f559c0d0b30 msgr2=0x7f559c0d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2799460641 shutdown_connections 2023-09-10T00:14:02.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2799460641 wait complete. 2023-09-10T00:14:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 Processor -- start 2023-09-10T00:14:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- start start 2023-09-10T00:14:02.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f559c1559c0 0x7f559c0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c87b0 0x7f559c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1533c0 con 0x7f5588003980 2023-09-10T00:14:02.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c85a0 con 0x7f559c0c87b0 2023-09-10T00:14:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a3ecb640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c155ec0 con 0x7f559c1559c0 2023-09-10T00:14:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a1c67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a1c67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46424/0 (socket says 172.21.15.84:46424) 2023-09-10T00:14:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a1c67640 1 -- 172.21.15.84:0/2847309897 learned_addr learned my addr 172.21.15.84:0/2847309897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:02.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.937+0000 7f55a1c67640 1 -- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f559c1559c0 msgr2=0x7f559c0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1c67640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f559c1559c0 0x7f559c0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1c67640 1 -- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c87b0 msgr2=0x7f559c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a2468640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c87b0 0x7f559c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1c67640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c87b0 0x7f559c0c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1c67640 1 -- 172.21.15.84:0/2847309897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c1561a0 con 0x7f5588003980 2023-09-10T00:14:02.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1c67640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f559800ba60 tx=0x7f55980050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980be070 con 0x7f5588003980 2023-09-10T00:14:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5598005470 con 0x7f5588003980 2023-09-10T00:14:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c156480 con 0x7f5588003980 2023-09-10T00:14:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598004280 con 0x7f5588003980 2023-09-10T00:14:02.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c156a40 con 0x7f5588003980 2023-09-10T00:14:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c073390 con 0x7f5588003980 2023-09-10T00:14:02.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f55980046d0 con 0x7f5588003980 2023-09-10T00:14:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 0x7f5580068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1466640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 0x7f5580068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f559811db40 con 0x7f5588003980 2023-09-10T00:14:02.951 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.941+0000 7f55a1466640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 0x7f5580068010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f558c005bd0 tx=0x7f558c005a80 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:02.952 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:02.945+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f55980eb620 con 0x7f5588003980 2023-09-10T00:14:03.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.149+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f559c0d0810 con 0x7f5588003980 2023-09-10T00:14:03.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55927fc640 1 -- 172.21.15.84:0/2847309897 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f55980eec40 con 0x7f5588003980 2023-09-10T00:14:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 msgr2=0x7f5580068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 0x7f5580068010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f558c005bd0 tx=0x7f558c005a80 comp rx=0 tx=0).stop 2023-09-10T00:14:03.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 msgr2=0x7f559c156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f559800ba60 tx=0x7f55980050d0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 shutdown_connections 2023-09-10T00:14:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5580065b50 0x7f5580068010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c87b0 0x7f559c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f559c1559c0 0x7f559c0c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 --2- 172.21.15.84:0/2847309897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5588003980 0x7f559c156f60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 >> 172.21.15.84:0/2847309897 conn(0x7f559c0d0b30 msgr2=0x7f559c0b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 shutdown_connections 2023-09-10T00:14:03.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.153+0000 7f55a3ecb640 1 -- 172.21.15.84:0/2847309897 wait complete. 2023-09-10T00:14:03.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-09-10T00:14:03.296 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/1854682055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 msgr2=0x7f435c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 --2- 172.21.15.84:0/1854682055 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f435c003dd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f436c00bb10 tx=0x7f436c01cdc0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f437643f640 1 -- 172.21.15.84:0/1854682055 reap_dead start 2023-09-10T00:14:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/1854682055 shutdown_connections 2023-09-10T00:14:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/1854682055 >> 172.21.15.84:0/1854682055 conn(0x7f43700d0b30 msgr2=0x7f43700d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/1854682055 shutdown_connections 2023-09-10T00:14:03.298 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/1854682055 wait complete. 2023-09-10T00:14:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 Processor -- start 2023-09-10T00:14:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- start start 2023-09-10T00:14:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43701e1200 0x7f4370145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4370158340 0x7f43701587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43700c9a30 con 0x7f435c0039b0 2023-09-10T00:14:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370158d00 con 0x7f43701e1200 2023-09-10T00:14:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4370146430 con 0x7f4370158340 2023-09-10T00:14:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46434/0 (socket says 172.21.15.84:46434) 2023-09-10T00:14:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 -- 172.21.15.84:0/389914558 learned_addr learned my addr 172.21.15.84:0/389914558 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f437543d640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43701e1200 0x7f4370145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f437643f640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4370158340 0x7f43701587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 -- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4370158340 msgr2=0x7f43701587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4370158340 0x7f43701587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 -- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43701e1200 msgr2=0x7f4370145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43701e1200 0x7f4370145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.303 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 -- 172.21.15.84:0/389914558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43700c9750 con 0x7f435c0039b0 2023-09-10T00:14:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4375c3e640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f436c0b1040 tx=0x7f436c004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c005040 con 0x7f435c0039b0 2023-09-10T00:14:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f436c0052b0 con 0x7f435c0039b0 2023-09-10T00:14:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43700c7d10 con 0x7f435c0039b0 2023-09-10T00:14:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0046d0 con 0x7f435c0039b0 2023-09-10T00:14:03.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.293+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43700c82d0 con 0x7f435c0039b0 2023-09-10T00:14:03.305 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43700c7b70 con 0x7f435c0039b0 2023-09-10T00:14:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f436c004830 con 0x7f435c0039b0 2023-09-10T00:14:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f43667fc640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 0x7f4354067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f436c11e040 con 0x7f435c0039b0 2023-09-10T00:14:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f437543d640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 0x7f4354067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.297+0000 7f437543d640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 0x7f4354067fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f43701e6530 tx=0x7f4360001500 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.301+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f43700c7b70 con 0x7f435c0039b0 2023-09-10T00:14:03.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.509+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f43700c7b70 con 0x7f435c0039b0 2023-09-10T00:14:03.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.513+0000 7f43667fc640 1 -- 172.21.15.84:0/389914558 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f43700c7b70 con 0x7f435c0039b0 2023-09-10T00:14:03.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 msgr2=0x7f4354067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 0x7f4354067fe0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f43701e6530 tx=0x7f4360001500 comp rx=0 tx=0).stop 2023-09-10T00:14:03.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 msgr2=0x7f43700c87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f436c0b1040 tx=0x7f436c004130 comp rx=0 tx=0).stop 2023-09-10T00:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 shutdown_connections 2023-09-10T00:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4354065b20 0x7f4354067fe0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4370158340 0x7f43701587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43701e1200 0x7f4370145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 --2- 172.21.15.84:0/389914558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f435c0039b0 0x7f43700c87f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 >> 172.21.15.84:0/389914558 conn(0x7f43700d0b30 msgr2=0x7f43700c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 shutdown_connections 2023-09-10T00:14:03.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.517+0000 7f4377ea2640 1 -- 172.21.15.84:0/389914558 wait complete. 2023-09-10T00:14:03.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:14:03.664 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3424617526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 msgr2=0x7f810015ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 --2- 172.21.15.84:0/3424617526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810015ec00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009900 tx=0x7f80f001c850 comp rx=0 tx=0).stop 2023-09-10T00:14:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3424617526 shutdown_connections 2023-09-10T00:14:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 --2- 172.21.15.84:0/3424617526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810015ec00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.665 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3424617526 >> 172.21.15.84:0/3424617526 conn(0x7f81000ca240 msgr2=0x7f81000ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3424617526 shutdown_connections 2023-09-10T00:14:03.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3424617526 wait complete. 2023-09-10T00:14:03.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 Processor -- start 2023-09-10T00:14:03.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- start start 2023-09-10T00:14:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 0x7f81000c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f810015f140 0x7f8100148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81001522c0 con 0x7f81000cc460 2023-09-10T00:14:03.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810015c8c0 con 0x7f810006cec0 2023-09-10T00:14:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8100151b10 con 0x7f810015f140 2023-09-10T00:14:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46446/0 (socket says 172.21.15.84:46446) 2023-09-10T00:14:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 -- 172.21.15.84:0/3375703331 learned_addr learned my addr 172.21.15.84:0/3375703331 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:03.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 -- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f810015f140 msgr2=0x7f8100148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80fe59c640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 0x7f81000c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80fed9d640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f810015f140 0x7f8100148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f810015f140 0x7f8100148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 -- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 msgr2=0x7f81000c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 0x7f81000c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 -- 172.21.15.84:0/3375703331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f0009560 con 0x7f81000cc460 2023-09-10T00:14:03.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80fe59c640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 0x7f81000c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:03.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f5d9b640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f80f0019460 tx=0x7f80f0004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0005220 con 0x7f81000cc460 2023-09-10T00:14:03.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80f0005470 con 0x7f81000cc460 2023-09-10T00:14:03.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8100150f00 con 0x7f81000cc460 2023-09-10T00:14:03.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f0004930 con 0x7f81000cc460 2023-09-10T00:14:03.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.661+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81001514c0 con 0x7f81000cc460 2023-09-10T00:14:03.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8100151ca0 con 0x7f81000cc460 2023-09-10T00:14:03.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f80f00b4070 con 0x7f81000cc460 2023-09-10T00:14:03.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f80f77fe640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 0x7f80e0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f80f011d160 con 0x7f81000cc460 2023-09-10T00:14:03.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f80fe59c640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 0x7f80e0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.665+0000 7f80fe59c640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 0x7f80e0067fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000f70 tx=0x7f80e8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.669+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f80f00eac30 con 0x7f81000cc460 2023-09-10T00:14:03.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.825+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8100073400 con 0x7f81000cc460 2023-09-10T00:14:03.829 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.825+0000 7f80f77fe640 1 -- 172.21.15.84:0/3375703331 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f80f00ee250 con 0x7f81000cc460 2023-09-10T00:14:03.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:03.830 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":36,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:00.933968+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:14:03.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 msgr2=0x7f80e0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 0x7f80e0067fe0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f80e8000f70 tx=0x7f80e8009040 comp rx=0 tx=0).stop 2023-09-10T00:14:03.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 msgr2=0x7f810014d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f80f0019460 tx=0x7f80f0004220 comp rx=0 tx=0).stop 2023-09-10T00:14:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 shutdown_connections 2023-09-10T00:14:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f80e0065b20 0x7f80e0067fe0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f810015f140 0x7f8100148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81000cc460 0x7f810014d3e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 --2- 172.21.15.84:0/3375703331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f810006cec0 0x7f81000c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 >> 172.21.15.84:0/3375703331 conn(0x7f81000ca240 msgr2=0x7f81001578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 shutdown_connections 2023-09-10T00:14:03.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.829+0000 7f8104b95640 1 -- 172.21.15.84:0/3375703331 wait complete. 2023-09-10T00:14:03.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-10T00:14:03.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T00:14:03.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2821426358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fd8004d10 msgr2=0x7f0fd8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.980 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2821426358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0fd8004d10 0x7f0fd8005190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800c640 tx=0x7f0fe801d380 comp rx=0 tx=0).stop 2023-09-10T00:14:03.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff52e2640 1 -- 172.21.15.84:0/2821426358 reap_dead start 2023-09-10T00:14:03.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2821426358 shutdown_connections 2023-09-10T00:14:03.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2821426358 >> 172.21.15.84:0/2821426358 conn(0x7f0ff00aec00 msgr2=0x7f0ff00cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:03.981 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2821426358 shutdown_connections 2023-09-10T00:14:03.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2821426358 wait complete. 2023-09-10T00:14:03.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 Processor -- start 2023-09-10T00:14:03.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- start start 2023-09-10T00:14:03.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 0x7f0ff013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 0x7f0ff00b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00b1aa0 con 0x7f0ff01348a0 2023-09-10T00:14:03.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0134d20 con 0x7f0ff0134170 2023-09-10T00:14:03.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff015b710 con 0x7f0ff00b10b0 2023-09-10T00:14:03.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46456/0 (socket says 172.21.15.84:46456) 2023-09-10T00:14:03.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 -- 172.21.15.84:0/2044553322 learned_addr learned my addr 172.21.15.84:0/2044553322 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:03.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff52e2640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 0x7f0ff00b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff4ae1640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 0x7f0ff013fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.987 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 -- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 msgr2=0x7f0ff00b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 0x7f0ff00b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 -- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 msgr2=0x7f0ff013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 0x7f0ff013fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 -- 172.21.15.84:0/2044553322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0140260 con 0x7f0ff01348a0 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff4ae1640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 0x7f0ff013fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:03.988 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff52e2640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 0x7f0ff00b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:03.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0feffff640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e7b0 tx=0x7f0fe400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400cc00 con 0x7f0ff01348a0 2023-09-10T00:14:03.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0fe400ce50 con 0x7f0ff01348a0 2023-09-10T00:14:03.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff0140540 con 0x7f0ff01348a0 2023-09-10T00:14:03.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4005280 con 0x7f0ff01348a0 2023-09-10T00:14:03.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.977+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff0140b00 con 0x7f0ff01348a0 2023-09-10T00:14:03.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff00713a0 con 0x7f0ff01348a0 2023-09-10T00:14:03.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f0fe40053e0 con 0x7f0ff01348a0 2023-09-10T00:14:03.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0fed7fa640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 0x7f0fdc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:03.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0fe4083970 con 0x7f0ff01348a0 2023-09-10T00:14:03.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0ff4ae1640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 0x7f0fdc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:03.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.981+0000 7f0ff4ae1640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 0x7f0fdc067fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0005d10 tx=0x7f0fe0005e40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:03.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:03.985+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f0fe40514d0 con 0x7f0ff01348a0 2023-09-10T00:14:04.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.129+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ff0073400 con 0x7f0ff01348a0 2023-09-10T00:14:04.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.129+0000 7f0fed7fa640 1 -- 172.21.15.84:0/2044553322 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fe401f020 con 0x7f0ff01348a0 2023-09-10T00:14:04.134 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T00:14:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.129+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 msgr2=0x7f0fdc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.129+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 0x7f0fdc067fe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0005d10 tx=0x7f0fe0005e40 comp rx=0 tx=0).stop 2023-09-10T00:14:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 msgr2=0x7f0ff015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400e7b0 tx=0x7f0fe400ec70 comp rx=0 tx=0).stop 2023-09-10T00:14:04.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 shutdown_connections 2023-09-10T00:14:04.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f0fdc065b20 0x7f0fdc067fe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0ff00b10b0 0x7f0ff00b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0ff01348a0 0x7f0ff015bb10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 --2- 172.21.15.84:0/2044553322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff0134170 0x7f0ff013fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 >> 172.21.15.84:0/2044553322 conn(0x7f0ff00aec00 msgr2=0x7f0ff00c8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:04.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 shutdown_connections 2023-09-10T00:14:04.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.133+0000 7f0ff6d45640 1 -- 172.21.15.84:0/2044553322 wait complete. 2023-09-10T00:14:04.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-10T00:14:04.272 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/3477980283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47dc0047d0 msgr2=0x7f47dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 --2- 172.21.15.84:0/3477980283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47dc0047d0 0x7f47dc004c50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f47f006f370 tx=0x7f47e401c690 comp rx=0 tx=0).stop 2023-09-10T00:14:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/3477980283 shutdown_connections 2023-09-10T00:14:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 --2- 172.21.15.84:0/3477980283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47dc0047d0 0x7f47dc004c50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.273 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/3477980283 >> 172.21.15.84:0/3477980283 conn(0x7f47f00cb7c0 msgr2=0x7f47f00cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/3477980283 shutdown_connections 2023-09-10T00:14:04.274 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/3477980283 wait complete. 2023-09-10T00:14:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 Processor -- start 2023-09-10T00:14:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- start start 2023-09-10T00:14:04.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f47dc0047d0 0x7f47f00c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 0x7f47f01f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01f2e90 con 0x7f47f0152220 2023-09-10T00:14:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00c5730 con 0x7f47f0152ad0 2023-09-10T00:14:04.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00c6e90 con 0x7f47dc0047d0 2023-09-10T00:14:04.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46470/0 (socket says 172.21.15.84:46470) 2023-09-10T00:14:04.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 -- 172.21.15.84:0/898794574 learned_addr learned my addr 172.21.15.84:0/898794574 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:04.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f5a74640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 0x7f47f01f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6275640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f47dc0047d0 0x7f47f00c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 -- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f47dc0047d0 msgr2=0x7f47f00c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f47dc0047d0 0x7f47f00c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 -- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 msgr2=0x7f47f01f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 0x7f47f01f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.279 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 -- 172.21.15.84:0/898794574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f00c7170 con 0x7f47f0152220 2023-09-10T00:14:04.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f5a74640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 0x7f47f01f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:14:04.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f6a76640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f47f0159400 tx=0x7f47e8006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:04.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e800e8f0 con 0x7f47f0152220 2023-09-10T00:14:04.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f47e800eb40 con 0x7f47f0152220 2023-09-10T00:14:04.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8011460 con 0x7f47f0152220 2023-09-10T00:14:04.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f00c7450 con 0x7f47f0152220 2023-09-10T00:14:04.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.269+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f0153250 con 0x7f47f0152220 2023-09-10T00:14:04.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f006f3a0 con 0x7f47f0152220 2023-09-10T00:14:04.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f47e80115c0 con 0x7f47f0152220 2023-09-10T00:14:04.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47e2ffd640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 0x7f47d4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f47e80839d0 con 0x7f47f0152220 2023-09-10T00:14:04.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47f6275640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 0x7f47d4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.273+0000 7f47f6275640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 0x7f47d4068010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec005f60 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:04.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.277+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f47e8051530 con 0x7f47f0152220 2023-09-10T00:14:04.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f47f00c9f40 con 0x7f47f0152220 2023-09-10T00:14:04.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47e2ffd640 1 -- 172.21.15.84:0/898794574 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f47f00c9f40 con 0x7f47f0152220 2023-09-10T00:14:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:04.437 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2023-09-10T00:14:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: { 2023-09-10T00:14:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2023-09-10T00:14:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2023-09-10T00:14:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:04.438 INFO:teuthology.orchestra.run.smithi084.stdout:] 2023-09-10T00:14:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 msgr2=0x7f47d4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.439 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 0x7f47d4068010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005fd0 tx=0x7f47ec005f60 comp rx=0 tx=0).stop 2023-09-10T00:14:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 msgr2=0x7f47f00b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f47f0159400 tx=0x7f47e8006420 comp rx=0 tx=0).stop 2023-09-10T00:14:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 shutdown_connections 2023-09-10T00:14:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f47d4065b50 0x7f47d4068010 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.440 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47f0152220 0x7f47f00b2a20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0152ad0 0x7f47f01f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 --2- 172.21.15.84:0/898794574 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f47dc0047d0 0x7f47f00c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 >> 172.21.15.84:0/898794574 conn(0x7f47f00cb7c0 msgr2=0x7f47f0158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 shutdown_connections 2023-09-10T00:14:04.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.433+0000 7f47f84d9640 1 -- 172.21.15.84:0/898794574 wait complete. 2023-09-10T00:14:04.455 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-10T00:14:04.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-10T00:14:04.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- 172.21.15.84:0/3834111430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd360157ac0 msgr2=0x7fd3600c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 --2- 172.21.15.84:0/3834111430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd360157ac0 0x7fd3600c9bb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd360070400 tx=0x7fd35c01c860 comp rx=0 tx=0).stop 2023-09-10T00:14:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- 172.21.15.84:0/3834111430 shutdown_connections 2023-09-10T00:14:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 --2- 172.21.15.84:0/3834111430 >> v2:172.21.15.100:3300/0 conn(0x7fd3600ac6b0 0x7fd360070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 --2- 172.21.15.84:0/3834111430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd360157ac0 0x7fd3600c9bb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- 172.21.15.84:0/3834111430 >> 172.21.15.84:0/3834111430 conn(0x7fd3600af240 msgr2=0x7fd3600af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- 172.21.15.84:0/3834111430 shutdown_connections 2023-09-10T00:14:04.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- 172.21.15.84:0/3834111430 wait complete. 2023-09-10T00:14:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 Processor -- start 2023-09-10T00:14:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.577+0000 7fd36840c640 1 -- start start 2023-09-10T00:14:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3600710b0 0x7fd3600b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 0x7fd360147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36014c1b0 con 0x7fd3600ac6b0 2023-09-10T00:14:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36014c490 con 0x7fd3600710b0 2023-09-10T00:14:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36014c770 con 0x7fd360157ac0 2023-09-10T00:14:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46482/0 (socket says 172.21.15.84:46482) 2023-09-10T00:14:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 -- 172.21.15.84:0/134711131 learned_addr learned my addr 172.21.15.84:0/134711131 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3661a8640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3600710b0 0x7fd3600b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 -- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 msgr2=0x7fd360147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3669a9640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 0x7fd360147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 0x7fd360147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 -- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3600710b0 msgr2=0x7fd3600b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3600710b0 0x7fd3600b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 -- 172.21.15.84:0/134711131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c009560 con 0x7fd3600ac6b0 2023-09-10T00:14:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3669a9640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 0x7fd360147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:04.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3659a7640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c970 tx=0x7fd35400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354007bb0 con 0x7fd3600ac6b0 2023-09-10T00:14:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd354007e20 con 0x7fd3600ac6b0 2023-09-10T00:14:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36014ca50 con 0x7fd3600ac6b0 2023-09-10T00:14:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354005280 con 0x7fd3600ac6b0 2023-09-10T00:14:04.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3600b08b0 con 0x7fd3600ac6b0 2023-09-10T00:14:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36014cf70 con 0x7fd3600ac6b0 2023-09-10T00:14:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd3540053e0 con 0x7fd3600ac6b0 2023-09-10T00:14:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 0x7fd344067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:04.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd354083a90 con 0x7fd3600ac6b0 2023-09-10T00:14:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3661a8640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 0x7fd344067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.581+0000 7fd3661a8640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 0x7fd344067fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0af000 tx=0x7fd35c01b0a0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:04.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.585+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd36014cf70 con 0x7fd3600ac6b0 2023-09-10T00:14:04.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:04.741+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd36014cf70 con 0x7fd3600ac6b0 2023-09-10T00:14:05.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.521+0000 7fd352ffd640 1 -- 172.21.15.84:0/134711131 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd36014cf70 con 0x7fd3600ac6b0 2023-09-10T00:14:05.525 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2023-09-10T00:14:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 msgr2=0x7fd344067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 0x7fd344067fe0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0af000 tx=0x7fd35c01b0a0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 msgr2=0x7fd3600c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c970 tx=0x7fd35400ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 shutdown_connections 2023-09-10T00:14:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd344065b20 0x7fd344067fe0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd360157ac0 0x7fd360147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3600ac6b0 0x7fd3600c1c90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 --2- 172.21.15.84:0/134711131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3600710b0 0x7fd3600b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 >> 172.21.15.84:0/134711131 conn(0x7fd3600af240 msgr2=0x7fd3600cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 shutdown_connections 2023-09-10T00:14:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.525+0000 7fd36840c640 1 -- 172.21.15.84:0/134711131 wait complete. 2023-09-10T00:14:05.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-10T00:14:05.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- 172.21.15.84:0/391854142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b2570 msgr2=0x7f98b40b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:05.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- 172.21.15.84:0/391854142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b2570 0x7f98b40b2950 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f98b406ae50 tx=0x7f98a401f050 comp rx=0 tx=0).stop 2023-09-10T00:14:05.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- 172.21.15.84:0/391854142 shutdown_connections 2023-09-10T00:14:05.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- 172.21.15.84:0/391854142 >> v2:172.21.15.100:3300/0 conn(0x7f98b40cefd0 0x7f98b4069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- 172.21.15.84:0/391854142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40b2570 0x7f98b40b2950 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- 172.21.15.84:0/391854142 >> 172.21.15.84:0/391854142 conn(0x7f98b40cd570 msgr2=0x7f98b40cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:05.690 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- 172.21.15.84:0/391854142 shutdown_connections 2023-09-10T00:14:05.691 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- 172.21.15.84:0/391854142 wait complete. 2023-09-10T00:14:05.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 Processor -- start 2023-09-10T00:14:05.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- start start 2023-09-10T00:14:05.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98b40b2570 0x7f98b414dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:05.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:05.693 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98b40cefd0 0x7f98b4150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b414dbb0 con 0x7f98b40ceb70 2023-09-10T00:14:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b414ef60 con 0x7f98b40cefd0 2023-09-10T00:14:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b9918640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b414e350 con 0x7f98b40b2570 2023-09-10T00:14:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:05.694 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46494/0 (socket says 172.21.15.84:46494) 2023-09-10T00:14:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.685+0000 7f98b27fc640 1 -- 172.21.15.84:0/899624727 learned_addr learned my addr 172.21.15.84:0/899624727 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b2ffd640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98b40b2570 0x7f98b414dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b37fe640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98b40cefd0 0x7f98b4150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 -- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98b40b2570 msgr2=0x7f98b414dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:05.695 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98b40b2570 0x7f98b414dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 -- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98b40cefd0 msgr2=0x7f98b4150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98b40cefd0 0x7f98b4150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 -- 172.21.15.84:0/899624727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4009560 con 0x7f98b40ceb70 2023-09-10T00:14:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b27fc640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c450 tx=0x7f98a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:05.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8012830 con 0x7f98b40ceb70 2023-09-10T00:14:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98a8012aa0 con 0x7f98b40ceb70 2023-09-10T00:14:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b414e630 con 0x7f98b40ceb70 2023-09-10T00:14:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8011380 con 0x7f98b40ceb70 2023-09-10T00:14:05.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b414ebf0 con 0x7f98b40ceb70 2023-09-10T00:14:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b406c610 con 0x7f98b40ceb70 2023-09-10T00:14:05.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f98a80114e0 con 0x7f98b40ceb70 2023-09-10T00:14:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 0x7f98a0068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b2ffd640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 0x7f98a0068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f98a8083160 con 0x7f98b40ceb70 2023-09-10T00:14:05.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.689+0000 7f98b2ffd640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 0x7f98a0068010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f98a40b2000 tx=0x7f98a401d890 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:05.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.693+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f98a8050c90 con 0x7f98b40ceb70 2023-09-10T00:14:05.853 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:05.849+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f98b414f0a0 con 0x7f98b40ceb70 2023-09-10T00:14:06.536 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.533+0000 7f989bfff640 1 -- 172.21.15.84:0/899624727 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7f98a80542b0 con 0x7f98b40ceb70 2023-09-10T00:14:06.537 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2023-09-10T00:14:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 msgr2=0x7f98a0068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:06.540 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 0x7f98a0068010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f98a40b2000 tx=0x7f98a401d890 comp rx=0 tx=0).stop 2023-09-10T00:14:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 msgr2=0x7f98b414d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:06.541 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c450 tx=0x7f98a800c910 comp rx=0 tx=0).stop 2023-09-10T00:14:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 shutdown_connections 2023-09-10T00:14:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98a0065b50 0x7f98a0068010 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98b40cefd0 0x7f98b4150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f98b40ceb70 0x7f98b414d670 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.542 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 --2- 172.21.15.84:0/899624727 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f98b40b2570 0x7f98b414dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 >> 172.21.15.84:0/899624727 conn(0x7f98b40cd570 msgr2=0x7f98b40c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 shutdown_connections 2023-09-10T00:14:06.543 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.537+0000 7f98b9918640 1 -- 172.21.15.84:0/899624727 wait complete. 2023-09-10T00:14:06.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-10T00:14:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1415214775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f615015b4f0 msgr2=0x7f615015b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- 172.21.15.84:0/1415214775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f615015b4f0 0x7f615015b940 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f61500afe70 tx=0x7f614801cad0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1415214775 shutdown_connections 2023-09-10T00:14:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- 172.21.15.84:0/1415214775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f615015b4f0 0x7f615015b940 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- 172.21.15.84:0/1415214775 >> v2:172.21.15.100:3300/0 conn(0x7f615006d4d0 0x7f615006bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1415214775 >> 172.21.15.84:0/1415214775 conn(0x7f61500af230 msgr2=0x7f61500af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1415214775 shutdown_connections 2023-09-10T00:14:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1415214775 wait complete. 2023-09-10T00:14:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 Processor -- start 2023-09-10T00:14:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- start start 2023-09-10T00:14:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 0x7f6150153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f615015b4f0 0x7f615015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501449a0 con 0x7f61501579d0 2023-09-10T00:14:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150143a60 con 0x7f615006d4d0 2023-09-10T00:14:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61501535b0 con 0x7f615015b4f0 2023-09-10T00:14:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46514/0 (socket says 172.21.15.84:46514) 2023-09-10T00:14:06.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 -- 172.21.15.84:0/1133518777 learned_addr learned my addr 172.21.15.84:0/1133518777 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614f7fe640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 0x7f6150153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614ffff640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f615015b4f0 0x7f615015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 -- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f615015b4f0 msgr2=0x7f615015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f615015b4f0 0x7f615015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 -- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 msgr2=0x7f6150153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 0x7f6150153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 -- 172.21.15.84:0/1133518777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148009820 con 0x7f61501579d0 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614f7fe640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 0x7f6150153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f614effd640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f613800c970 tx=0x7f613800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138007bb0 con 0x7f61501579d0 2023-09-10T00:14:06.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6138007e00 con 0x7f61501579d0 2023-09-10T00:14:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6150143d20 con 0x7f61501579d0 2023-09-10T00:14:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138005280 con 0x7f61501579d0 2023-09-10T00:14:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.701+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61501442e0 con 0x7f61501579d0 2023-09-10T00:14:06.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615006e0d0 con 0x7f61501579d0 2023-09-10T00:14:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f61380053e0 con 0x7f61501579d0 2023-09-10T00:14:06.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f6147fff640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 0x7f6130067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f6138083a00 con 0x7f61501579d0 2023-09-10T00:14:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f614f7fe640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 0x7f6130067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.705+0000 7f614f7fe640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 0x7f6130067fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61400046c0 tx=0x7f6140009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:06.715 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.709+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6138051270 con 0x7f61501579d0 2023-09-10T00:14:06.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:06.897+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6150073400 con 0x7f61501579d0 2023-09-10T00:14:07.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.573+0000 7f6147fff640 1 -- 172.21.15.84:0/1133518777 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f613801d070 con 0x7f61501579d0 2023-09-10T00:14:07.579 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 5 and data pool 6 2023-09-10T00:14:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.577+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 msgr2=0x7f6130067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 0x7f6130067fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f61400046c0 tx=0x7f6140009040 comp rx=0 tx=0).stop 2023-09-10T00:14:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 msgr2=0x7f6150162010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.587 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f613800c970 tx=0x7f613800ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 shutdown_connections 2023-09-10T00:14:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6130065b20 0x7f6130067fe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f615015b4f0 0x7f615015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61501579d0 0x7f6150162010 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 --2- 172.21.15.84:0/1133518777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615006d4d0 0x7f6150153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 >> 172.21.15.84:0/1133518777 conn(0x7f61500af230 msgr2=0x7f615006cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:07.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 shutdown_connections 2023-09-10T00:14:07.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.581+0000 7f6155b24640 1 -- 172.21.15.84:0/1133518777 wait complete. 2023-09-10T00:14:07.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:14:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/417916449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 msgr2=0x7feae406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- 172.21.15.84:0/417916449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae406c800 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7feae40cddb0 tx=0x7feadc01cd60 comp rx=0 tx=0).stop 2023-09-10T00:14:07.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/417916449 shutdown_connections 2023-09-10T00:14:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- 172.21.15.84:0/417916449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae406c800 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- 172.21.15.84:0/417916449 >> v2:172.21.15.100:3300/0 conn(0x7feae4157740 0x7feae40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/417916449 >> 172.21.15.84:0/417916449 conn(0x7feae40ccef0 msgr2=0x7feae40cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/417916449 shutdown_connections 2023-09-10T00:14:07.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/417916449 wait complete. 2023-09-10T00:14:07.735 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 Processor -- start 2023-09-10T00:14:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- start start 2023-09-10T00:14:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 0x7feae41f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:07.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 0x7feae40c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae414b240 con 0x7feae40c7c50 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae40c36f0 con 0x7feae4157740 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae414b450 con 0x7feae406c370 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46542/0 (socket says 172.21.15.84:46542) 2023-09-10T00:14:07.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 -- 172.21.15.84:0/3309693106 learned_addr learned my addr 172.21.15.84:0/3309693106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae99fa640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 0x7feae40c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae91f9640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 0x7feae41f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 -- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 msgr2=0x7feae41f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 0x7feae41f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 -- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 msgr2=0x7feae40c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 0x7feae40c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 -- 172.21.15.84:0/3309693106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0098e0 con 0x7feae40c7c50 2023-09-10T00:14:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae99fa640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 0x7feae40c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae91f9640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 0x7feae41f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:07.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feae89f8640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7feae000c500 tx=0x7feae000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0005220 con 0x7feae40c7c50 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feae0005470 con 0x7feae40c7c50 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae414b730 con 0x7feae40c7c50 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0007290 con 0x7feae40c7c50 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.729+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae414bcf0 con 0x7feae40c7c50 2023-09-10T00:14:07.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae41509d0 con 0x7feae40c7c50 2023-09-10T00:14:07.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feae00073f0 con 0x7feae40c7c50 2023-09-10T00:14:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7fead9ffb640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 0x7feac8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feae0082ff0 con 0x7feae40c7c50 2023-09-10T00:14:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7feae91f9640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 0x7feac8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.733+0000 7feae91f9640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 0x7feac8067fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fead400a870 tx=0x7fead4008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:07.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.737+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feae00b3db0 con 0x7feae40c7c50 2023-09-10T00:14:07.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.893+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae4156df0 con 0x7feae40c7c50 2023-09-10T00:14:07.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.893+0000 7fead9ffb640 1 -- 172.21.15.84:0/3309693106 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16775 (secure 0 0 0) 0x7feae41509d0 con 0x7feae40c7c50 2023-09-10T00:14:07.900 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:07.900 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:06.904129+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:14:07.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 msgr2=0x7feac8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 0x7feac8067fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fead400a870 tx=0x7fead4008040 comp rx=0 tx=0).stop 2023-09-10T00:14:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 msgr2=0x7feae414ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7feae000c500 tx=0x7feae000c9c0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 shutdown_connections 2023-09-10T00:14:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feac8065b20 0x7feac8067fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feae4157740 0x7feae40c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feae40c7c50 0x7feae414ad00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 --2- 172.21.15.84:0/3309693106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feae406c370 0x7feae41f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:07.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 >> 172.21.15.84:0/3309693106 conn(0x7feae40ccef0 msgr2=0x7feae4154490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 shutdown_connections 2023-09-10T00:14:07.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:07.897+0000 7feaeb45d640 1 -- 172.21.15.84:0/3309693106 wait complete. 2023-09-10T00:14:07.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:14:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- 172.21.15.84:0/1382909519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc06a6e0 msgr2=0x7f5cfc158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- 172.21.15.84:0/1382909519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc06a6e0 0x7f5cfc158ee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009840 tx=0x7f5cec01c770 comp rx=0 tx=0).stop 2023-09-10T00:14:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- 172.21.15.84:0/1382909519 shutdown_connections 2023-09-10T00:14:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- 172.21.15.84:0/1382909519 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc06a6e0 0x7f5cfc158ee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- 172.21.15.84:0/1382909519 >> v2:172.21.15.100:3300/0 conn(0x7f5cfc0afa40 0x7f5cfc0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- 172.21.15.84:0/1382909519 >> 172.21.15.84:0/1382909519 conn(0x7f5cfc0cca70 msgr2=0x7f5cfc0cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- 172.21.15.84:0/1382909519 shutdown_connections 2023-09-10T00:14:08.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- 172.21.15.84:0/1382909519 wait complete. 2023-09-10T00:14:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 Processor -- start 2023-09-10T00:14:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- start start 2023-09-10T00:14:08.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cfc06a6e0 0x7f5cfc1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc0afa40 0x7f5cfc1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1419d0 con 0x7f5cfc06d250 2023-09-10T00:14:08.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc141760 con 0x7f5cfc06a6e0 2023-09-10T00:14:08.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d047e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc147800 con 0x7f5cfc0afa40 2023-09-10T00:14:08.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46550/0 (socket says 172.21.15.84:46550) 2023-09-10T00:14:08.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 -- 172.21.15.84:0/2489712613 learned_addr learned my addr 172.21.15.84:0/2489712613 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d02d81640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc0afa40 0x7f5cfc1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d02580640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cfc06a6e0 0x7f5cfc1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 -- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc0afa40 msgr2=0x7f5cfc1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc0afa40 0x7f5cfc1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 -- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cfc06a6e0 msgr2=0x7f5cfc1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cfc06a6e0 0x7f5cfc1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.045+0000 7f5d01d7f640 1 -- 172.21.15.84:0/2489712613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80094a0 con 0x7f5cfc06d250 2023-09-10T00:14:08.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d01d7f640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000c10 tx=0x7f5cec0a5700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0bc070 con 0x7f5cfc06d250 2023-09-10T00:14:08.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cec0051b0 con 0x7f5cfc06d250 2023-09-10T00:14:08.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec005560 con 0x7f5cfc06d250 2023-09-10T00:14:08.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec0094a0 con 0x7f5cfc06d250 2023-09-10T00:14:08.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc156f10 con 0x7f5cfc06d250 2023-09-10T00:14:08.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc0712c0 con 0x7f5cfc06d250 2023-09-10T00:14:08.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5cec0b4040 con 0x7f5cfc06d250 2023-09-10T00:14:08.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 0x7f5ce0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d02580640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 0x7f5ce0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5cec11e1b0 con 0x7f5cfc06d250 2023-09-10T00:14:08.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.049+0000 7f5d02580640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 0x7f5ce0067fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0adc90 tx=0x7f5cf80091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.053+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5cec0eb9b0 con 0x7f5cfc06d250 2023-09-10T00:14:08.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.209+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cfc073400 con 0x7f5cfc06d250 2023-09-10T00:14:08.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5cf2ffd640 1 -- 172.21.15.84:0/2489712613 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f5cec0b2020 con 0x7f5cfc06d250 2023-09-10T00:14:08.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:08.216 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":39,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:06.904129+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:14:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 msgr2=0x7f5ce0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 0x7f5ce0067fe0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0adc90 tx=0x7f5cf80091e0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 msgr2=0x7f5cfc140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000c10 tx=0x7f5cec0a5700 comp rx=0 tx=0).stop 2023-09-10T00:14:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 shutdown_connections 2023-09-10T00:14:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5ce0065b20 0x7f5ce0067fe0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cfc0afa40 0x7f5cfc1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5cfc06d250 0x7f5cfc140b70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 --2- 172.21.15.84:0/2489712613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cfc06a6e0 0x7f5cfc1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 >> 172.21.15.84:0/2489712613 conn(0x7f5cfc0cca70 msgr2=0x7f5cfc15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 shutdown_connections 2023-09-10T00:14:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.213+0000 7f5d047e4640 1 -- 172.21.15.84:0/2489712613 wait complete. 2023-09-10T00:14:08.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-10T00:14:08.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- 172.21.15.84:0/131972915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc29806fa60 msgr2=0x7fc29806fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/131972915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc29806fa60 0x7fc29806fe40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc288009900 tx=0x7fc28801c890 comp rx=0 tx=0).stop 2023-09-10T00:14:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- 172.21.15.84:0/131972915 shutdown_connections 2023-09-10T00:14:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/131972915 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 0x7fc29806c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.362 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/131972915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc29806fa60 0x7fc29806fe40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- 172.21.15.84:0/131972915 >> 172.21.15.84:0/131972915 conn(0x7fc2980aec00 msgr2=0x7fc2980cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- 172.21.15.84:0/131972915 shutdown_connections 2023-09-10T00:14:08.363 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- 172.21.15.84:0/131972915 wait complete. 2023-09-10T00:14:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 Processor -- start 2023-09-10T00:14:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 -- start start 2023-09-10T00:14:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 0x7fc2980b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.357+0000 7fc29e3ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc298158230 0x7fc2980b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2980afd10 con 0x7fc29806fa60 2023-09-10T00:14:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc298148e20 con 0x7fc298158230 2023-09-10T00:14:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29814c370 con 0x7fc29806c280 2023-09-10T00:14:08.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46566/0 (socket says 172.21.15.84:46566) 2023-09-10T00:14:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 -- 172.21.15.84:0/866594503 learned_addr learned my addr 172.21.15.84:0/866594503 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc297fff640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 0x7fc2980b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29c967640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc298158230 0x7fc2980b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 -- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 msgr2=0x7fc2980b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 0x7fc2980b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 -- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc298158230 msgr2=0x7fc2980b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc298158230 0x7fc2980b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 -- 172.21.15.84:0/866594503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288009560 con 0x7fc29806fa60 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc28f7fe640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c450 tx=0x7fc28000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280005480 con 0x7fc29806fa60 2023-09-10T00:14:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2980b11e0 con 0x7fc29806fa60 2023-09-10T00:14:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2800036f0 con 0x7fc29806fa60 2023-09-10T00:14:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280003b00 con 0x7fc29806fa60 2023-09-10T00:14:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2980af930 con 0x7fc29806fa60 2023-09-10T00:14:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2980af790 con 0x7fc29806fa60 2023-09-10T00:14:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fc280003c60 con 0x7fc29806fa60 2023-09-10T00:14:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 0x7fc278067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc297fff640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 0x7fc278067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc280082c10 con 0x7fc29806fa60 2023-09-10T00:14:08.372 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.361+0000 7fc297fff640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 0x7fc278067fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2880af000 tx=0x7fc28801b0d0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.373 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.365+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fc2980af790 con 0x7fc29806fa60 2023-09-10T00:14:08.557 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.553+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc2980af790 con 0x7fc29806fa60 2023-09-10T00:14:08.578 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.573+0000 7fc2957fa640 1 -- 172.21.15.84:0/866594503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc2980af790 con 0x7fc29806fa60 2023-09-10T00:14:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 msgr2=0x7fc278067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 0x7fc278067fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2880af000 tx=0x7fc28801b0d0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 msgr2=0x7fc2981488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c450 tx=0x7fc28000c910 comp rx=0 tx=0).stop 2023-09-10T00:14:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 shutdown_connections 2023-09-10T00:14:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fc278065b20 0x7fc278067fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc298158230 0x7fc2980b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.582 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc29806fa60 0x7fc2981488e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 --2- 172.21.15.84:0/866594503 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc29806c280 0x7fc2980b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 >> 172.21.15.84:0/866594503 conn(0x7fc2980aec00 msgr2=0x7fc2980ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 shutdown_connections 2023-09-10T00:14:08.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.577+0000 7fc29e3ca640 1 -- 172.21.15.84:0/866594503 wait complete. 2023-09-10T00:14:08.598 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-10T00:14:08.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-10T00:14:08.720 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- 172.21.15.84:0/1905502432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06c280 msgr2=0x7f57ec06c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- 172.21.15.84:0/1905502432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06c280 0x7f57ec06c710 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f57e4009c80 tx=0x7f57e401cd10 comp rx=0 tx=0).stop 2023-09-10T00:14:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- 172.21.15.84:0/1905502432 shutdown_connections 2023-09-10T00:14:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- 172.21.15.84:0/1905502432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06c280 0x7f57ec06c710 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.721 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- 172.21.15.84:0/1905502432 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec158230 0x7f57ec0695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- 172.21.15.84:0/1905502432 >> 172.21.15.84:0/1905502432 conn(0x7f57ec0aec00 msgr2=0x7f57ec0cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- 172.21.15.84:0/1905502432 shutdown_connections 2023-09-10T00:14:08.722 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- 172.21.15.84:0/1905502432 wait complete. 2023-09-10T00:14:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 Processor -- start 2023-09-10T00:14:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- start start 2023-09-10T00:14:08.724 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 0x7f57ec14c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 0x7f57ec14edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec14bc70 con 0x7f57ec06fa60 2023-09-10T00:14:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec14b060 con 0x7f57ec158230 2023-09-10T00:14:08.725 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f4029640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec14b340 con 0x7f57ec06c280 2023-09-10T00:14:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46578/0 (socket says 172.21.15.84:46578) 2023-09-10T00:14:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 -- 172.21.15.84:0/3261439628 learned_addr learned my addr 172.21.15.84:0/3261439628 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f25c6640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 0x7f57ec14edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f1dc5640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 0x7f57ec14c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 -- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 msgr2=0x7f57ec14c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 0x7f57ec14c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 -- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 msgr2=0x7f57ec14edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 0x7f57ec14edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:08.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 -- 172.21.15.84:0/3261439628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40098e0 con 0x7f57ec06fa60 2023-09-10T00:14:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f25c6640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 0x7f57ec14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f1dc5640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 0x7f57ec14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57f15c4640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c940 tx=0x7f57dc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc004220 con 0x7f57ec06fa60 2023-09-10T00:14:08.728 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f57dc004470 con 0x7f57ec06fa60 2023-09-10T00:14:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.717+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc007c10 con 0x7f57ec06fa60 2023-09-10T00:14:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ec14b620 con 0x7f57ec06fa60 2023-09-10T00:14:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec14c640 con 0x7f57ec06fa60 2023-09-10T00:14:08.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec0713a0 con 0x7f57ec06fa60 2023-09-10T00:14:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f57dc003600 con 0x7f57ec06fa60 2023-09-10T00:14:08.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57e27fc640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 0x7f57d0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f57dc083980 con 0x7f57ec06fa60 2023-09-10T00:14:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57f1dc5640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 0x7f57d0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.721+0000 7f57f1dc5640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 0x7f57d0067fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f57e80016e0 tx=0x7f57e8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:08.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.725+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f57dc051190 con 0x7f57ec06fa60 2023-09-10T00:14:08.907 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:08.901+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57ec073400 con 0x7f57ec06fa60 2023-09-10T00:14:09.485 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:14:09.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:14:09.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.584+0000 7f57e27fc640 1 -- 172.21.15.84:0/3261439628 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57dc01d020 con 0x7f57ec06fa60 2023-09-10T00:14:09.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 msgr2=0x7f57d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 0x7f57d0067fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f57e80016e0 tx=0x7f57e8009040 comp rx=0 tx=0).stop 2023-09-10T00:14:09.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 msgr2=0x7f57ec1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c940 tx=0x7f57dc00ce00 comp rx=0 tx=0).stop 2023-09-10T00:14:09.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 shutdown_connections 2023-09-10T00:14:09.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f57d0065b20 0x7f57d0067fe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57ec158230 0x7f57ec14edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57ec06fa60 0x7f57ec1424e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 --2- 172.21.15.84:0/3261439628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57ec06c280 0x7f57ec14c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 >> 172.21.15.84:0/3261439628 conn(0x7f57ec0aec00 msgr2=0x7f57ec1511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:09.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 shutdown_connections 2023-09-10T00:14:09.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.588+0000 7f57f4029640 1 -- 172.21.15.84:0/3261439628 wait complete. 2023-09-10T00:14:09.615 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-10T00:14:09.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:14:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/852169228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77300b1cd0 msgr2=0x7f773006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- 172.21.15.84:0/852169228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77300b1cd0 0x7f773006fad0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f77300c8ef0 tx=0x7f772801cd30 comp rx=0 tx=0).stop 2023-09-10T00:14:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/852169228 shutdown_connections 2023-09-10T00:14:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- 172.21.15.84:0/852169228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77300b1cd0 0x7f773006fad0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- 172.21.15.84:0/852169228 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300c0700 0x7f77300b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- 172.21.15.84:0/852169228 >> v2:172.21.15.100:3300/0 conn(0x7f7730158a90 0x7f77300c01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/852169228 >> 172.21.15.84:0/852169228 conn(0x7f77300cca70 msgr2=0x7f77300cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:09.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/852169228 shutdown_connections 2023-09-10T00:14:09.742 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/852169228 wait complete. 2023-09-10T00:14:09.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 Processor -- start 2023-09-10T00:14:09.745 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- start start 2023-09-10T00:14:09.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300b1cd0 0x7f77300c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:09.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 0x7f7730152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:09.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:09.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7730153380 con 0x7f7730158a90 2023-09-10T00:14:09.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7730152b90 con 0x7f77300c0700 2023-09-10T00:14:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77300ca3c0 con 0x7f77300b1cd0 2023-09-10T00:14:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46594/0 (socket says 172.21.15.84:46594) 2023-09-10T00:14:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 -- 172.21.15.84:0/3862024890 learned_addr learned my addr 172.21.15.84:0/3862024890 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:09.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772ffff640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300b1cd0 0x7f77300c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772f7fe640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 0x7f7730152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 -- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300b1cd0 msgr2=0x7f77300c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300b1cd0 0x7f77300c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 -- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 msgr2=0x7f7730152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 0x7f7730152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 -- 172.21.15.84:0/3862024890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280098e0 con 0x7f7730158a90 2023-09-10T00:14:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772f7fe640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 0x7f7730152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f7734beb640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f772801b3e0 tx=0x7f77280a5dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280adab0 con 0x7f7730158a90 2023-09-10T00:14:09.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77280add00 con 0x7f7730158a90 2023-09-10T00:14:09.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7730152dc0 con 0x7f7730158a90 2023-09-10T00:14:09.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77280041c0 con 0x7f7730158a90 2023-09-10T00:14:09.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.736+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77300ca660 con 0x7f7730158a90 2023-09-10T00:14:09.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77300ca220 con 0x7f7730158a90 2023-09-10T00:14:09.750 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f77280b4040 con 0x7f7730158a90 2023-09-10T00:14:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f772cff9640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 0x7f7710067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f772811e5d0 con 0x7f7730158a90 2023-09-10T00:14:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f772ffff640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 0x7f7710067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:09.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.740+0000 7f772ffff640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 0x7f7710067fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720008040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:09.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.744+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f77300ca220 con 0x7f7730158a90 2023-09-10T00:14:09.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.924+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77300ca220 con 0x7f7730158a90 2023-09-10T00:14:09.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.924+0000 7f772cff9640 1 -- 172.21.15.84:0/3862024890 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f77300ca220 con 0x7f7730158a90 2023-09-10T00:14:09.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:09.930 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T00:14:09.930 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T00:14:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 msgr2=0x7f7710067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 0x7f7710067fe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7720006fd0 tx=0x7f7720008040 comp rx=0 tx=0).stop 2023-09-10T00:14:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 msgr2=0x7f773014dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:09.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f772801b3e0 tx=0x7f77280a5dc0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 shutdown_connections 2023-09-10T00:14:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7710065b20 0x7f7710067fe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7730158a90 0x7f773014dc90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77300c0700 0x7f7730152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 --2- 172.21.15.84:0/3862024890 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77300b1cd0 0x7f77300c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 >> 172.21.15.84:0/3862024890 conn(0x7f77300cca70 msgr2=0x7f77300cce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 shutdown_connections 2023-09-10T00:14:09.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:09.928+0000 7f773664e640 1 -- 172.21.15.84:0/3862024890 wait complete. 2023-09-10T00:14:09.948 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T00:14:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 -- 172.21.15.84:0/2902020088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400c0700 msgr2=0x7f7e400b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 --2- 172.21.15.84:0/2902020088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400c0700 0x7f7e400b1790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7e400c8ef0 tx=0x7f7e3001c830 comp rx=0 tx=0).stop 2023-09-10T00:14:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 -- 172.21.15.84:0/2902020088 shutdown_connections 2023-09-10T00:14:10.072 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 --2- 172.21.15.84:0/2902020088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400c0700 0x7f7e400b1790 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 --2- 172.21.15.84:0/2902020088 >> v2:172.21.15.100:3300/0 conn(0x7f7e40158a90 0x7f7e400c01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 -- 172.21.15.84:0/2902020088 >> 172.21.15.84:0/2902020088 conn(0x7f7e400cca70 msgr2=0x7f7e400cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 -- 172.21.15.84:0/2902020088 shutdown_connections 2023-09-10T00:14:10.073 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.064+0000 7f7e44904640 1 -- 172.21.15.84:0/2902020088 wait complete. 2023-09-10T00:14:10.075 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 Processor -- start 2023-09-10T00:14:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- start start 2023-09-10T00:14:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400c0700 0x7f7e4015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e40158a90 0x7f7e4015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.076 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40147250 con 0x7f7e400b1cd0 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4015b880 con 0x7f7e400c0700 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401f43a0 con 0x7f7e40158a90 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46834/0 (socket says 172.21.15.84:46834) 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 -- 172.21.15.84:0/2883818667 learned_addr learned my addr 172.21.15.84:0/2883818667 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:10.077 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3dd9b640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400c0700 0x7f7e4015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3ed9d640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e40158a90 0x7f7e4015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 -- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e40158a90 msgr2=0x7f7e4015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e40158a90 0x7f7e4015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 -- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400c0700 msgr2=0x7f7e4015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.078 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400c0700 0x7f7e4015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 -- 172.21.15.84:0/2883818667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009560 con 0x7f7e400b1cd0 2023-09-10T00:14:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e3e59c640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c970 tx=0x7f7e3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34004220 con 0x7f7e400b1cd0 2023-09-10T00:14:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e34004470 con 0x7f7e400b1cd0 2023-09-10T00:14:10.079 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e40162040 con 0x7f7e400b1cd0 2023-09-10T00:14:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34007bf0 con 0x7f7e400b1cd0 2023-09-10T00:14:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e40146c00 con 0x7f7e400b1cd0 2023-09-10T00:14:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.068+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400712c0 con 0x7f7e400b1cd0 2023-09-10T00:14:10.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.072+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7e34007d50 con 0x7f7e400b1cd0 2023-09-10T00:14:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.072+0000 7f7e2effd640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 0x7f7e20067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.072+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7e340835e0 con 0x7f7e400b1cd0 2023-09-10T00:14:10.081 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.072+0000 7f7e3dd9b640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 0x7f7e20067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.072+0000 7f7e3dd9b640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 0x7f7e20067fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e300af000 tx=0x7f7e3001b070 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.076+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7e34050df0 con 0x7f7e400b1cd0 2023-09-10T00:14:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.228+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e40073400 con 0x7f7e400b1cd0 2023-09-10T00:14:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e2effd640 1 -- 172.21.15.84:0/2883818667 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f7e34054410 con 0x7f7e400b1cd0 2023-09-10T00:14:10.237 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:10.237 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":40,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:08.531621+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T00:14:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 msgr2=0x7f7e20067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 0x7f7e20067fe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e300af000 tx=0x7f7e3001b070 comp rx=0 tx=0).stop 2023-09-10T00:14:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 msgr2=0x7f7e401f3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400c970 tx=0x7f7e3400ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 shutdown_connections 2023-09-10T00:14:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e20065b20 0x7f7e20067fe0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e40158a90 0x7f7e4015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e400c0700 0x7f7e4015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 --2- 172.21.15.84:0/2883818667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e400b1cd0 0x7f7e401f3e60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 >> 172.21.15.84:0/2883818667 conn(0x7f7e400cca70 msgr2=0x7f7e40157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 shutdown_connections 2023-09-10T00:14:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.232+0000 7f7e44904640 1 -- 172.21.15.84:0/2883818667 wait complete. 2023-09-10T00:14:10.256 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-10T00:14:10.256 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:14:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/1174265160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f340cbff0 msgr2=0x7f6f340d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/1174265160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f340cbff0 0x7f6f340d04d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009c80 tx=0x7f6f2c01cbf0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/1174265160 shutdown_connections 2023-09-10T00:14:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/1174265160 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f340cbff0 0x7f6f340d04d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/1174265160 >> 172.21.15.84:0/1174265160 conn(0x7f6f340cd590 msgr2=0x7f6f340cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/1174265160 shutdown_connections 2023-09-10T00:14:10.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.380+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/1174265160 wait complete. 2023-09-10T00:14:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 Processor -- start 2023-09-10T00:14:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- start start 2023-09-10T00:14:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f340b6760 0x7f6f3415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f340cbff0 0x7f6f340c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.391 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c3070 con 0x7f6f3415acf0 2023-09-10T00:14:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415b9c0 con 0x7f6f340b6760 2023-09-10T00:14:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34152410 con 0x7f6f340cbff0 2023-09-10T00:14:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.392 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46842/0 (socket says 172.21.15.84:46842) 2023-09-10T00:14:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 -- 172.21.15.84:0/2261282243 learned_addr learned my addr 172.21.15.84:0/2261282243 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 -- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f340cbff0 msgr2=0x7f6f340c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f340cbff0 0x7f6f340c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 -- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f340b6760 msgr2=0x7f6f3415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.393 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f340b6760 0x7f6f3415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 -- 172.21.15.84:0/2261282243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0098e0 con 0x7f6f3415acf0 2023-09-10T00:14:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f38a62640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c01a820 tx=0x7f6f2c0a5ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0044b0 con 0x7f6f3415acf0 2023-09-10T00:14:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f2c004700 con 0x7f6f3415acf0 2023-09-10T00:14:10.394 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340c2a20 con 0x7f6f3415acf0 2023-09-10T00:14:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0ad810 con 0x7f6f3415acf0 2023-09-10T00:14:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f340b5910 con 0x7f6f3415acf0 2023-09-10T00:14:10.395 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3406c610 con 0x7f6f3415acf0 2023-09-10T00:14:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.384+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f6f2c0b4040 con 0x7f6f3415acf0 2023-09-10T00:14:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.388+0000 7f6f30ff9640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 0x7f6f20067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.388+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6f2c11e580 con 0x7f6f3415acf0 2023-09-10T00:14:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.388+0000 7f6f33fff640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 0x7f6f20067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.388+0000 7f6f33fff640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 0x7f6f20067fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f28000f70 tx=0x7f6f280079c0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.392+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f6f2c0ebd00 con 0x7f6f3415acf0 2023-09-10T00:14:10.552 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.548+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f340c2ed0 con 0x7f6f20065b20 2023-09-10T00:14:10.566 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.560+0000 7f6f30ff9640 1 -- 172.21.15.84:0/2261282243 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288208 (secure 0 0 0) 0x7f6f28005080 con 0x7f6f20065b20 2023-09-10T00:14:10.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:10.571 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:14:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 msgr2=0x7f6f20067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.572 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 0x7f6f20067fe0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6f28000f70 tx=0x7f6f280079c0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 msgr2=0x7f6f3414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c01a820 tx=0x7f6f2c0a5ca0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 shutdown_connections 2023-09-10T00:14:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f6f20065b20 0x7f6f20067fe0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.573 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f3415acf0 0x7f6f3414d0b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6f340cbff0 0x7f6f340c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 --2- 172.21.15.84:0/2261282243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f340b6760 0x7f6f3415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 >> 172.21.15.84:0/2261282243 conn(0x7f6f340cd590 msgr2=0x7f6f340b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.574 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 shutdown_connections 2023-09-10T00:14:10.575 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.564+0000 7f6f3a4c5640 1 -- 172.21.15.84:0/2261282243 wait complete. 2023-09-10T00:14:10.589 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-09-10T00:14:09.838353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220808,"kb_used_data":4620,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753912,"statfs":{"total":773094113280,"available":772868005888,"internally_reserved":0,"allocated":4730880,"data_stored":2692041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.310238"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588835+0000","last_change":"2023-09-10T00:14:07.575565+0000","last_active":"2023-09-10T00:14:07.588835+0000","last_peered":"2023-09-10T00:14:07.588835+0000","last_clean":"2023-09-10T00:14:07.588835+0000","last_became_active":"2023-09-10T00:14:07.574813+0000","last_became_peered":"2023-09-10T00:14:07.574813+0000","last_unstale":"2023-09-10T00:14:07.588835+0000","last_undegraded":"2023-09-10T00:14:07.588835+0000","last_fullsized":"2023-09-10T00:14:07.588835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584625+0000","last_change":"2023-09-10T00:14:07.566067+0000","last_active":"2023-09-10T00:14:07.584625+0000","last_peered":"2023-09-10T00:14:07.584625+0000","last_clean":"2023-09-10T00:14:07.584625+0000","last_became_active":"2023-09-10T00:14:07.565297+0000","last_became_peered":"2023-09-10T00:14:07.565297+0000","last_unstale":"2023-09-10T00:14:07.584625+0000","last_undegraded":"2023-09-10T00:14:07.584625+0000","last_fullsized":"2023-09-10T00:14:07.584625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600341+0000","last_change":"2023-09-10T00:14:07.595650+0000","last_active":"2023-09-10T00:14:07.600341+0000","last_peered":"2023-09-10T00:14:07.600341+0000","last_clean":"2023-09-10T00:14:07.600341+0000","last_became_active":"2023-09-10T00:14:07.594871+0000","last_became_peered":"2023-09-10T00:14:07.594871+0000","last_unstale":"2023-09-10T00:14:07.600341+0000","last_undegraded":"2023-09-10T00:14:07.600341+0000","last_fullsized":"2023-09-10T00:14:07.600341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585344+0000","last_change":"2023-09-10T00:14:07.581124+0000","last_active":"2023-09-10T00:14:07.585344+0000","last_peered":"2023-09-10T00:14:07.585344+0000","last_clean":"2023-09-10T00:14:07.585344+0000","last_became_active":"2023-09-10T00:14:07.580755+0000","last_became_peered":"2023-09-10T00:14:07.580755+0000","last_unstale":"2023-09-10T00:14:07.585344+0000","last_undegraded":"2023-09-10T00:14:07.585344+0000","last_fullsized":"2023-09-10T00:14:07.585344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:49:36.855888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585391+0000","last_change":"2023-09-10T00:14:07.582029+0000","last_active":"2023-09-10T00:14:07.585391+0000","last_peered":"2023-09-10T00:14:07.585391+0000","last_clean":"2023-09-10T00:14:07.585391+0000","last_became_active":"2023-09-10T00:14:07.581489+0000","last_became_peered":"2023-09-10T00:14:07.581489+0000","last_unstale":"2023-09-10T00:14:07.585391+0000","last_undegraded":"2023-09-10T00:14:07.585391+0000","last_fullsized":"2023-09-10T00:14:07.585391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:16:15.465397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.586532+0000","last_change":"2023-09-10T00:14:07.576854+0000","last_active":"2023-09-10T00:14:07.586532+0000","last_peered":"2023-09-10T00:14:07.586532+0000","last_clean":"2023-09-10T00:14:07.586532+0000","last_became_active":"2023-09-10T00:14:07.576010+0000","last_became_peered":"2023-09-10T00:14:07.576010+0000","last_unstale":"2023-09-10T00:14:07.586532+0000","last_undegraded":"2023-09-10T00:14:07.586532+0000","last_fullsized":"2023-09-10T00:14:07.586532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:29:32.046406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737490+0000","last_change":"2023-09-10T00:14:07.597943+0000","last_active":"2023-09-10T00:14:08.737490+0000","last_peered":"2023-09-10T00:14:08.737490+0000","last_clean":"2023-09-10T00:14:08.737490+0000","last_became_active":"2023-09-10T00:14:07.596212+0000","last_became_peered":"2023-09-10T00:14:07.596212+0000","last_unstale":"2023-09-10T00:14:08.737490+0000","last_undegraded":"2023-09-10T00:14:08.737490+0000","last_fullsized":"2023-09-10T00:14:08.737490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.597468+0000","last_change":"2023-09-10T00:14:07.589704+0000","last_active":"2023-09-10T00:14:07.597468+0000","last_peered":"2023-09-10T00:14:07.597468+0000","last_clean":"2023-09-10T00:14:07.597468+0000","last_became_active":"2023-09-10T00:14:07.589405+0000","last_became_peered":"2023-09-10T00:14:07.589405+0000","last_unstale":"2023-09-10T00:14:07.597468+0000","last_undegraded":"2023-09-10T00:14:07.597468+0000","last_fullsized":"2023-09-10T00:14:07.597468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:09:15.026087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.603178+0000","last_change":"2023-09-10T00:14:07.596194+0000","last_active":"2023-09-10T00:14:07.603178+0000","last_peered":"2023-09-10T00:14:07.603178+0000","last_clean":"2023-09-10T00:14:07.603178+0000","last_became_active":"2023-09-10T00:14:07.595848+0000","last_became_peered":"2023-09-10T00:14:07.595848+0000","last_unstale":"2023-09-10T00:14:07.603178+0000","last_undegraded":"2023-09-10T00:14:07.603178+0000","last_fullsized":"2023-09-10T00:14:07.603178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738032+0000","last_change":"2023-09-10T00:14:07.591437+0000","last_active":"2023-09-10T00:14:08.738032+0000","last_peered":"2023-09-10T00:14:08.738032+0000","last_clean":"2023-09-10T00:14:08.738032+0000","last_became_active":"2023-09-10T00:14:07.589943+0000","last_became_peered":"2023-09-10T00:14:07.589943+0000","last_unstale":"2023-09-10T00:14:08.738032+0000","last_undegraded":"2023-09-10T00:14:08.738032+0000","last_fullsized":"2023-09-10T00:14:08.738032+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:31:10.853712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738278+0000","last_change":"2023-09-10T00:14:07.605920+0000","last_active":"2023-09-10T00:14:08.738278+0000","last_peered":"2023-09-10T00:14:08.738278+0000","last_clean":"2023-09-10T00:14:08.738278+0000","last_became_active":"2023-09-10T00:14:07.605377+0000","last_became_peered":"2023-09-10T00:14:07.605377+0000","last_unstale":"2023-09-10T00:14:08.738278+0000","last_undegraded":"2023-09-10T00:14:08.738278+0000","last_fullsized":"2023-09-10T00:14:08.738278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:32:07.782174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579798+0000","last_change":"2023-09-10T00:14:07.568511+0000","last_active":"2023-09-10T00:14:07.579798+0000","last_peered":"2023-09-10T00:14:07.579798+0000","last_clean":"2023-09-10T00:14:07.579798+0000","last_became_active":"2023-09-10T00:14:07.565850+0000","last_became_peered":"2023-09-10T00:14:07.565850+0000","last_unstale":"2023-09-10T00:14:07.579798+0000","last_undegraded":"2023-09-10T00:14:07.579798+0000","last_fullsized":"2023-09-10T00:14:07.579798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737649+0000","last_change":"2023-09-10T00:14:07.603534+0000","last_active":"2023-09-10T00:14:08.737649+0000","last_peered":"2023-09-10T00:14:08.737649+0000","last_clean":"2023-09-10T00:14:08.737649+0000","last_became_active":"2023-09-10T00:14:07.602956+0000","last_became_peered":"2023-09-10T00:14:07.602956+0000","last_unstale":"2023-09-10T00:14:08.737649+0000","last_undegraded":"2023-09-10T00:14:08.737649+0000","last_fullsized":"2023-09-10T00:14:08.737649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542344+0000","last_change":"2023-09-10T00:14:07.596747+0000","last_active":"2023-09-10T00:14:08.542344+0000","last_peered":"2023-09-10T00:14:08.542344+0000","last_clean":"2023-09-10T00:14:08.542344+0000","last_became_active":"2023-09-10T00:14:07.595383+0000","last_became_peered":"2023-09-10T00:14:07.595383+0000","last_unstale":"2023-09-10T00:14:08.542344+0000","last_undegraded":"2023-09-10T00:14:08.542344+0000","last_fullsized":"2023-09-10T00:14:08.542344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:27.215626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737629+0000","last_change":"2023-09-10T00:14:07.586072+0000","last_active":"2023-09-10T00:14:08.737629+0000","last_peered":"2023-09-10T00:14:08.737629+0000","last_clean":"2023-09-10T00:14:08.737629+0000","last_became_active":"2023-09-10T00:14:07.585521+0000","last_became_peered":"2023-09-10T00:14:07.585521+0000","last_unstale":"2023-09-10T00:14:08.737629+0000","last_undegraded":"2023-09-10T00:14:08.737629+0000","last_fullsized":"2023-09-10T00:14:08.737629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.611922+0000","last_change":"2023-09-10T00:14:07.608406+0000","last_active":"2023-09-10T00:14:07.611922+0000","last_peered":"2023-09-10T00:14:07.611922+0000","last_clean":"2023-09-10T00:14:07.611922+0000","last_became_active":"2023-09-10T00:14:07.607831+0000","last_became_peered":"2023-09-10T00:14:07.607831+0000","last_unstale":"2023-09-10T00:14:07.611922+0000","last_undegraded":"2023-09-10T00:14:07.611922+0000","last_fullsized":"2023-09-10T00:14:07.611922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:24:48.594760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588389+0000","last_change":"2023-09-10T00:14:07.579752+0000","last_active":"2023-09-10T00:14:07.588389+0000","last_peered":"2023-09-10T00:14:07.588389+0000","last_clean":"2023-09-10T00:14:07.588389+0000","last_became_active":"2023-09-10T00:14:07.579078+0000","last_became_peered":"2023-09-10T00:14:07.579078+0000","last_unstale":"2023-09-10T00:14:07.588389+0000","last_undegraded":"2023-09-10T00:14:07.588389+0000","last_fullsized":"2023-09-10T00:14:07.588389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:11:43.437713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543523+0000","last_change":"2023-09-10T00:14:07.595635+0000","last_active":"2023-09-10T00:14:08.543523+0000","last_peered":"2023-09-10T00:14:08.543523+0000","last_clean":"2023-09-10T00:14:08.543523+0000","last_became_active":"2023-09-10T00:14:07.595050+0000","last_became_peered":"2023-09-10T00:14:07.595050+0000","last_unstale":"2023-09-10T00:14:08.543523+0000","last_undegraded":"2023-09-10T00:14:08.543523+0000","last_fullsized":"2023-09-10T00:14:08.543523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.583447+0000","last_change":"2023-09-10T00:14:07.577211+0000","last_active":"2023-09-10T00:14:07.583447+0000","last_peered":"2023-09-10T00:14:07.583447+0000","last_clean":"2023-09-10T00:14:07.583447+0000","last_became_active":"2023-09-10T00:14:07.576560+0000","last_became_peered":"2023-09-10T00:14:07.576560+0000","last_unstale":"2023-09-10T00:14:07.583447+0000","last_undegraded":"2023-09-10T00:14:07.583447+0000","last_fullsized":"2023-09-10T00:14:07.583447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:35:50.244578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543046+0000","last_change":"2023-09-10T00:14:07.580026+0000","last_active":"2023-09-10T00:14:08.543046+0000","last_peered":"2023-09-10T00:14:08.543046+0000","last_clean":"2023-09-10T00:14:08.543046+0000","last_became_active":"2023-09-10T00:14:07.579352+0000","last_became_peered":"2023-09-10T00:14:07.579352+0000","last_unstale":"2023-09-10T00:14:08.543046+0000","last_undegraded":"2023-09-10T00:14:08.543046+0000","last_fullsized":"2023-09-10T00:14:08.543046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:53.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737962+0000","last_change":"2023-09-10T00:14:07.592145+0000","last_active":"2023-09-10T00:14:08.737962+0000","last_peered":"2023-09-10T00:14:08.737962+0000","last_clean":"2023-09-10T00:14:08.737962+0000","last_became_active":"2023-09-10T00:14:07.589524+0000","last_became_peered":"2023-09-10T00:14:07.589524+0000","last_unstale":"2023-09-10T00:14:08.737962+0000","last_undegraded":"2023-09-10T00:14:08.737962+0000","last_fullsized":"2023-09-10T00:14:08.737962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543206+0000","last_change":"2023-09-10T00:14:07.595929+0000","last_active":"2023-09-10T00:14:08.543206+0000","last_peered":"2023-09-10T00:14:08.543206+0000","last_clean":"2023-09-10T00:14:08.543206+0000","last_became_active":"2023-09-10T00:14:07.593800+0000","last_became_peered":"2023-09-10T00:14:07.593800+0000","last_unstale":"2023-09-10T00:14:08.543206+0000","last_undegraded":"2023-09-10T00:14:08.543206+0000","last_fullsized":"2023-09-10T00:14:08.543206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.573884+0000","last_change":"2023-09-10T00:14:07.565142+0000","last_active":"2023-09-10T00:14:07.573884+0000","last_peered":"2023-09-10T00:14:07.573884+0000","last_clean":"2023-09-10T00:14:07.573884+0000","last_became_active":"2023-09-10T00:14:07.563439+0000","last_became_peered":"2023-09-10T00:14:07.563439+0000","last_unstale":"2023-09-10T00:14:07.573884+0000","last_undegraded":"2023-09-10T00:14:07.573884+0000","last_fullsized":"2023-09-10T00:14:07.573884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:51:59.365787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.556655+0000","last_change":"2023-09-10T00:14:07.550777+0000","last_active":"2023-09-10T00:14:07.556655+0000","last_peered":"2023-09-10T00:14:07.556655+0000","last_clean":"2023-09-10T00:14:07.556655+0000","last_became_active":"2023-09-10T00:14:07.550038+0000","last_became_peered":"2023-09-10T00:14:07.550038+0000","last_unstale":"2023-09-10T00:14:07.556655+0000","last_undegraded":"2023-09-10T00:14:07.556655+0000","last_fullsized":"2023-09-10T00:14:07.556655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:12:29.119042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543666+0000","last_change":"2023-09-10T00:14:07.572560+0000","last_active":"2023-09-10T00:14:08.543666+0000","last_peered":"2023-09-10T00:14:08.543666+0000","last_clean":"2023-09-10T00:14:08.543666+0000","last_became_active":"2023-09-10T00:14:07.571769+0000","last_became_peered":"2023-09-10T00:14:07.571769+0000","last_unstale":"2023-09-10T00:14:08.543666+0000","last_undegraded":"2023-09-10T00:14:08.543666+0000","last_fullsized":"2023-09-10T00:14:08.543666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:58:32.798976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.599279+0000","last_change":"2023-09-10T00:14:07.590394+0000","last_active":"2023-09-10T00:14:07.599279+0000","last_peered":"2023-09-10T00:14:07.599279+0000","last_clean":"2023-09-10T00:14:07.599279+0000","last_became_active":"2023-09-10T00:14:07.590100+0000","last_became_peered":"2023-09-10T00:14:07.590100+0000","last_unstale":"2023-09-10T00:14:07.599279+0000","last_undegraded":"2023-09-10T00:14:07.599279+0000","last_fullsized":"2023-09-10T00:14:07.599279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:16.125153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543552+0000","last_change":"2023-09-10T00:14:07.558651+0000","last_active":"2023-09-10T00:14:08.543552+0000","last_peered":"2023-09-10T00:14:08.543552+0000","last_clean":"2023-09-10T00:14:08.543552+0000","last_became_active":"2023-09-10T00:14:07.557894+0000","last_became_peered":"2023-09-10T00:14:07.557894+0000","last_unstale":"2023-09-10T00:14:08.543552+0000","last_undegraded":"2023-09-10T00:14:08.543552+0000","last_fullsized":"2023-09-10T00:14:08.543552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:29:17.726708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738147+0000","last_change":"2023-09-10T00:14:07.576020+0000","last_active":"2023-09-10T00:14:08.738147+0000","last_peered":"2023-09-10T00:14:08.738147+0000","last_clean":"2023-09-10T00:14:08.738147+0000","last_became_active":"2023-09-10T00:14:07.575536+0000","last_became_peered":"2023-09-10T00:14:07.575536+0000","last_unstale":"2023-09-10T00:14:08.738147+0000","last_undegraded":"2023-09-10T00:14:08.738147+0000","last_fullsized":"2023-09-10T00:14:08.738147+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:28.746506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542893+0000","last_change":"2023-09-10T00:14:07.569255+0000","last_active":"2023-09-10T00:14:08.542893+0000","last_peered":"2023-09-10T00:14:08.542893+0000","last_clean":"2023-09-10T00:14:08.542893+0000","last_became_active":"2023-09-10T00:14:07.568457+0000","last_became_peered":"2023-09-10T00:14:07.568457+0000","last_unstale":"2023-09-10T00:14:08.542893+0000","last_undegraded":"2023-09-10T00:14:08.542893+0000","last_fullsized":"2023-09-10T00:14:08.542893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542860+0000","last_change":"2023-09-10T00:14:07.567675+0000","last_active":"2023-09-10T00:14:08.542860+0000","last_peered":"2023-09-10T00:14:08.542860+0000","last_clean":"2023-09-10T00:14:08.542860+0000","last_became_active":"2023-09-10T00:14:07.566770+0000","last_became_peered":"2023-09-10T00:14:07.566770+0000","last_unstale":"2023-09-10T00:14:08.542860+0000","last_undegraded":"2023-09-10T00:14:08.542860+0000","last_fullsized":"2023-09-10T00:14:08.542860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.573987+0000","last_change":"2023-09-10T00:14:07.565606+0000","last_active":"2023-09-10T00:14:07.573987+0000","last_peered":"2023-09-10T00:14:07.573987+0000","last_clean":"2023-09-10T00:14:07.573987+0000","last_became_active":"2023-09-10T00:14:07.564405+0000","last_became_peered":"2023-09-10T00:14:07.564405+0000","last_unstale":"2023-09-10T00:14:07.573987+0000","last_undegraded":"2023-09-10T00:14:07.573987+0000","last_fullsized":"2023-09-10T00:14:07.573987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:29:04.024829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.566038+0000","last_change":"2023-09-10T00:14:07.561803+0000","last_active":"2023-09-10T00:14:07.566038+0000","last_peered":"2023-09-10T00:14:07.566038+0000","last_clean":"2023-09-10T00:14:07.566038+0000","last_became_active":"2023-09-10T00:14:07.560525+0000","last_became_peered":"2023-09-10T00:14:07.560525+0000","last_unstale":"2023-09-10T00:14:07.566038+0000","last_undegraded":"2023-09-10T00:14:07.566038+0000","last_fullsized":"2023-09-10T00:14:07.566038+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:12:41.058769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.613297+0000","last_change":"2023-09-10T00:14:07.609677+0000","last_active":"2023-09-10T00:14:07.613297+0000","last_peered":"2023-09-10T00:14:07.613297+0000","last_clean":"2023-09-10T00:14:07.613297+0000","last_became_active":"2023-09-10T00:14:07.609110+0000","last_became_peered":"2023-09-10T00:14:07.609110+0000","last_unstale":"2023-09-10T00:14:07.613297+0000","last_undegraded":"2023-09-10T00:14:07.613297+0000","last_fullsized":"2023-09-10T00:14:07.613297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543585+0000","last_change":"2023-09-10T00:14:06.560396+0000","last_active":"2023-09-10T00:14:08.543585+0000","last_peered":"2023-09-10T00:14:08.543585+0000","last_clean":"2023-09-10T00:14:08.543585+0000","last_became_active":"2023-09-10T00:14:06.559669+0000","last_became_peered":"2023-09-10T00:14:06.559669+0000","last_unstale":"2023-09-10T00:14:08.543585+0000","last_undegraded":"2023-09-10T00:14:08.543585+0000","last_fullsized":"2023-09-10T00:14:08.543585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:11:42.433273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.608419+0000","last_change":"2023-09-10T00:14:07.605265+0000","last_active":"2023-09-10T00:14:07.608419+0000","last_peered":"2023-09-10T00:14:07.608419+0000","last_clean":"2023-09-10T00:14:07.608419+0000","last_became_active":"2023-09-10T00:14:07.604895+0000","last_became_peered":"2023-09-10T00:14:07.604895+0000","last_unstale":"2023-09-10T00:14:07.608419+0000","last_undegraded":"2023-09-10T00:14:07.608419+0000","last_fullsized":"2023-09-10T00:14:07.608419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:10.792491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600434+0000","last_change":"2023-09-10T00:14:06.575379+0000","last_active":"2023-09-10T00:14:07.600434+0000","last_peered":"2023-09-10T00:14:07.600434+0000","last_clean":"2023-09-10T00:14:07.600434+0000","last_became_active":"2023-09-10T00:14:06.575117+0000","last_became_peered":"2023-09-10T00:14:06.575117+0000","last_unstale":"2023-09-10T00:14:07.600434+0000","last_undegraded":"2023-09-10T00:14:07.600434+0000","last_fullsized":"2023-09-10T00:14:07.600434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543912+0000","last_change":"2023-09-10T00:14:07.583110+0000","last_active":"2023-09-10T00:14:08.543912+0000","last_peered":"2023-09-10T00:14:08.543912+0000","last_clean":"2023-09-10T00:14:08.543912+0000","last_became_active":"2023-09-10T00:14:07.582106+0000","last_became_peered":"2023-09-10T00:14:07.582106+0000","last_unstale":"2023-09-10T00:14:08.543912+0000","last_undegraded":"2023-09-10T00:14:08.543912+0000","last_fullsized":"2023-09-10T00:14:08.543912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.615388+0000","last_change":"2023-09-10T00:14:06.570865+0000","last_active":"2023-09-10T00:14:07.615388+0000","last_peered":"2023-09-10T00:14:07.615388+0000","last_clean":"2023-09-10T00:14:07.615388+0000","last_became_active":"2023-09-10T00:14:06.570406+0000","last_became_peered":"2023-09-10T00:14:06.570406+0000","last_unstale":"2023-09-10T00:14:07.615388+0000","last_undegraded":"2023-09-10T00:14:07.615388+0000","last_fullsized":"2023-09-10T00:14:07.615388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:49:21.149885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584639+0000","last_change":"2023-09-10T00:14:07.566297+0000","last_active":"2023-09-10T00:14:07.584639+0000","last_peered":"2023-09-10T00:14:07.584639+0000","last_clean":"2023-09-10T00:14:07.584639+0000","last_became_active":"2023-09-10T00:14:07.565520+0000","last_became_peered":"2023-09-10T00:14:07.565520+0000","last_unstale":"2023-09-10T00:14:07.584639+0000","last_undegraded":"2023-09-10T00:14:07.584639+0000","last_fullsized":"2023-09-10T00:14:07.584639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543031+0000","last_change":"2023-09-10T00:14:06.571173+0000","last_active":"2023-09-10T00:14:08.543031+0000","last_peered":"2023-09-10T00:14:08.543031+0000","last_clean":"2023-09-10T00:14:08.543031+0000","last_became_active":"2023-09-10T00:14:06.570275+0000","last_became_peered":"2023-09-10T00:14:06.570275+0000","last_unstale":"2023-09-10T00:14:08.543031+0000","last_undegraded":"2023-09-10T00:14:08.543031+0000","last_fullsized":"2023-09-10T00:14:08.543031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585533+0000","last_change":"2023-09-10T00:14:07.575221+0000","last_active":"2023-09-10T00:14:07.585533+0000","last_peered":"2023-09-10T00:14:07.585533+0000","last_clean":"2023-09-10T00:14:07.585533+0000","last_became_active":"2023-09-10T00:14:07.574190+0000","last_became_peered":"2023-09-10T00:14:07.574190+0000","last_unstale":"2023-09-10T00:14:07.585533+0000","last_undegraded":"2023-09-10T00:14:07.585533+0000","last_fullsized":"2023-09-10T00:14:07.585533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:45.756460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737924+0000","last_change":"2023-09-10T00:14:06.586022+0000","last_active":"2023-09-10T00:14:08.737924+0000","last_peered":"2023-09-10T00:14:08.737924+0000","last_clean":"2023-09-10T00:14:08.737924+0000","last_became_active":"2023-09-10T00:14:06.585290+0000","last_became_peered":"2023-09-10T00:14:06.585290+0000","last_unstale":"2023-09-10T00:14:08.737924+0000","last_undegraded":"2023-09-10T00:14:08.737924+0000","last_fullsized":"2023-09-10T00:14:08.737924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:09:14.021648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737881+0000","last_change":"2023-09-10T00:14:07.592539+0000","last_active":"2023-09-10T00:14:08.737881+0000","last_peered":"2023-09-10T00:14:08.737881+0000","last_clean":"2023-09-10T00:14:08.737881+0000","last_became_active":"2023-09-10T00:14:07.587936+0000","last_became_peered":"2023-09-10T00:14:07.587936+0000","last_unstale":"2023-09-10T00:14:08.737881+0000","last_undegraded":"2023-09-10T00:14:08.737881+0000","last_fullsized":"2023-09-10T00:14:08.737881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:31.247225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.616116+0000","last_change":"2023-09-10T00:14:06.588868+0000","last_active":"2023-09-10T00:14:07.616116+0000","last_peered":"2023-09-10T00:14:07.616116+0000","last_clean":"2023-09-10T00:14:07.616116+0000","last_became_active":"2023-09-10T00:14:06.587976+0000","last_became_peered":"2023-09-10T00:14:06.587976+0000","last_unstale":"2023-09-10T00:14:07.616116+0000","last_undegraded":"2023-09-10T00:14:07.616116+0000","last_fullsized":"2023-09-10T00:14:07.616116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:45:45.720325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542832+0000","last_change":"2023-09-10T00:14:07.607061+0000","last_active":"2023-09-10T00:14:08.542832+0000","last_peered":"2023-09-10T00:14:08.542832+0000","last_clean":"2023-09-10T00:14:08.542832+0000","last_became_active":"2023-09-10T00:14:07.605696+0000","last_became_peered":"2023-09-10T00:14:07.605696+0000","last_unstale":"2023-09-10T00:14:08.542832+0000","last_undegraded":"2023-09-10T00:14:08.542832+0000","last_fullsized":"2023-09-10T00:14:08.542832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.553942+0000","last_change":"2023-09-10T00:14:06.585233+0000","last_active":"2023-09-10T00:14:07.553942+0000","last_peered":"2023-09-10T00:14:07.553942+0000","last_clean":"2023-09-10T00:14:07.553942+0000","last_became_active":"2023-09-10T00:14:06.584838+0000","last_became_peered":"2023-09-10T00:14:06.584838+0000","last_unstale":"2023-09-10T00:14:07.553942+0000","last_undegraded":"2023-09-10T00:14:07.553942+0000","last_fullsized":"2023-09-10T00:14:07.553942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:29:31.298081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588732+0000","last_change":"2023-09-10T00:14:07.574361+0000","last_active":"2023-09-10T00:14:07.588732+0000","last_peered":"2023-09-10T00:14:07.588732+0000","last_clean":"2023-09-10T00:14:07.588732+0000","last_became_active":"2023-09-10T00:14:07.572719+0000","last_became_peered":"2023-09-10T00:14:07.572719+0000","last_unstale":"2023-09-10T00:14:07.588732+0000","last_undegraded":"2023-09-10T00:14:07.588732+0000","last_fullsized":"2023-09-10T00:14:07.588732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.541981+0000","last_change":"2023-09-10T00:14:06.578783+0000","last_active":"2023-09-10T00:14:08.541981+0000","last_peered":"2023-09-10T00:14:08.541981+0000","last_clean":"2023-09-10T00:14:08.541981+0000","last_became_active":"2023-09-10T00:14:06.578044+0000","last_became_peered":"2023-09-10T00:14:06.578044+0000","last_unstale":"2023-09-10T00:14:08.541981+0000","last_undegraded":"2023-09-10T00:14:08.541981+0000","last_fullsized":"2023-09-10T00:14:08.541981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:31:55.011004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585226+0000","last_change":"2023-09-10T00:14:07.579506+0000","last_active":"2023-09-10T00:14:07.585226+0000","last_peered":"2023-09-10T00:14:07.585226+0000","last_clean":"2023-09-10T00:14:07.585226+0000","last_became_active":"2023-09-10T00:14:07.578842+0000","last_became_peered":"2023-09-10T00:14:07.578842+0000","last_unstale":"2023-09-10T00:14:07.585226+0000","last_undegraded":"2023-09-10T00:14:07.585226+0000","last_fullsized":"2023-09-10T00:14:07.585226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:59:45.684156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.560519+0000","last_change":"2023-09-10T00:14:06.558518+0000","last_active":"2023-09-10T00:14:07.560519+0000","last_peered":"2023-09-10T00:14:07.560519+0000","last_clean":"2023-09-10T00:14:07.560519+0000","last_became_active":"2023-09-10T00:14:06.558185+0000","last_became_peered":"2023-09-10T00:14:06.558185+0000","last_unstale":"2023-09-10T00:14:07.560519+0000","last_undegraded":"2023-09-10T00:14:07.560519+0000","last_fullsized":"2023-09-10T00:14:07.560519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:02:50.048470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570460+0000","last_change":"2023-09-10T00:14:07.559229+0000","last_active":"2023-09-10T00:14:07.570460+0000","last_peered":"2023-09-10T00:14:07.570460+0000","last_clean":"2023-09-10T00:14:07.570460+0000","last_became_active":"2023-09-10T00:14:07.557550+0000","last_became_peered":"2023-09-10T00:14:07.557550+0000","last_unstale":"2023-09-10T00:14:07.570460+0000","last_undegraded":"2023-09-10T00:14:07.570460+0000","last_fullsized":"2023-09-10T00:14:07.570460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:12:08.723496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738270+0000","last_change":"2023-09-10T00:14:06.589092+0000","last_active":"2023-09-10T00:14:08.738270+0000","last_peered":"2023-09-10T00:14:08.738270+0000","last_clean":"2023-09-10T00:14:08.738270+0000","last_became_active":"2023-09-10T00:14:06.587619+0000","last_became_peered":"2023-09-10T00:14:06.587619+0000","last_unstale":"2023-09-10T00:14:08.738270+0000","last_undegraded":"2023-09-10T00:14:08.738270+0000","last_fullsized":"2023-09-10T00:14:08.738270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:07:12.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579860+0000","last_change":"2023-09-10T00:14:07.570987+0000","last_active":"2023-09-10T00:14:07.579860+0000","last_peered":"2023-09-10T00:14:07.579860+0000","last_clean":"2023-09-10T00:14:07.579860+0000","last_became_active":"2023-09-10T00:14:07.568925+0000","last_became_peered":"2023-09-10T00:14:07.568925+0000","last_unstale":"2023-09-10T00:14:07.579860+0000","last_undegraded":"2023-09-10T00:14:07.579860+0000","last_fullsized":"2023-09-10T00:14:07.579860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:53.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738430+0000","last_change":"2023-09-10T00:14:06.586365+0000","last_active":"2023-09-10T00:14:08.738430+0000","last_peered":"2023-09-10T00:14:08.738430+0000","last_clean":"2023-09-10T00:14:08.738430+0000","last_became_active":"2023-09-10T00:14:06.585666+0000","last_became_peered":"2023-09-10T00:14:06.585666+0000","last_unstale":"2023-09-10T00:14:08.738430+0000","last_undegraded":"2023-09-10T00:14:08.738430+0000","last_fullsized":"2023-09-10T00:14:08.738430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543101+0000","last_change":"2023-09-10T00:14:07.579761+0000","last_active":"2023-09-10T00:14:08.543101+0000","last_peered":"2023-09-10T00:14:08.543101+0000","last_clean":"2023-09-10T00:14:08.543101+0000","last_became_active":"2023-09-10T00:14:07.579054+0000","last_became_peered":"2023-09-10T00:14:07.579054+0000","last_unstale":"2023-09-10T00:14:08.543101+0000","last_undegraded":"2023-09-10T00:14:08.543101+0000","last_fullsized":"2023-09-10T00:14:08.543101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.614861+0000","last_change":"2023-09-10T00:14:06.582400+0000","last_active":"2023-09-10T00:14:07.614861+0000","last_peered":"2023-09-10T00:14:07.614861+0000","last_clean":"2023-09-10T00:14:07.614861+0000","last_became_active":"2023-09-10T00:14:06.582008+0000","last_became_peered":"2023-09-10T00:14:06.582008+0000","last_unstale":"2023-09-10T00:14:07.614861+0000","last_undegraded":"2023-09-10T00:14:07.614861+0000","last_fullsized":"2023-09-10T00:14:07.614861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:31:09.849273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.591216+0000","last_change":"2023-09-10T00:14:07.588853+0000","last_active":"2023-09-10T00:14:07.591216+0000","last_peered":"2023-09-10T00:14:07.591216+0000","last_clean":"2023-09-10T00:14:07.591216+0000","last_became_active":"2023-09-10T00:14:07.588492+0000","last_became_peered":"2023-09-10T00:14:07.588492+0000","last_unstale":"2023-09-10T00:14:07.591216+0000","last_undegraded":"2023-09-10T00:14:07.591216+0000","last_fullsized":"2023-09-10T00:14:07.591216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:29:17.726708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.603412+0000","last_change":"2023-09-10T00:14:06.560688+0000","last_active":"2023-09-10T00:14:07.603412+0000","last_peered":"2023-09-10T00:14:07.603412+0000","last_clean":"2023-09-10T00:14:07.603412+0000","last_became_active":"2023-09-10T00:14:06.560398+0000","last_became_peered":"2023-09-10T00:14:06.560398+0000","last_unstale":"2023-09-10T00:14:07.603412+0000","last_undegraded":"2023-09-10T00:14:07.603412+0000","last_fullsized":"2023-09-10T00:14:07.603412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:32:06.777734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588709+0000","last_change":"2023-09-10T00:14:07.570864+0000","last_active":"2023-09-10T00:14:07.588709+0000","last_peered":"2023-09-10T00:14:07.588709+0000","last_clean":"2023-09-10T00:14:07.588709+0000","last_became_active":"2023-09-10T00:14:07.570110+0000","last_became_peered":"2023-09-10T00:14:07.570110+0000","last_unstale":"2023-09-10T00:14:07.588709+0000","last_undegraded":"2023-09-10T00:14:07.588709+0000","last_fullsized":"2023-09-10T00:14:07.588709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:46:50.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.555664+0000","last_change":"2023-09-10T00:14:06.584968+0000","last_active":"2023-09-10T00:14:07.555664+0000","last_peered":"2023-09-10T00:14:07.555664+0000","last_clean":"2023-09-10T00:14:07.555664+0000","last_became_active":"2023-09-10T00:14:06.584515+0000","last_became_peered":"2023-09-10T00:14:06.584515+0000","last_unstale":"2023-09-10T00:14:07.555664+0000","last_undegraded":"2023-09-10T00:14:07.555664+0000","last_fullsized":"2023-09-10T00:14:07.555664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:40:29.433658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570985+0000","last_change":"2023-09-10T00:14:07.564925+0000","last_active":"2023-09-10T00:14:07.570985+0000","last_peered":"2023-09-10T00:14:07.570985+0000","last_clean":"2023-09-10T00:14:07.570985+0000","last_became_active":"2023-09-10T00:14:07.564006+0000","last_became_peered":"2023-09-10T00:14:07.564006+0000","last_unstale":"2023-09-10T00:14:07.570985+0000","last_undegraded":"2023-09-10T00:14:07.570985+0000","last_fullsized":"2023-09-10T00:14:07.570985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542615+0000","last_change":"2023-09-10T00:14:06.573592+0000","last_active":"2023-09-10T00:14:08.542615+0000","last_peered":"2023-09-10T00:14:08.542615+0000","last_clean":"2023-09-10T00:14:08.542615+0000","last_became_active":"2023-09-10T00:14:06.572872+0000","last_became_peered":"2023-09-10T00:14:06.572872+0000","last_unstale":"2023-09-10T00:14:08.542615+0000","last_undegraded":"2023-09-10T00:14:08.542615+0000","last_fullsized":"2023-09-10T00:14:08.542615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:45:45.720325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588781+0000","last_change":"2023-09-10T00:14:07.574858+0000","last_active":"2023-09-10T00:14:07.588781+0000","last_peered":"2023-09-10T00:14:07.588781+0000","last_clean":"2023-09-10T00:14:07.588781+0000","last_became_active":"2023-09-10T00:14:07.573649+0000","last_became_peered":"2023-09-10T00:14:07.573649+0000","last_unstale":"2023-09-10T00:14:07.588781+0000","last_undegraded":"2023-09-10T00:14:07.588781+0000","last_fullsized":"2023-09-10T00:14:07.588781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.618751+0000","last_change":"2023-09-10T00:14:06.589824+0000","last_active":"2023-09-10T00:14:07.618751+0000","last_peered":"2023-09-10T00:14:07.618751+0000","last_clean":"2023-09-10T00:14:07.618751+0000","last_became_active":"2023-09-10T00:14:06.589158+0000","last_became_peered":"2023-09-10T00:14:06.589158+0000","last_unstale":"2023-09-10T00:14:07.618751+0000","last_undegraded":"2023-09-10T00:14:07.618751+0000","last_fullsized":"2023-09-10T00:14:07.618751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:50:26.142857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584690+0000","last_change":"2023-09-10T00:14:07.567537+0000","last_active":"2023-09-10T00:14:07.584690+0000","last_peered":"2023-09-10T00:14:07.584690+0000","last_clean":"2023-09-10T00:14:07.584690+0000","last_became_active":"2023-09-10T00:14:07.566724+0000","last_became_peered":"2023-09-10T00:14:07.566724+0000","last_unstale":"2023-09-10T00:14:07.584690+0000","last_undegraded":"2023-09-10T00:14:07.584690+0000","last_fullsized":"2023-09-10T00:14:07.584690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:27.215626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738494+0000","last_change":"2023-09-10T00:14:06.592753+0000","last_active":"2023-09-10T00:14:08.738494+0000","last_peered":"2023-09-10T00:14:08.738494+0000","last_clean":"2023-09-10T00:14:08.738494+0000","last_became_active":"2023-09-10T00:14:06.592180+0000","last_became_peered":"2023-09-10T00:14:06.592180+0000","last_unstale":"2023-09-10T00:14:08.738494+0000","last_undegraded":"2023-09-10T00:14:08.738494+0000","last_fullsized":"2023-09-10T00:14:08.738494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738393+0000","last_change":"2023-09-10T00:14:07.590731+0000","last_active":"2023-09-10T00:14:08.738393+0000","last_peered":"2023-09-10T00:14:08.738393+0000","last_clean":"2023-09-10T00:14:08.738393+0000","last_became_active":"2023-09-10T00:14:07.589855+0000","last_became_peered":"2023-09-10T00:14:07.589855+0000","last_unstale":"2023-09-10T00:14:08.738393+0000","last_undegraded":"2023-09-10T00:14:08.738393+0000","last_fullsized":"2023-09-10T00:14:08.738393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:05.658631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.544030+0000","last_change":"2023-09-10T00:14:06.590370+0000","last_active":"2023-09-10T00:14:08.544030+0000","last_peered":"2023-09-10T00:14:08.544030+0000","last_clean":"2023-09-10T00:14:08.544030+0000","last_became_active":"2023-09-10T00:14:06.589631+0000","last_became_peered":"2023-09-10T00:14:06.589631+0000","last_unstale":"2023-09-10T00:14:08.544030+0000","last_undegraded":"2023-09-10T00:14:08.544030+0000","last_fullsized":"2023-09-10T00:14:08.544030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:07:12.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543737+0000","last_change":"2023-09-10T00:14:07.582830+0000","last_active":"2023-09-10T00:14:08.543737+0000","last_peered":"2023-09-10T00:14:08.543737+0000","last_clean":"2023-09-10T00:14:08.543737+0000","last_became_active":"2023-09-10T00:14:07.582153+0000","last_became_peered":"2023-09-10T00:14:07.582153+0000","last_unstale":"2023-09-10T00:14:08.543737+0000","last_undegraded":"2023-09-10T00:14:08.543737+0000","last_fullsized":"2023-09-10T00:14:08.543737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:31.247225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.601285+0000","last_change":"2023-09-10T00:14:06.571749+0000","last_active":"2023-09-10T00:14:07.601285+0000","last_peered":"2023-09-10T00:14:07.601285+0000","last_clean":"2023-09-10T00:14:07.601285+0000","last_became_active":"2023-09-10T00:14:06.571373+0000","last_became_peered":"2023-09-10T00:14:06.571373+0000","last_unstale":"2023-09-10T00:14:07.601285+0000","last_undegraded":"2023-09-10T00:14:07.601285+0000","last_fullsized":"2023-09-10T00:14:07.601285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:05:36.655057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.575361+0000","last_change":"2023-09-10T00:14:07.568644+0000","last_active":"2023-09-10T00:14:07.575361+0000","last_peered":"2023-09-10T00:14:07.575361+0000","last_clean":"2023-09-10T00:14:07.575361+0000","last_became_active":"2023-09-10T00:14:07.567903+0000","last_became_peered":"2023-09-10T00:14:07.567903+0000","last_unstale":"2023-09-10T00:14:07.575361+0000","last_undegraded":"2023-09-10T00:14:07.575361+0000","last_fullsized":"2023-09-10T00:14:07.575361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:42:33.294831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.554267+0000","last_change":"2023-09-10T00:14:06.571387+0000","last_active":"2023-09-10T00:14:07.554267+0000","last_peered":"2023-09-10T00:14:07.554267+0000","last_clean":"2023-09-10T00:14:07.554267+0000","last_became_active":"2023-09-10T00:14:06.571045+0000","last_became_peered":"2023-09-10T00:14:06.571045+0000","last_unstale":"2023-09-10T00:14:07.554267+0000","last_undegraded":"2023-09-10T00:14:07.554267+0000","last_fullsized":"2023-09-10T00:14:07.554267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:12.930824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.567820+0000","last_change":"2023-09-10T00:14:07.558672+0000","last_active":"2023-09-10T00:14:07.567820+0000","last_peered":"2023-09-10T00:14:07.567820+0000","last_clean":"2023-09-10T00:14:07.567820+0000","last_became_active":"2023-09-10T00:14:07.557930+0000","last_became_peered":"2023-09-10T00:14:07.557930+0000","last_unstale":"2023-09-10T00:14:07.567820+0000","last_undegraded":"2023-09-10T00:14:07.567820+0000","last_fullsized":"2023-09-10T00:14:07.567820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:19:32.012604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600670+0000","last_change":"2023-09-10T00:14:06.556770+0000","last_active":"2023-09-10T00:14:07.600670+0000","last_peered":"2023-09-10T00:14:07.600670+0000","last_clean":"2023-09-10T00:14:07.600670+0000","last_became_active":"2023-09-10T00:14:06.556495+0000","last_became_peered":"2023-09-10T00:14:06.556495+0000","last_unstale":"2023-09-10T00:14:07.600670+0000","last_undegraded":"2023-09-10T00:14:07.600670+0000","last_fullsized":"2023-09-10T00:14:07.600670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:16:53.015653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579727+0000","last_change":"2023-09-10T00:14:07.570404+0000","last_active":"2023-09-10T00:14:07.579727+0000","last_peered":"2023-09-10T00:14:07.579727+0000","last_clean":"2023-09-10T00:14:07.579727+0000","last_became_active":"2023-09-10T00:14:07.569621+0000","last_became_peered":"2023-09-10T00:14:07.569621+0000","last_unstale":"2023-09-10T00:14:07.579727+0000","last_undegraded":"2023-09-10T00:14:07.579727+0000","last_fullsized":"2023-09-10T00:14:07.579727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:19:32.012604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.537238+0000","last_change":"2023-09-10T00:14:06.571225+0000","last_active":"2023-09-10T00:14:07.537238+0000","last_peered":"2023-09-10T00:14:07.537238+0000","last_clean":"2023-09-10T00:14:07.537238+0000","last_became_active":"2023-09-10T00:14:06.570938+0000","last_became_peered":"2023-09-10T00:14:06.570938+0000","last_unstale":"2023-09-10T00:14:07.537238+0000","last_undegraded":"2023-09-10T00:14:07.537238+0000","last_fullsized":"2023-09-10T00:14:07.537238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:14:48.938669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737545+0000","last_change":"2023-09-10T00:14:07.590985+0000","last_active":"2023-09-10T00:14:08.737545+0000","last_peered":"2023-09-10T00:14:08.737545+0000","last_clean":"2023-09-10T00:14:08.737545+0000","last_became_active":"2023-09-10T00:14:07.590385+0000","last_became_peered":"2023-09-10T00:14:07.590385+0000","last_unstale":"2023-09-10T00:14:08.737545+0000","last_undegraded":"2023-09-10T00:14:08.737545+0000","last_fullsized":"2023-09-10T00:14:08.737545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.543043+0000","last_change":"2023-09-10T00:14:06.583998+0000","last_active":"2023-09-10T00:14:07.543043+0000","last_peered":"2023-09-10T00:14:07.543043+0000","last_clean":"2023-09-10T00:14:07.543043+0000","last_became_active":"2023-09-10T00:14:06.583255+0000","last_became_peered":"2023-09-10T00:14:06.583255+0000","last_unstale":"2023-09-10T00:14:07.543043+0000","last_undegraded":"2023-09-10T00:14:07.543043+0000","last_fullsized":"2023-09-10T00:14:07.543043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:38:27.437329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588662+0000","last_change":"2023-09-10T00:14:07.570386+0000","last_active":"2023-09-10T00:14:07.588662+0000","last_peered":"2023-09-10T00:14:07.588662+0000","last_clean":"2023-09-10T00:14:07.588662+0000","last_became_active":"2023-09-10T00:14:07.569531+0000","last_became_peered":"2023-09-10T00:14:07.569531+0000","last_unstale":"2023-09-10T00:14:07.588662+0000","last_undegraded":"2023-09-10T00:14:07.588662+0000","last_fullsized":"2023-09-10T00:14:07.588662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:34:25.751953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.537216+0000","last_change":"2023-09-10T00:14:06.556190+0000","last_active":"2023-09-10T00:14:07.537216+0000","last_peered":"2023-09-10T00:14:07.537216+0000","last_clean":"2023-09-10T00:14:07.537216+0000","last_became_active":"2023-09-10T00:14:06.555869+0000","last_became_peered":"2023-09-10T00:14:06.555869+0000","last_unstale":"2023-09-10T00:14:07.537216+0000","last_undegraded":"2023-09-10T00:14:07.537216+0000","last_fullsized":"2023-09-10T00:14:07.537216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:40.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.608440+0000","last_change":"2023-09-10T00:14:07.605262+0000","last_active":"2023-09-10T00:14:07.608440+0000","last_peered":"2023-09-10T00:14:07.608440+0000","last_clean":"2023-09-10T00:14:07.608440+0000","last_became_active":"2023-09-10T00:14:07.604893+0000","last_became_peered":"2023-09-10T00:14:07.604893+0000","last_unstale":"2023-09-10T00:14:07.608440+0000","last_undegraded":"2023-09-10T00:14:07.608440+0000","last_fullsized":"2023-09-10T00:14:07.608440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T12:02:25.264837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738622+0000","last_change":"2023-09-10T00:14:06.587287+0000","last_active":"2023-09-10T00:14:08.738622+0000","last_peered":"2023-09-10T00:14:08.738622+0000","last_clean":"2023-09-10T00:14:08.738622+0000","last_became_active":"2023-09-10T00:14:06.586641+0000","last_became_peered":"2023-09-10T00:14:06.586641+0000","last_unstale":"2023-09-10T00:14:08.738622+0000","last_undegraded":"2023-09-10T00:14:08.738622+0000","last_fullsized":"2023-09-10T00:14:08.738622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:24:38.625991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570513+0000","last_change":"2023-09-10T00:14:07.559714+0000","last_active":"2023-09-10T00:14:07.570513+0000","last_peered":"2023-09-10T00:14:07.570513+0000","last_clean":"2023-09-10T00:14:07.570513+0000","last_became_active":"2023-09-10T00:14:07.558526+0000","last_became_peered":"2023-09-10T00:14:07.558526+0000","last_unstale":"2023-09-10T00:14:07.570513+0000","last_undegraded":"2023-09-10T00:14:07.570513+0000","last_fullsized":"2023-09-10T00:14:07.570513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.538172+0000","last_change":"2023-09-10T00:14:06.589333+0000","last_active":"2023-09-10T00:14:07.538172+0000","last_peered":"2023-09-10T00:14:07.538172+0000","last_clean":"2023-09-10T00:14:07.538172+0000","last_became_active":"2023-09-10T00:14:06.588958+0000","last_became_peered":"2023-09-10T00:14:06.588958+0000","last_unstale":"2023-09-10T00:14:07.538172+0000","last_undegraded":"2023-09-10T00:14:07.538172+0000","last_fullsized":"2023-09-10T00:14:07.538172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:51:18.261628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600829+0000","last_change":"2023-09-10T00:14:07.594469+0000","last_active":"2023-09-10T00:14:07.600829+0000","last_peered":"2023-09-10T00:14:07.600829+0000","last_clean":"2023-09-10T00:14:07.600829+0000","last_became_active":"2023-09-10T00:14:07.594172+0000","last_became_peered":"2023-09-10T00:14:07.594172+0000","last_unstale":"2023-09-10T00:14:07.600829+0000","last_undegraded":"2023-09-10T00:14:07.600829+0000","last_fullsized":"2023-09-10T00:14:07.600829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:28.746506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.562508+0000","last_change":"2023-09-10T00:14:06.558665+0000","last_active":"2023-09-10T00:14:07.562508+0000","last_peered":"2023-09-10T00:14:07.562508+0000","last_clean":"2023-09-10T00:14:07.562508+0000","last_became_active":"2023-09-10T00:14:06.558380+0000","last_became_peered":"2023-09-10T00:14:06.558380+0000","last_unstale":"2023-09-10T00:14:07.562508+0000","last_undegraded":"2023-09-10T00:14:07.562508+0000","last_fullsized":"2023-09-10T00:14:07.562508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:31:55.011004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585489+0000","last_change":"2023-09-10T00:14:07.574804+0000","last_active":"2023-09-10T00:14:07.585489+0000","last_peered":"2023-09-10T00:14:07.585489+0000","last_clean":"2023-09-10T00:14:07.585489+0000","last_became_active":"2023-09-10T00:14:07.573314+0000","last_became_peered":"2023-09-10T00:14:07.573314+0000","last_unstale":"2023-09-10T00:14:07.585489+0000","last_undegraded":"2023-09-10T00:14:07.585489+0000","last_fullsized":"2023-09-10T00:14:07.585489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:58:32.798976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.562796+0000","last_change":"2023-09-10T00:14:06.577540+0000","last_active":"2023-09-10T00:14:07.562796+0000","last_peered":"2023-09-10T00:14:07.562796+0000","last_clean":"2023-09-10T00:14:07.562796+0000","last_became_active":"2023-09-10T00:14:06.577148+0000","last_became_peered":"2023-09-10T00:14:06.577148+0000","last_unstale":"2023-09-10T00:14:07.562796+0000","last_undegraded":"2023-09-10T00:14:07.562796+0000","last_fullsized":"2023-09-10T00:14:07.562796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.580636+0000","last_change":"2023-09-10T00:14:07.568013+0000","last_active":"2023-09-10T00:14:07.580636+0000","last_peered":"2023-09-10T00:14:07.580636+0000","last_clean":"2023-09-10T00:14:07.580636+0000","last_became_active":"2023-09-10T00:14:07.567253+0000","last_became_peered":"2023-09-10T00:14:07.567253+0000","last_unstale":"2023-09-10T00:14:07.580636+0000","last_undegraded":"2023-09-10T00:14:07.580636+0000","last_fullsized":"2023-09-10T00:14:07.580636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T12:10:19.630721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542870+0000","last_change":"2023-09-10T00:14:06.569435+0000","last_active":"2023-09-10T00:14:08.542870+0000","last_peered":"2023-09-10T00:14:08.542870+0000","last_clean":"2023-09-10T00:14:08.542870+0000","last_became_active":"2023-09-10T00:14:06.568679+0000","last_became_peered":"2023-09-10T00:14:06.568679+0000","last_unstale":"2023-09-10T00:14:08.542870+0000","last_undegraded":"2023-09-10T00:14:08.542870+0000","last_fullsized":"2023-09-10T00:14:08.542870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:01:21.714136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542593+0000","last_change":"2023-09-10T00:14:07.596338+0000","last_active":"2023-09-10T00:14:08.542593+0000","last_peered":"2023-09-10T00:14:08.542593+0000","last_clean":"2023-09-10T00:14:08.542593+0000","last_became_active":"2023-09-10T00:14:07.594641+0000","last_became_peered":"2023-09-10T00:14:07.594641+0000","last_unstale":"2023-09-10T00:14:08.542593+0000","last_undegraded":"2023-09-10T00:14:08.542593+0000","last_fullsized":"2023-09-10T00:14:08.542593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542071+0000","last_change":"2023-09-10T00:14:06.568522+0000","last_active":"2023-09-10T00:14:08.542071+0000","last_peered":"2023-09-10T00:14:08.542071+0000","last_clean":"2023-09-10T00:14:08.542071+0000","last_became_active":"2023-09-10T00:14:06.567687+0000","last_became_peered":"2023-09-10T00:14:06.567687+0000","last_unstale":"2023-09-10T00:14:08.542071+0000","last_undegraded":"2023-09-10T00:14:08.542071+0000","last_fullsized":"2023-09-10T00:14:08.542071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.567749+0000","last_change":"2023-09-10T00:14:07.558085+0000","last_active":"2023-09-10T00:14:07.567749+0000","last_peered":"2023-09-10T00:14:07.567749+0000","last_clean":"2023-09-10T00:14:07.567749+0000","last_became_active":"2023-09-10T00:14:07.557304+0000","last_became_peered":"2023-09-10T00:14:07.557304+0000","last_unstale":"2023-09-10T00:14:07.567749+0000","last_undegraded":"2023-09-10T00:14:07.567749+0000","last_fullsized":"2023-09-10T00:14:07.567749+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:01:22.718576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.546539+0000","last_change":"2023-09-10T00:14:06.558375+0000","last_active":"2023-09-10T00:14:07.546539+0000","last_peered":"2023-09-10T00:14:07.546539+0000","last_clean":"2023-09-10T00:14:07.546539+0000","last_became_active":"2023-09-10T00:14:06.558088+0000","last_became_peered":"2023-09-10T00:14:06.558088+0000","last_unstale":"2023-09-10T00:14:07.546539+0000","last_undegraded":"2023-09-10T00:14:07.546539+0000","last_fullsized":"2023-09-10T00:14:07.546539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:30.242785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738341+0000","last_change":"2023-09-10T00:14:07.595745+0000","last_active":"2023-09-10T00:14:08.738341+0000","last_peered":"2023-09-10T00:14:08.738341+0000","last_clean":"2023-09-10T00:14:08.738341+0000","last_became_active":"2023-09-10T00:14:07.595037+0000","last_became_peered":"2023-09-10T00:14:07.595037+0000","last_unstale":"2023-09-10T00:14:08.738341+0000","last_undegraded":"2023-09-10T00:14:08.738341+0000","last_fullsized":"2023-09-10T00:14:08.738341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:02:51.052910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.544464+0000","last_change":"2023-09-10T00:14:06.588872+0000","last_active":"2023-09-10T00:14:07.544464+0000","last_peered":"2023-09-10T00:14:07.544464+0000","last_clean":"2023-09-10T00:14:07.544464+0000","last_became_active":"2023-09-10T00:14:06.587817+0000","last_became_peered":"2023-09-10T00:14:06.587817+0000","last_unstale":"2023-09-10T00:14:07.544464+0000","last_undegraded":"2023-09-10T00:14:07.544464+0000","last_fullsized":"2023-09-10T00:14:07.544464+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:52.242117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-10T00:14:06.569046+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:14:06.569046+0000","last_peered":"2023-09-10T00:14:06.569046+0000","last_clean":"2023-09-10T00:14:06.569046+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:14:06.569046+0000","last_undegraded":"2023-09-10T00:14:06.569046+0000","last_fullsized":"2023-09-10T00:14:06.569046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1052672,"data_stored":783240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.496}]},{"osd":1,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.123},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0640000000000001}]},{"osd":4,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.002},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98599999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":191772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":3.7639999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":4.6790000000000003}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":2.0169999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":3.0579999999999998}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":4.7809999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":2.109}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":3.1629999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":4.54}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":7.5049999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":8.5790000000000006}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":14.475},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":14.391}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":2.972},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":2.1890000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":191302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.61699999999999999}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":5.5279999999999996,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":1.173}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":6.2629999999999999,"5min":6.2629999999999999,"15min":6.2629999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.337},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":6.1710000000000003,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":1.2929999999999999}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.123},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":1.258}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":191794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.248},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.91900000000000004}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.204}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.1100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":184095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68700000000000006}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.752}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0489999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.075}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1819999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":184095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98599999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.085}]},{"osd":7,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.224},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":191280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.29799999999999999}]},{"osd":2,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.377},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.73999999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":774463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.77600000000000002}]},{"osd":2,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.085}]},{"osd":7,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.135}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:14:10.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T00:14:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 -- 172.21.15.84:0/1618119415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 msgr2=0x7f366c0cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 --2- 172.21.15.84:0/1618119415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0cbb20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f365c009840 tx=0x7f365c01efb0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 -- 172.21.15.84:0/1618119415 shutdown_connections 2023-09-10T00:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 --2- 172.21.15.84:0/1618119415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0cbb20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 -- 172.21.15.84:0/1618119415 >> 172.21.15.84:0/1618119415 conn(0x7f366c0b25b0 msgr2=0x7f366c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 -- 172.21.15.84:0/1618119415 shutdown_connections 2023-09-10T00:14:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.740+0000 7f3670a6d640 1 -- 172.21.15.84:0/1618119415 wait complete. 2023-09-10T00:14:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 Processor -- start 2023-09-10T00:14:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- start start 2023-09-10T00:14:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 0x7f366c145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f366c15af60 0x7f366c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c06afb0 con 0x7f366c15ab80 2023-09-10T00:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c145aa0 con 0x7f366c0afba0 2023-09-10T00:14:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1461d0 con 0x7f366c15af60 2023-09-10T00:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46848/0 (socket says 172.21.15.84:46848) 2023-09-10T00:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 -- 172.21.15.84:0/3552577294 learned_addr learned my addr 172.21.15.84:0/3552577294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f366a59c640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 0x7f366c145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 -- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f366c15af60 msgr2=0x7f366c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f366ad9d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f366c15af60 0x7f366c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f366c15af60 0x7f366c0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 -- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 msgr2=0x7f366c145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 0x7f366c145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 -- 172.21.15.84:0/3552577294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c0094a0 con 0x7f366c15ab80 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f366a59c640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 0x7f366c145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3669d9b640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f366000b3e0 tx=0x7f366000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660011830 con 0x7f366c15ab80 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3660011aa0 con 0x7f366c15ab80 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660010380 con 0x7f366c15ab80 2023-09-10T00:14:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c1464b0 con 0x7f366c15ab80 2023-09-10T00:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c146a70 con 0x7f366c15ab80 2023-09-10T00:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0b65c0 con 0x7f366c15ab80 2023-09-10T00:14:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.744+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f36600104e0 con 0x7f366c15ab80 2023-09-10T00:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.748+0000 7f365affd640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 0x7f364c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.748+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3660083900 con 0x7f366c15ab80 2023-09-10T00:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.748+0000 7f366a59c640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 0x7f364c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.748+0000 7f366a59c640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 0x7f364c067fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f365c0b2000 tx=0x7f365c01d7f0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.752+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3660051080 con 0x7f366c15ab80 2023-09-10T00:14:10.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.896+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f366c0d0830 con 0x7f364c065b20 2023-09-10T00:14:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.904+0000 7f365affd640 1 -- 172.21.15.84:0/3552577294 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288208 (secure 0 0 0) 0x7f365c0aae80 con 0x7f364c065b20 2023-09-10T00:14:10.952 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:10.953 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T00:14:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 msgr2=0x7f364c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 0x7f364c067fe0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f365c0b2000 tx=0x7f365c01d7f0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 msgr2=0x7f366c0b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f366000b3e0 tx=0x7f366000b8a0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 shutdown_connections 2023-09-10T00:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f364c065b20 0x7f364c067fe0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f366c15af60 0x7f366c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f366c15ab80 0x7f366c0b1c00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 --2- 172.21.15.84:0/3552577294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f366c0afba0 0x7f366c145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 >> 172.21.15.84:0/3552577294 conn(0x7f366c0b25b0 msgr2=0x7f366c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 shutdown_connections 2023-09-10T00:14:10.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:10.908+0000 7f3670a6d640 1 -- 172.21.15.84:0/3552577294 wait complete. 2023-09-10T00:14:10.958 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-09-10T00:14:09.838353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220808,"kb_used_data":4620,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753912,"statfs":{"total":773094113280,"available":772868005888,"internally_reserved":0,"allocated":4730880,"data_stored":2692041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.310238"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588835+0000","last_change":"2023-09-10T00:14:07.575565+0000","last_active":"2023-09-10T00:14:07.588835+0000","last_peered":"2023-09-10T00:14:07.588835+0000","last_clean":"2023-09-10T00:14:07.588835+0000","last_became_active":"2023-09-10T00:14:07.574813+0000","last_became_peered":"2023-09-10T00:14:07.574813+0000","last_unstale":"2023-09-10T00:14:07.588835+0000","last_undegraded":"2023-09-10T00:14:07.588835+0000","last_fullsized":"2023-09-10T00:14:07.588835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584625+0000","last_change":"2023-09-10T00:14:07.566067+0000","last_active":"2023-09-10T00:14:07.584625+0000","last_peered":"2023-09-10T00:14:07.584625+0000","last_clean":"2023-09-10T00:14:07.584625+0000","last_became_active":"2023-09-10T00:14:07.565297+0000","last_became_peered":"2023-09-10T00:14:07.565297+0000","last_unstale":"2023-09-10T00:14:07.584625+0000","last_undegraded":"2023-09-10T00:14:07.584625+0000","last_fullsized":"2023-09-10T00:14:07.584625+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600341+0000","last_change":"2023-09-10T00:14:07.595650+0000","last_active":"2023-09-10T00:14:07.600341+0000","last_peered":"2023-09-10T00:14:07.600341+0000","last_clean":"2023-09-10T00:14:07.600341+0000","last_became_active":"2023-09-10T00:14:07.594871+0000","last_became_peered":"2023-09-10T00:14:07.594871+0000","last_unstale":"2023-09-10T00:14:07.600341+0000","last_undegraded":"2023-09-10T00:14:07.600341+0000","last_fullsized":"2023-09-10T00:14:07.600341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585344+0000","last_change":"2023-09-10T00:14:07.581124+0000","last_active":"2023-09-10T00:14:07.585344+0000","last_peered":"2023-09-10T00:14:07.585344+0000","last_clean":"2023-09-10T00:14:07.585344+0000","last_became_active":"2023-09-10T00:14:07.580755+0000","last_became_peered":"2023-09-10T00:14:07.580755+0000","last_unstale":"2023-09-10T00:14:07.585344+0000","last_undegraded":"2023-09-10T00:14:07.585344+0000","last_fullsized":"2023-09-10T00:14:07.585344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:49:36.855888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585391+0000","last_change":"2023-09-10T00:14:07.582029+0000","last_active":"2023-09-10T00:14:07.585391+0000","last_peered":"2023-09-10T00:14:07.585391+0000","last_clean":"2023-09-10T00:14:07.585391+0000","last_became_active":"2023-09-10T00:14:07.581489+0000","last_became_peered":"2023-09-10T00:14:07.581489+0000","last_unstale":"2023-09-10T00:14:07.585391+0000","last_undegraded":"2023-09-10T00:14:07.585391+0000","last_fullsized":"2023-09-10T00:14:07.585391+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:16:15.465397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.586532+0000","last_change":"2023-09-10T00:14:07.576854+0000","last_active":"2023-09-10T00:14:07.586532+0000","last_peered":"2023-09-10T00:14:07.586532+0000","last_clean":"2023-09-10T00:14:07.586532+0000","last_became_active":"2023-09-10T00:14:07.576010+0000","last_became_peered":"2023-09-10T00:14:07.576010+0000","last_unstale":"2023-09-10T00:14:07.586532+0000","last_undegraded":"2023-09-10T00:14:07.586532+0000","last_fullsized":"2023-09-10T00:14:07.586532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:29:32.046406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737490+0000","last_change":"2023-09-10T00:14:07.597943+0000","last_active":"2023-09-10T00:14:08.737490+0000","last_peered":"2023-09-10T00:14:08.737490+0000","last_clean":"2023-09-10T00:14:08.737490+0000","last_became_active":"2023-09-10T00:14:07.596212+0000","last_became_peered":"2023-09-10T00:14:07.596212+0000","last_unstale":"2023-09-10T00:14:08.737490+0000","last_undegraded":"2023-09-10T00:14:08.737490+0000","last_fullsized":"2023-09-10T00:14:08.737490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.597468+0000","last_change":"2023-09-10T00:14:07.589704+0000","last_active":"2023-09-10T00:14:07.597468+0000","last_peered":"2023-09-10T00:14:07.597468+0000","last_clean":"2023-09-10T00:14:07.597468+0000","last_became_active":"2023-09-10T00:14:07.589405+0000","last_became_peered":"2023-09-10T00:14:07.589405+0000","last_unstale":"2023-09-10T00:14:07.597468+0000","last_undegraded":"2023-09-10T00:14:07.597468+0000","last_fullsized":"2023-09-10T00:14:07.597468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:09:15.026087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.603178+0000","last_change":"2023-09-10T00:14:07.596194+0000","last_active":"2023-09-10T00:14:07.603178+0000","last_peered":"2023-09-10T00:14:07.603178+0000","last_clean":"2023-09-10T00:14:07.603178+0000","last_became_active":"2023-09-10T00:14:07.595848+0000","last_became_peered":"2023-09-10T00:14:07.595848+0000","last_unstale":"2023-09-10T00:14:07.603178+0000","last_undegraded":"2023-09-10T00:14:07.603178+0000","last_fullsized":"2023-09-10T00:14:07.603178+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738032+0000","last_change":"2023-09-10T00:14:07.591437+0000","last_active":"2023-09-10T00:14:08.738032+0000","last_peered":"2023-09-10T00:14:08.738032+0000","last_clean":"2023-09-10T00:14:08.738032+0000","last_became_active":"2023-09-10T00:14:07.589943+0000","last_became_peered":"2023-09-10T00:14:07.589943+0000","last_unstale":"2023-09-10T00:14:08.738032+0000","last_undegraded":"2023-09-10T00:14:08.738032+0000","last_fullsized":"2023-09-10T00:14:08.738032+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:31:10.853712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738278+0000","last_change":"2023-09-10T00:14:07.605920+0000","last_active":"2023-09-10T00:14:08.738278+0000","last_peered":"2023-09-10T00:14:08.738278+0000","last_clean":"2023-09-10T00:14:08.738278+0000","last_became_active":"2023-09-10T00:14:07.605377+0000","last_became_peered":"2023-09-10T00:14:07.605377+0000","last_unstale":"2023-09-10T00:14:08.738278+0000","last_undegraded":"2023-09-10T00:14:08.738278+0000","last_fullsized":"2023-09-10T00:14:08.738278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:32:07.782174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579798+0000","last_change":"2023-09-10T00:14:07.568511+0000","last_active":"2023-09-10T00:14:07.579798+0000","last_peered":"2023-09-10T00:14:07.579798+0000","last_clean":"2023-09-10T00:14:07.579798+0000","last_became_active":"2023-09-10T00:14:07.565850+0000","last_became_peered":"2023-09-10T00:14:07.565850+0000","last_unstale":"2023-09-10T00:14:07.579798+0000","last_undegraded":"2023-09-10T00:14:07.579798+0000","last_fullsized":"2023-09-10T00:14:07.579798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737649+0000","last_change":"2023-09-10T00:14:07.603534+0000","last_active":"2023-09-10T00:14:08.737649+0000","last_peered":"2023-09-10T00:14:08.737649+0000","last_clean":"2023-09-10T00:14:08.737649+0000","last_became_active":"2023-09-10T00:14:07.602956+0000","last_became_peered":"2023-09-10T00:14:07.602956+0000","last_unstale":"2023-09-10T00:14:08.737649+0000","last_undegraded":"2023-09-10T00:14:08.737649+0000","last_fullsized":"2023-09-10T00:14:08.737649+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542344+0000","last_change":"2023-09-10T00:14:07.596747+0000","last_active":"2023-09-10T00:14:08.542344+0000","last_peered":"2023-09-10T00:14:08.542344+0000","last_clean":"2023-09-10T00:14:08.542344+0000","last_became_active":"2023-09-10T00:14:07.595383+0000","last_became_peered":"2023-09-10T00:14:07.595383+0000","last_unstale":"2023-09-10T00:14:08.542344+0000","last_undegraded":"2023-09-10T00:14:08.542344+0000","last_fullsized":"2023-09-10T00:14:08.542344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:27.215626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737629+0000","last_change":"2023-09-10T00:14:07.586072+0000","last_active":"2023-09-10T00:14:08.737629+0000","last_peered":"2023-09-10T00:14:08.737629+0000","last_clean":"2023-09-10T00:14:08.737629+0000","last_became_active":"2023-09-10T00:14:07.585521+0000","last_became_peered":"2023-09-10T00:14:07.585521+0000","last_unstale":"2023-09-10T00:14:08.737629+0000","last_undegraded":"2023-09-10T00:14:08.737629+0000","last_fullsized":"2023-09-10T00:14:08.737629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.611922+0000","last_change":"2023-09-10T00:14:07.608406+0000","last_active":"2023-09-10T00:14:07.611922+0000","last_peered":"2023-09-10T00:14:07.611922+0000","last_clean":"2023-09-10T00:14:07.611922+0000","last_became_active":"2023-09-10T00:14:07.607831+0000","last_became_peered":"2023-09-10T00:14:07.607831+0000","last_unstale":"2023-09-10T00:14:07.611922+0000","last_undegraded":"2023-09-10T00:14:07.611922+0000","last_fullsized":"2023-09-10T00:14:07.611922+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:24:48.594760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588389+0000","last_change":"2023-09-10T00:14:07.579752+0000","last_active":"2023-09-10T00:14:07.588389+0000","last_peered":"2023-09-10T00:14:07.588389+0000","last_clean":"2023-09-10T00:14:07.588389+0000","last_became_active":"2023-09-10T00:14:07.579078+0000","last_became_peered":"2023-09-10T00:14:07.579078+0000","last_unstale":"2023-09-10T00:14:07.588389+0000","last_undegraded":"2023-09-10T00:14:07.588389+0000","last_fullsized":"2023-09-10T00:14:07.588389+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:11:43.437713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543523+0000","last_change":"2023-09-10T00:14:07.595635+0000","last_active":"2023-09-10T00:14:08.543523+0000","last_peered":"2023-09-10T00:14:08.543523+0000","last_clean":"2023-09-10T00:14:08.543523+0000","last_became_active":"2023-09-10T00:14:07.595050+0000","last_became_peered":"2023-09-10T00:14:07.595050+0000","last_unstale":"2023-09-10T00:14:08.543523+0000","last_undegraded":"2023-09-10T00:14:08.543523+0000","last_fullsized":"2023-09-10T00:14:08.543523+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.583447+0000","last_change":"2023-09-10T00:14:07.577211+0000","last_active":"2023-09-10T00:14:07.583447+0000","last_peered":"2023-09-10T00:14:07.583447+0000","last_clean":"2023-09-10T00:14:07.583447+0000","last_became_active":"2023-09-10T00:14:07.576560+0000","last_became_peered":"2023-09-10T00:14:07.576560+0000","last_unstale":"2023-09-10T00:14:07.583447+0000","last_undegraded":"2023-09-10T00:14:07.583447+0000","last_fullsized":"2023-09-10T00:14:07.583447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:35:50.244578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543046+0000","last_change":"2023-09-10T00:14:07.580026+0000","last_active":"2023-09-10T00:14:08.543046+0000","last_peered":"2023-09-10T00:14:08.543046+0000","last_clean":"2023-09-10T00:14:08.543046+0000","last_became_active":"2023-09-10T00:14:07.579352+0000","last_became_peered":"2023-09-10T00:14:07.579352+0000","last_unstale":"2023-09-10T00:14:08.543046+0000","last_undegraded":"2023-09-10T00:14:08.543046+0000","last_fullsized":"2023-09-10T00:14:08.543046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:53.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737962+0000","last_change":"2023-09-10T00:14:07.592145+0000","last_active":"2023-09-10T00:14:08.737962+0000","last_peered":"2023-09-10T00:14:08.737962+0000","last_clean":"2023-09-10T00:14:08.737962+0000","last_became_active":"2023-09-10T00:14:07.589524+0000","last_became_peered":"2023-09-10T00:14:07.589524+0000","last_unstale":"2023-09-10T00:14:08.737962+0000","last_undegraded":"2023-09-10T00:14:08.737962+0000","last_fullsized":"2023-09-10T00:14:08.737962+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543206+0000","last_change":"2023-09-10T00:14:07.595929+0000","last_active":"2023-09-10T00:14:08.543206+0000","last_peered":"2023-09-10T00:14:08.543206+0000","last_clean":"2023-09-10T00:14:08.543206+0000","last_became_active":"2023-09-10T00:14:07.593800+0000","last_became_peered":"2023-09-10T00:14:07.593800+0000","last_unstale":"2023-09-10T00:14:08.543206+0000","last_undegraded":"2023-09-10T00:14:08.543206+0000","last_fullsized":"2023-09-10T00:14:08.543206+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.573884+0000","last_change":"2023-09-10T00:14:07.565142+0000","last_active":"2023-09-10T00:14:07.573884+0000","last_peered":"2023-09-10T00:14:07.573884+0000","last_clean":"2023-09-10T00:14:07.573884+0000","last_became_active":"2023-09-10T00:14:07.563439+0000","last_became_peered":"2023-09-10T00:14:07.563439+0000","last_unstale":"2023-09-10T00:14:07.573884+0000","last_undegraded":"2023-09-10T00:14:07.573884+0000","last_fullsized":"2023-09-10T00:14:07.573884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:51:59.365787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.556655+0000","last_change":"2023-09-10T00:14:07.550777+0000","last_active":"2023-09-10T00:14:07.556655+0000","last_peered":"2023-09-10T00:14:07.556655+0000","last_clean":"2023-09-10T00:14:07.556655+0000","last_became_active":"2023-09-10T00:14:07.550038+0000","last_became_peered":"2023-09-10T00:14:07.550038+0000","last_unstale":"2023-09-10T00:14:07.556655+0000","last_undegraded":"2023-09-10T00:14:07.556655+0000","last_fullsized":"2023-09-10T00:14:07.556655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:12:29.119042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543666+0000","last_change":"2023-09-10T00:14:07.572560+0000","last_active":"2023-09-10T00:14:08.543666+0000","last_peered":"2023-09-10T00:14:08.543666+0000","last_clean":"2023-09-10T00:14:08.543666+0000","last_became_active":"2023-09-10T00:14:07.571769+0000","last_became_peered":"2023-09-10T00:14:07.571769+0000","last_unstale":"2023-09-10T00:14:08.543666+0000","last_undegraded":"2023-09-10T00:14:08.543666+0000","last_fullsized":"2023-09-10T00:14:08.543666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:58:32.798976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.599279+0000","last_change":"2023-09-10T00:14:07.590394+0000","last_active":"2023-09-10T00:14:07.599279+0000","last_peered":"2023-09-10T00:14:07.599279+0000","last_clean":"2023-09-10T00:14:07.599279+0000","last_became_active":"2023-09-10T00:14:07.590100+0000","last_became_peered":"2023-09-10T00:14:07.590100+0000","last_unstale":"2023-09-10T00:14:07.599279+0000","last_undegraded":"2023-09-10T00:14:07.599279+0000","last_fullsized":"2023-09-10T00:14:07.599279+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:35:16.125153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543552+0000","last_change":"2023-09-10T00:14:07.558651+0000","last_active":"2023-09-10T00:14:08.543552+0000","last_peered":"2023-09-10T00:14:08.543552+0000","last_clean":"2023-09-10T00:14:08.543552+0000","last_became_active":"2023-09-10T00:14:07.557894+0000","last_became_peered":"2023-09-10T00:14:07.557894+0000","last_unstale":"2023-09-10T00:14:08.543552+0000","last_undegraded":"2023-09-10T00:14:08.543552+0000","last_fullsized":"2023-09-10T00:14:08.543552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:29:17.726708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738147+0000","last_change":"2023-09-10T00:14:07.576020+0000","last_active":"2023-09-10T00:14:08.738147+0000","last_peered":"2023-09-10T00:14:08.738147+0000","last_clean":"2023-09-10T00:14:08.738147+0000","last_became_active":"2023-09-10T00:14:07.575536+0000","last_became_peered":"2023-09-10T00:14:07.575536+0000","last_unstale":"2023-09-10T00:14:08.738147+0000","last_undegraded":"2023-09-10T00:14:08.738147+0000","last_fullsized":"2023-09-10T00:14:08.738147+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:28.746506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542893+0000","last_change":"2023-09-10T00:14:07.569255+0000","last_active":"2023-09-10T00:14:08.542893+0000","last_peered":"2023-09-10T00:14:08.542893+0000","last_clean":"2023-09-10T00:14:08.542893+0000","last_became_active":"2023-09-10T00:14:07.568457+0000","last_became_peered":"2023-09-10T00:14:07.568457+0000","last_unstale":"2023-09-10T00:14:08.542893+0000","last_undegraded":"2023-09-10T00:14:08.542893+0000","last_fullsized":"2023-09-10T00:14:08.542893+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542860+0000","last_change":"2023-09-10T00:14:07.567675+0000","last_active":"2023-09-10T00:14:08.542860+0000","last_peered":"2023-09-10T00:14:08.542860+0000","last_clean":"2023-09-10T00:14:08.542860+0000","last_became_active":"2023-09-10T00:14:07.566770+0000","last_became_peered":"2023-09-10T00:14:07.566770+0000","last_unstale":"2023-09-10T00:14:08.542860+0000","last_undegraded":"2023-09-10T00:14:08.542860+0000","last_fullsized":"2023-09-10T00:14:08.542860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.573987+0000","last_change":"2023-09-10T00:14:07.565606+0000","last_active":"2023-09-10T00:14:07.573987+0000","last_peered":"2023-09-10T00:14:07.573987+0000","last_clean":"2023-09-10T00:14:07.573987+0000","last_became_active":"2023-09-10T00:14:07.564405+0000","last_became_peered":"2023-09-10T00:14:07.564405+0000","last_unstale":"2023-09-10T00:14:07.573987+0000","last_undegraded":"2023-09-10T00:14:07.573987+0000","last_fullsized":"2023-09-10T00:14:07.573987+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:29:04.024829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.566038+0000","last_change":"2023-09-10T00:14:07.561803+0000","last_active":"2023-09-10T00:14:07.566038+0000","last_peered":"2023-09-10T00:14:07.566038+0000","last_clean":"2023-09-10T00:14:07.566038+0000","last_became_active":"2023-09-10T00:14:07.560525+0000","last_became_peered":"2023-09-10T00:14:07.560525+0000","last_unstale":"2023-09-10T00:14:07.566038+0000","last_undegraded":"2023-09-10T00:14:07.566038+0000","last_fullsized":"2023-09-10T00:14:07.566038+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:12:41.058769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.613297+0000","last_change":"2023-09-10T00:14:07.609677+0000","last_active":"2023-09-10T00:14:07.613297+0000","last_peered":"2023-09-10T00:14:07.613297+0000","last_clean":"2023-09-10T00:14:07.613297+0000","last_became_active":"2023-09-10T00:14:07.609110+0000","last_became_peered":"2023-09-10T00:14:07.609110+0000","last_unstale":"2023-09-10T00:14:07.613297+0000","last_undegraded":"2023-09-10T00:14:07.613297+0000","last_fullsized":"2023-09-10T00:14:07.613297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:45:27.360257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543585+0000","last_change":"2023-09-10T00:14:06.560396+0000","last_active":"2023-09-10T00:14:08.543585+0000","last_peered":"2023-09-10T00:14:08.543585+0000","last_clean":"2023-09-10T00:14:08.543585+0000","last_became_active":"2023-09-10T00:14:06.559669+0000","last_became_peered":"2023-09-10T00:14:06.559669+0000","last_unstale":"2023-09-10T00:14:08.543585+0000","last_undegraded":"2023-09-10T00:14:08.543585+0000","last_fullsized":"2023-09-10T00:14:08.543585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:11:42.433273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.608419+0000","last_change":"2023-09-10T00:14:07.605265+0000","last_active":"2023-09-10T00:14:07.608419+0000","last_peered":"2023-09-10T00:14:07.608419+0000","last_clean":"2023-09-10T00:14:07.608419+0000","last_became_active":"2023-09-10T00:14:07.604895+0000","last_became_peered":"2023-09-10T00:14:07.604895+0000","last_unstale":"2023-09-10T00:14:07.608419+0000","last_undegraded":"2023-09-10T00:14:07.608419+0000","last_fullsized":"2023-09-10T00:14:07.608419+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:42:10.792491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600434+0000","last_change":"2023-09-10T00:14:06.575379+0000","last_active":"2023-09-10T00:14:07.600434+0000","last_peered":"2023-09-10T00:14:07.600434+0000","last_clean":"2023-09-10T00:14:07.600434+0000","last_became_active":"2023-09-10T00:14:06.575117+0000","last_became_peered":"2023-09-10T00:14:06.575117+0000","last_unstale":"2023-09-10T00:14:07.600434+0000","last_undegraded":"2023-09-10T00:14:07.600434+0000","last_fullsized":"2023-09-10T00:14:07.600434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543912+0000","last_change":"2023-09-10T00:14:07.583110+0000","last_active":"2023-09-10T00:14:08.543912+0000","last_peered":"2023-09-10T00:14:08.543912+0000","last_clean":"2023-09-10T00:14:08.543912+0000","last_became_active":"2023-09-10T00:14:07.582106+0000","last_became_peered":"2023-09-10T00:14:07.582106+0000","last_unstale":"2023-09-10T00:14:08.543912+0000","last_undegraded":"2023-09-10T00:14:08.543912+0000","last_fullsized":"2023-09-10T00:14:08.543912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:44:51.589186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.615388+0000","last_change":"2023-09-10T00:14:06.570865+0000","last_active":"2023-09-10T00:14:07.615388+0000","last_peered":"2023-09-10T00:14:07.615388+0000","last_clean":"2023-09-10T00:14:07.615388+0000","last_became_active":"2023-09-10T00:14:06.570406+0000","last_became_peered":"2023-09-10T00:14:06.570406+0000","last_unstale":"2023-09-10T00:14:07.615388+0000","last_undegraded":"2023-09-10T00:14:07.615388+0000","last_fullsized":"2023-09-10T00:14:07.615388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:49:21.149885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584639+0000","last_change":"2023-09-10T00:14:07.566297+0000","last_active":"2023-09-10T00:14:07.584639+0000","last_peered":"2023-09-10T00:14:07.584639+0000","last_clean":"2023-09-10T00:14:07.584639+0000","last_became_active":"2023-09-10T00:14:07.565520+0000","last_became_peered":"2023-09-10T00:14:07.565520+0000","last_unstale":"2023-09-10T00:14:07.584639+0000","last_undegraded":"2023-09-10T00:14:07.584639+0000","last_fullsized":"2023-09-10T00:14:07.584639+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T11:20:28.784540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543031+0000","last_change":"2023-09-10T00:14:06.571173+0000","last_active":"2023-09-10T00:14:08.543031+0000","last_peered":"2023-09-10T00:14:08.543031+0000","last_clean":"2023-09-10T00:14:08.543031+0000","last_became_active":"2023-09-10T00:14:06.570275+0000","last_became_peered":"2023-09-10T00:14:06.570275+0000","last_unstale":"2023-09-10T00:14:08.543031+0000","last_undegraded":"2023-09-10T00:14:08.543031+0000","last_fullsized":"2023-09-10T00:14:08.543031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585533+0000","last_change":"2023-09-10T00:14:07.575221+0000","last_active":"2023-09-10T00:14:07.585533+0000","last_peered":"2023-09-10T00:14:07.585533+0000","last_clean":"2023-09-10T00:14:07.585533+0000","last_became_active":"2023-09-10T00:14:07.574190+0000","last_became_peered":"2023-09-10T00:14:07.574190+0000","last_unstale":"2023-09-10T00:14:07.585533+0000","last_undegraded":"2023-09-10T00:14:07.585533+0000","last_fullsized":"2023-09-10T00:14:07.585533+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:45.756460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737924+0000","last_change":"2023-09-10T00:14:06.586022+0000","last_active":"2023-09-10T00:14:08.737924+0000","last_peered":"2023-09-10T00:14:08.737924+0000","last_clean":"2023-09-10T00:14:08.737924+0000","last_became_active":"2023-09-10T00:14:06.585290+0000","last_became_peered":"2023-09-10T00:14:06.585290+0000","last_unstale":"2023-09-10T00:14:08.737924+0000","last_undegraded":"2023-09-10T00:14:08.737924+0000","last_fullsized":"2023-09-10T00:14:08.737924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:09:14.021648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737881+0000","last_change":"2023-09-10T00:14:07.592539+0000","last_active":"2023-09-10T00:14:08.737881+0000","last_peered":"2023-09-10T00:14:08.737881+0000","last_clean":"2023-09-10T00:14:08.737881+0000","last_became_active":"2023-09-10T00:14:07.587936+0000","last_became_peered":"2023-09-10T00:14:07.587936+0000","last_unstale":"2023-09-10T00:14:08.737881+0000","last_undegraded":"2023-09-10T00:14:08.737881+0000","last_fullsized":"2023-09-10T00:14:08.737881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:31.247225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.616116+0000","last_change":"2023-09-10T00:14:06.588868+0000","last_active":"2023-09-10T00:14:07.616116+0000","last_peered":"2023-09-10T00:14:07.616116+0000","last_clean":"2023-09-10T00:14:07.616116+0000","last_became_active":"2023-09-10T00:14:06.587976+0000","last_became_peered":"2023-09-10T00:14:06.587976+0000","last_unstale":"2023-09-10T00:14:07.616116+0000","last_undegraded":"2023-09-10T00:14:07.616116+0000","last_fullsized":"2023-09-10T00:14:07.616116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:45:45.720325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542832+0000","last_change":"2023-09-10T00:14:07.607061+0000","last_active":"2023-09-10T00:14:08.542832+0000","last_peered":"2023-09-10T00:14:08.542832+0000","last_clean":"2023-09-10T00:14:08.542832+0000","last_became_active":"2023-09-10T00:14:07.605696+0000","last_became_peered":"2023-09-10T00:14:07.605696+0000","last_unstale":"2023-09-10T00:14:08.542832+0000","last_undegraded":"2023-09-10T00:14:08.542832+0000","last_fullsized":"2023-09-10T00:14:08.542832+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.553942+0000","last_change":"2023-09-10T00:14:06.585233+0000","last_active":"2023-09-10T00:14:07.553942+0000","last_peered":"2023-09-10T00:14:07.553942+0000","last_clean":"2023-09-10T00:14:07.553942+0000","last_became_active":"2023-09-10T00:14:06.584838+0000","last_became_peered":"2023-09-10T00:14:06.584838+0000","last_unstale":"2023-09-10T00:14:07.553942+0000","last_undegraded":"2023-09-10T00:14:07.553942+0000","last_fullsized":"2023-09-10T00:14:07.553942+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:29:31.298081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588732+0000","last_change":"2023-09-10T00:14:07.574361+0000","last_active":"2023-09-10T00:14:07.588732+0000","last_peered":"2023-09-10T00:14:07.588732+0000","last_clean":"2023-09-10T00:14:07.588732+0000","last_became_active":"2023-09-10T00:14:07.572719+0000","last_became_peered":"2023-09-10T00:14:07.572719+0000","last_unstale":"2023-09-10T00:14:07.588732+0000","last_undegraded":"2023-09-10T00:14:07.588732+0000","last_fullsized":"2023-09-10T00:14:07.588732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.541981+0000","last_change":"2023-09-10T00:14:06.578783+0000","last_active":"2023-09-10T00:14:08.541981+0000","last_peered":"2023-09-10T00:14:08.541981+0000","last_clean":"2023-09-10T00:14:08.541981+0000","last_became_active":"2023-09-10T00:14:06.578044+0000","last_became_peered":"2023-09-10T00:14:06.578044+0000","last_unstale":"2023-09-10T00:14:08.541981+0000","last_undegraded":"2023-09-10T00:14:08.541981+0000","last_fullsized":"2023-09-10T00:14:08.541981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:31:55.011004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585226+0000","last_change":"2023-09-10T00:14:07.579506+0000","last_active":"2023-09-10T00:14:07.585226+0000","last_peered":"2023-09-10T00:14:07.585226+0000","last_clean":"2023-09-10T00:14:07.585226+0000","last_became_active":"2023-09-10T00:14:07.578842+0000","last_became_peered":"2023-09-10T00:14:07.578842+0000","last_unstale":"2023-09-10T00:14:07.585226+0000","last_undegraded":"2023-09-10T00:14:07.585226+0000","last_fullsized":"2023-09-10T00:14:07.585226+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:59:45.684156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.560519+0000","last_change":"2023-09-10T00:14:06.558518+0000","last_active":"2023-09-10T00:14:07.560519+0000","last_peered":"2023-09-10T00:14:07.560519+0000","last_clean":"2023-09-10T00:14:07.560519+0000","last_became_active":"2023-09-10T00:14:06.558185+0000","last_became_peered":"2023-09-10T00:14:06.558185+0000","last_unstale":"2023-09-10T00:14:07.560519+0000","last_undegraded":"2023-09-10T00:14:07.560519+0000","last_fullsized":"2023-09-10T00:14:07.560519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:02:50.048470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570460+0000","last_change":"2023-09-10T00:14:07.559229+0000","last_active":"2023-09-10T00:14:07.570460+0000","last_peered":"2023-09-10T00:14:07.570460+0000","last_clean":"2023-09-10T00:14:07.570460+0000","last_became_active":"2023-09-10T00:14:07.557550+0000","last_became_peered":"2023-09-10T00:14:07.557550+0000","last_unstale":"2023-09-10T00:14:07.570460+0000","last_undegraded":"2023-09-10T00:14:07.570460+0000","last_fullsized":"2023-09-10T00:14:07.570460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:12:08.723496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738270+0000","last_change":"2023-09-10T00:14:06.589092+0000","last_active":"2023-09-10T00:14:08.738270+0000","last_peered":"2023-09-10T00:14:08.738270+0000","last_clean":"2023-09-10T00:14:08.738270+0000","last_became_active":"2023-09-10T00:14:06.587619+0000","last_became_peered":"2023-09-10T00:14:06.587619+0000","last_unstale":"2023-09-10T00:14:08.738270+0000","last_undegraded":"2023-09-10T00:14:08.738270+0000","last_fullsized":"2023-09-10T00:14:08.738270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:07:12.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579860+0000","last_change":"2023-09-10T00:14:07.570987+0000","last_active":"2023-09-10T00:14:07.579860+0000","last_peered":"2023-09-10T00:14:07.579860+0000","last_clean":"2023-09-10T00:14:07.579860+0000","last_became_active":"2023-09-10T00:14:07.568925+0000","last_became_peered":"2023-09-10T00:14:07.568925+0000","last_unstale":"2023-09-10T00:14:07.579860+0000","last_undegraded":"2023-09-10T00:14:07.579860+0000","last_fullsized":"2023-09-10T00:14:07.579860+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:53.246557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738430+0000","last_change":"2023-09-10T00:14:06.586365+0000","last_active":"2023-09-10T00:14:08.738430+0000","last_peered":"2023-09-10T00:14:08.738430+0000","last_clean":"2023-09-10T00:14:08.738430+0000","last_became_active":"2023-09-10T00:14:06.585666+0000","last_became_peered":"2023-09-10T00:14:06.585666+0000","last_unstale":"2023-09-10T00:14:08.738430+0000","last_undegraded":"2023-09-10T00:14:08.738430+0000","last_fullsized":"2023-09-10T00:14:08.738430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543101+0000","last_change":"2023-09-10T00:14:07.579761+0000","last_active":"2023-09-10T00:14:08.543101+0000","last_peered":"2023-09-10T00:14:08.543101+0000","last_clean":"2023-09-10T00:14:08.543101+0000","last_became_active":"2023-09-10T00:14:07.579054+0000","last_became_peered":"2023-09-10T00:14:07.579054+0000","last_unstale":"2023-09-10T00:14:08.543101+0000","last_undegraded":"2023-09-10T00:14:08.543101+0000","last_fullsized":"2023-09-10T00:14:08.543101+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:06:58.748967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.614861+0000","last_change":"2023-09-10T00:14:06.582400+0000","last_active":"2023-09-10T00:14:07.614861+0000","last_peered":"2023-09-10T00:14:07.614861+0000","last_clean":"2023-09-10T00:14:07.614861+0000","last_became_active":"2023-09-10T00:14:06.582008+0000","last_became_peered":"2023-09-10T00:14:06.582008+0000","last_unstale":"2023-09-10T00:14:07.614861+0000","last_undegraded":"2023-09-10T00:14:07.614861+0000","last_fullsized":"2023-09-10T00:14:07.614861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:31:09.849273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.591216+0000","last_change":"2023-09-10T00:14:07.588853+0000","last_active":"2023-09-10T00:14:07.591216+0000","last_peered":"2023-09-10T00:14:07.591216+0000","last_clean":"2023-09-10T00:14:07.591216+0000","last_became_active":"2023-09-10T00:14:07.588492+0000","last_became_peered":"2023-09-10T00:14:07.588492+0000","last_unstale":"2023-09-10T00:14:07.591216+0000","last_undegraded":"2023-09-10T00:14:07.591216+0000","last_fullsized":"2023-09-10T00:14:07.591216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:29:17.726708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.603412+0000","last_change":"2023-09-10T00:14:06.560688+0000","last_active":"2023-09-10T00:14:07.603412+0000","last_peered":"2023-09-10T00:14:07.603412+0000","last_clean":"2023-09-10T00:14:07.603412+0000","last_became_active":"2023-09-10T00:14:06.560398+0000","last_became_peered":"2023-09-10T00:14:06.560398+0000","last_unstale":"2023-09-10T00:14:07.603412+0000","last_undegraded":"2023-09-10T00:14:07.603412+0000","last_fullsized":"2023-09-10T00:14:07.603412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:32:06.777734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588709+0000","last_change":"2023-09-10T00:14:07.570864+0000","last_active":"2023-09-10T00:14:07.588709+0000","last_peered":"2023-09-10T00:14:07.588709+0000","last_clean":"2023-09-10T00:14:07.588709+0000","last_became_active":"2023-09-10T00:14:07.570110+0000","last_became_peered":"2023-09-10T00:14:07.570110+0000","last_unstale":"2023-09-10T00:14:07.588709+0000","last_undegraded":"2023-09-10T00:14:07.588709+0000","last_fullsized":"2023-09-10T00:14:07.588709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:46:50.000512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.555664+0000","last_change":"2023-09-10T00:14:06.584968+0000","last_active":"2023-09-10T00:14:07.555664+0000","last_peered":"2023-09-10T00:14:07.555664+0000","last_clean":"2023-09-10T00:14:07.555664+0000","last_became_active":"2023-09-10T00:14:06.584515+0000","last_became_peered":"2023-09-10T00:14:06.584515+0000","last_unstale":"2023-09-10T00:14:07.555664+0000","last_undegraded":"2023-09-10T00:14:07.555664+0000","last_fullsized":"2023-09-10T00:14:07.555664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:40:29.433658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570985+0000","last_change":"2023-09-10T00:14:07.564925+0000","last_active":"2023-09-10T00:14:07.570985+0000","last_peered":"2023-09-10T00:14:07.570985+0000","last_clean":"2023-09-10T00:14:07.570985+0000","last_became_active":"2023-09-10T00:14:07.564006+0000","last_became_peered":"2023-09-10T00:14:07.564006+0000","last_unstale":"2023-09-10T00:14:07.570985+0000","last_undegraded":"2023-09-10T00:14:07.570985+0000","last_fullsized":"2023-09-10T00:14:07.570985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T09:07:29.134055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542615+0000","last_change":"2023-09-10T00:14:06.573592+0000","last_active":"2023-09-10T00:14:08.542615+0000","last_peered":"2023-09-10T00:14:08.542615+0000","last_clean":"2023-09-10T00:14:08.542615+0000","last_became_active":"2023-09-10T00:14:06.572872+0000","last_became_peered":"2023-09-10T00:14:06.572872+0000","last_unstale":"2023-09-10T00:14:08.542615+0000","last_undegraded":"2023-09-10T00:14:08.542615+0000","last_fullsized":"2023-09-10T00:14:08.542615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:45:45.720325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588781+0000","last_change":"2023-09-10T00:14:07.574858+0000","last_active":"2023-09-10T00:14:07.588781+0000","last_peered":"2023-09-10T00:14:07.588781+0000","last_clean":"2023-09-10T00:14:07.588781+0000","last_became_active":"2023-09-10T00:14:07.573649+0000","last_became_peered":"2023-09-10T00:14:07.573649+0000","last_unstale":"2023-09-10T00:14:07.588781+0000","last_undegraded":"2023-09-10T00:14:07.588781+0000","last_fullsized":"2023-09-10T00:14:07.588781+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.618751+0000","last_change":"2023-09-10T00:14:06.589824+0000","last_active":"2023-09-10T00:14:07.618751+0000","last_peered":"2023-09-10T00:14:07.618751+0000","last_clean":"2023-09-10T00:14:07.618751+0000","last_became_active":"2023-09-10T00:14:06.589158+0000","last_became_peered":"2023-09-10T00:14:06.589158+0000","last_unstale":"2023-09-10T00:14:07.618751+0000","last_undegraded":"2023-09-10T00:14:07.618751+0000","last_fullsized":"2023-09-10T00:14:07.618751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:50:26.142857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.584690+0000","last_change":"2023-09-10T00:14:07.567537+0000","last_active":"2023-09-10T00:14:07.584690+0000","last_peered":"2023-09-10T00:14:07.584690+0000","last_clean":"2023-09-10T00:14:07.584690+0000","last_became_active":"2023-09-10T00:14:07.566724+0000","last_became_peered":"2023-09-10T00:14:07.566724+0000","last_unstale":"2023-09-10T00:14:07.584690+0000","last_undegraded":"2023-09-10T00:14:07.584690+0000","last_fullsized":"2023-09-10T00:14:07.584690+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:11:27.215626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738494+0000","last_change":"2023-09-10T00:14:06.592753+0000","last_active":"2023-09-10T00:14:08.738494+0000","last_peered":"2023-09-10T00:14:08.738494+0000","last_clean":"2023-09-10T00:14:08.738494+0000","last_became_active":"2023-09-10T00:14:06.592180+0000","last_became_peered":"2023-09-10T00:14:06.592180+0000","last_unstale":"2023-09-10T00:14:08.738494+0000","last_undegraded":"2023-09-10T00:14:08.738494+0000","last_fullsized":"2023-09-10T00:14:08.738494+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:25:17.004472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738393+0000","last_change":"2023-09-10T00:14:07.590731+0000","last_active":"2023-09-10T00:14:08.738393+0000","last_peered":"2023-09-10T00:14:08.738393+0000","last_clean":"2023-09-10T00:14:08.738393+0000","last_became_active":"2023-09-10T00:14:07.589855+0000","last_became_peered":"2023-09-10T00:14:07.589855+0000","last_unstale":"2023-09-10T00:14:08.738393+0000","last_undegraded":"2023-09-10T00:14:08.738393+0000","last_fullsized":"2023-09-10T00:14:08.738393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T02:28:05.658631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.544030+0000","last_change":"2023-09-10T00:14:06.590370+0000","last_active":"2023-09-10T00:14:08.544030+0000","last_peered":"2023-09-10T00:14:08.544030+0000","last_clean":"2023-09-10T00:14:08.544030+0000","last_became_active":"2023-09-10T00:14:06.589631+0000","last_became_peered":"2023-09-10T00:14:06.589631+0000","last_unstale":"2023-09-10T00:14:08.544030+0000","last_undegraded":"2023-09-10T00:14:08.544030+0000","last_fullsized":"2023-09-10T00:14:08.544030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:07:12.211071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.543737+0000","last_change":"2023-09-10T00:14:07.582830+0000","last_active":"2023-09-10T00:14:08.543737+0000","last_peered":"2023-09-10T00:14:08.543737+0000","last_clean":"2023-09-10T00:14:08.543737+0000","last_became_active":"2023-09-10T00:14:07.582153+0000","last_became_peered":"2023-09-10T00:14:07.582153+0000","last_unstale":"2023-09-10T00:14:08.543737+0000","last_undegraded":"2023-09-10T00:14:08.543737+0000","last_fullsized":"2023-09-10T00:14:08.543737+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:31.247225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.601285+0000","last_change":"2023-09-10T00:14:06.571749+0000","last_active":"2023-09-10T00:14:07.601285+0000","last_peered":"2023-09-10T00:14:07.601285+0000","last_clean":"2023-09-10T00:14:07.601285+0000","last_became_active":"2023-09-10T00:14:06.571373+0000","last_became_peered":"2023-09-10T00:14:06.571373+0000","last_unstale":"2023-09-10T00:14:07.601285+0000","last_undegraded":"2023-09-10T00:14:07.601285+0000","last_fullsized":"2023-09-10T00:14:07.601285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:05:36.655057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.575361+0000","last_change":"2023-09-10T00:14:07.568644+0000","last_active":"2023-09-10T00:14:07.575361+0000","last_peered":"2023-09-10T00:14:07.575361+0000","last_clean":"2023-09-10T00:14:07.575361+0000","last_became_active":"2023-09-10T00:14:07.567903+0000","last_became_peered":"2023-09-10T00:14:07.567903+0000","last_unstale":"2023-09-10T00:14:07.575361+0000","last_undegraded":"2023-09-10T00:14:07.575361+0000","last_fullsized":"2023-09-10T00:14:07.575361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:42:33.294831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.554267+0000","last_change":"2023-09-10T00:14:06.571387+0000","last_active":"2023-09-10T00:14:07.554267+0000","last_peered":"2023-09-10T00:14:07.554267+0000","last_clean":"2023-09-10T00:14:07.554267+0000","last_became_active":"2023-09-10T00:14:06.571045+0000","last_became_peered":"2023-09-10T00:14:06.571045+0000","last_unstale":"2023-09-10T00:14:07.554267+0000","last_undegraded":"2023-09-10T00:14:07.554267+0000","last_fullsized":"2023-09-10T00:14:07.554267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:32:12.930824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.567820+0000","last_change":"2023-09-10T00:14:07.558672+0000","last_active":"2023-09-10T00:14:07.567820+0000","last_peered":"2023-09-10T00:14:07.567820+0000","last_clean":"2023-09-10T00:14:07.567820+0000","last_became_active":"2023-09-10T00:14:07.557930+0000","last_became_peered":"2023-09-10T00:14:07.557930+0000","last_unstale":"2023-09-10T00:14:07.567820+0000","last_undegraded":"2023-09-10T00:14:07.567820+0000","last_fullsized":"2023-09-10T00:14:07.567820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:19:32.012604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600670+0000","last_change":"2023-09-10T00:14:06.556770+0000","last_active":"2023-09-10T00:14:07.600670+0000","last_peered":"2023-09-10T00:14:07.600670+0000","last_clean":"2023-09-10T00:14:07.600670+0000","last_became_active":"2023-09-10T00:14:06.556495+0000","last_became_peered":"2023-09-10T00:14:06.556495+0000","last_unstale":"2023-09-10T00:14:07.600670+0000","last_undegraded":"2023-09-10T00:14:07.600670+0000","last_fullsized":"2023-09-10T00:14:07.600670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:16:53.015653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.579727+0000","last_change":"2023-09-10T00:14:07.570404+0000","last_active":"2023-09-10T00:14:07.579727+0000","last_peered":"2023-09-10T00:14:07.579727+0000","last_clean":"2023-09-10T00:14:07.579727+0000","last_became_active":"2023-09-10T00:14:07.569621+0000","last_became_peered":"2023-09-10T00:14:07.569621+0000","last_unstale":"2023-09-10T00:14:07.579727+0000","last_undegraded":"2023-09-10T00:14:07.579727+0000","last_fullsized":"2023-09-10T00:14:07.579727+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:19:32.012604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.537238+0000","last_change":"2023-09-10T00:14:06.571225+0000","last_active":"2023-09-10T00:14:07.537238+0000","last_peered":"2023-09-10T00:14:07.537238+0000","last_clean":"2023-09-10T00:14:07.537238+0000","last_became_active":"2023-09-10T00:14:06.570938+0000","last_became_peered":"2023-09-10T00:14:06.570938+0000","last_unstale":"2023-09-10T00:14:07.537238+0000","last_undegraded":"2023-09-10T00:14:07.537238+0000","last_fullsized":"2023-09-10T00:14:07.537238+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:14:48.938669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.737545+0000","last_change":"2023-09-10T00:14:07.590985+0000","last_active":"2023-09-10T00:14:08.737545+0000","last_peered":"2023-09-10T00:14:08.737545+0000","last_clean":"2023-09-10T00:14:08.737545+0000","last_became_active":"2023-09-10T00:14:07.590385+0000","last_became_peered":"2023-09-10T00:14:07.590385+0000","last_unstale":"2023-09-10T00:14:08.737545+0000","last_undegraded":"2023-09-10T00:14:08.737545+0000","last_fullsized":"2023-09-10T00:14:08.737545+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:46:12.362075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.543043+0000","last_change":"2023-09-10T00:14:06.583998+0000","last_active":"2023-09-10T00:14:07.543043+0000","last_peered":"2023-09-10T00:14:07.543043+0000","last_clean":"2023-09-10T00:14:07.543043+0000","last_became_active":"2023-09-10T00:14:06.583255+0000","last_became_peered":"2023-09-10T00:14:06.583255+0000","last_unstale":"2023-09-10T00:14:07.543043+0000","last_undegraded":"2023-09-10T00:14:07.543043+0000","last_fullsized":"2023-09-10T00:14:07.543043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:38:27.437329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.588662+0000","last_change":"2023-09-10T00:14:07.570386+0000","last_active":"2023-09-10T00:14:07.588662+0000","last_peered":"2023-09-10T00:14:07.588662+0000","last_clean":"2023-09-10T00:14:07.588662+0000","last_became_active":"2023-09-10T00:14:07.569531+0000","last_became_peered":"2023-09-10T00:14:07.569531+0000","last_unstale":"2023-09-10T00:14:07.588662+0000","last_undegraded":"2023-09-10T00:14:07.588662+0000","last_fullsized":"2023-09-10T00:14:07.588662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T08:34:25.751953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.537216+0000","last_change":"2023-09-10T00:14:06.556190+0000","last_active":"2023-09-10T00:14:07.537216+0000","last_peered":"2023-09-10T00:14:07.537216+0000","last_clean":"2023-09-10T00:14:07.537216+0000","last_became_active":"2023-09-10T00:14:06.555869+0000","last_became_peered":"2023-09-10T00:14:06.555869+0000","last_unstale":"2023-09-10T00:14:07.537216+0000","last_undegraded":"2023-09-10T00:14:07.537216+0000","last_fullsized":"2023-09-10T00:14:07.537216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:40.845518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.608440+0000","last_change":"2023-09-10T00:14:07.605262+0000","last_active":"2023-09-10T00:14:07.608440+0000","last_peered":"2023-09-10T00:14:07.608440+0000","last_clean":"2023-09-10T00:14:07.608440+0000","last_became_active":"2023-09-10T00:14:07.604893+0000","last_became_peered":"2023-09-10T00:14:07.604893+0000","last_unstale":"2023-09-10T00:14:07.608440+0000","last_undegraded":"2023-09-10T00:14:07.608440+0000","last_fullsized":"2023-09-10T00:14:07.608440+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T12:02:25.264837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738622+0000","last_change":"2023-09-10T00:14:06.587287+0000","last_active":"2023-09-10T00:14:08.738622+0000","last_peered":"2023-09-10T00:14:08.738622+0000","last_clean":"2023-09-10T00:14:08.738622+0000","last_became_active":"2023-09-10T00:14:06.586641+0000","last_became_peered":"2023-09-10T00:14:06.586641+0000","last_unstale":"2023-09-10T00:14:08.738622+0000","last_undegraded":"2023-09-10T00:14:08.738622+0000","last_fullsized":"2023-09-10T00:14:08.738622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:24:38.625991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.570513+0000","last_change":"2023-09-10T00:14:07.559714+0000","last_active":"2023-09-10T00:14:07.570513+0000","last_peered":"2023-09-10T00:14:07.570513+0000","last_clean":"2023-09-10T00:14:07.570513+0000","last_became_active":"2023-09-10T00:14:07.558526+0000","last_became_peered":"2023-09-10T00:14:07.558526+0000","last_unstale":"2023-09-10T00:14:07.570513+0000","last_undegraded":"2023-09-10T00:14:07.570513+0000","last_fullsized":"2023-09-10T00:14:07.570513+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:34:47.576271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.538172+0000","last_change":"2023-09-10T00:14:06.589333+0000","last_active":"2023-09-10T00:14:07.538172+0000","last_peered":"2023-09-10T00:14:07.538172+0000","last_clean":"2023-09-10T00:14:07.538172+0000","last_became_active":"2023-09-10T00:14:06.588958+0000","last_became_peered":"2023-09-10T00:14:06.588958+0000","last_unstale":"2023-09-10T00:14:07.538172+0000","last_undegraded":"2023-09-10T00:14:07.538172+0000","last_fullsized":"2023-09-10T00:14:07.538172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T03:51:18.261628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.600829+0000","last_change":"2023-09-10T00:14:07.594469+0000","last_active":"2023-09-10T00:14:07.600829+0000","last_peered":"2023-09-10T00:14:07.600829+0000","last_clean":"2023-09-10T00:14:07.600829+0000","last_became_active":"2023-09-10T00:14:07.594172+0000","last_became_peered":"2023-09-10T00:14:07.594172+0000","last_unstale":"2023-09-10T00:14:07.600829+0000","last_undegraded":"2023-09-10T00:14:07.600829+0000","last_fullsized":"2023-09-10T00:14:07.600829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T04:30:28.746506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.562508+0000","last_change":"2023-09-10T00:14:06.558665+0000","last_active":"2023-09-10T00:14:07.562508+0000","last_peered":"2023-09-10T00:14:07.562508+0000","last_clean":"2023-09-10T00:14:07.562508+0000","last_became_active":"2023-09-10T00:14:06.558380+0000","last_became_peered":"2023-09-10T00:14:06.558380+0000","last_unstale":"2023-09-10T00:14:07.562508+0000","last_undegraded":"2023-09-10T00:14:07.562508+0000","last_fullsized":"2023-09-10T00:14:07.562508+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:31:55.011004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.585489+0000","last_change":"2023-09-10T00:14:07.574804+0000","last_active":"2023-09-10T00:14:07.585489+0000","last_peered":"2023-09-10T00:14:07.585489+0000","last_clean":"2023-09-10T00:14:07.585489+0000","last_became_active":"2023-09-10T00:14:07.573314+0000","last_became_peered":"2023-09-10T00:14:07.573314+0000","last_unstale":"2023-09-10T00:14:07.585489+0000","last_undegraded":"2023-09-10T00:14:07.585489+0000","last_fullsized":"2023-09-10T00:14:07.585489+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:58:32.798976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.562796+0000","last_change":"2023-09-10T00:14:06.577540+0000","last_active":"2023-09-10T00:14:07.562796+0000","last_peered":"2023-09-10T00:14:07.562796+0000","last_clean":"2023-09-10T00:14:07.562796+0000","last_became_active":"2023-09-10T00:14:06.577148+0000","last_became_peered":"2023-09-10T00:14:06.577148+0000","last_unstale":"2023-09-10T00:14:07.562796+0000","last_undegraded":"2023-09-10T00:14:07.562796+0000","last_fullsized":"2023-09-10T00:14:07.562796+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.580636+0000","last_change":"2023-09-10T00:14:07.568013+0000","last_active":"2023-09-10T00:14:07.580636+0000","last_peered":"2023-09-10T00:14:07.580636+0000","last_clean":"2023-09-10T00:14:07.580636+0000","last_became_active":"2023-09-10T00:14:07.567253+0000","last_became_peered":"2023-09-10T00:14:07.567253+0000","last_unstale":"2023-09-10T00:14:07.580636+0000","last_undegraded":"2023-09-10T00:14:07.580636+0000","last_fullsized":"2023-09-10T00:14:07.580636+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T12:10:19.630721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542870+0000","last_change":"2023-09-10T00:14:06.569435+0000","last_active":"2023-09-10T00:14:08.542870+0000","last_peered":"2023-09-10T00:14:08.542870+0000","last_clean":"2023-09-10T00:14:08.542870+0000","last_became_active":"2023-09-10T00:14:06.568679+0000","last_became_peered":"2023-09-10T00:14:06.568679+0000","last_unstale":"2023-09-10T00:14:08.542870+0000","last_undegraded":"2023-09-10T00:14:08.542870+0000","last_fullsized":"2023-09-10T00:14:08.542870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:01:21.714136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542593+0000","last_change":"2023-09-10T00:14:07.596338+0000","last_active":"2023-09-10T00:14:08.542593+0000","last_peered":"2023-09-10T00:14:08.542593+0000","last_clean":"2023-09-10T00:14:08.542593+0000","last_became_active":"2023-09-10T00:14:07.594641+0000","last_became_peered":"2023-09-10T00:14:07.594641+0000","last_unstale":"2023-09-10T00:14:08.542593+0000","last_undegraded":"2023-09-10T00:14:08.542593+0000","last_fullsized":"2023-09-10T00:14:08.542593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T07:32:02.021362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.542071+0000","last_change":"2023-09-10T00:14:06.568522+0000","last_active":"2023-09-10T00:14:08.542071+0000","last_peered":"2023-09-10T00:14:08.542071+0000","last_clean":"2023-09-10T00:14:08.542071+0000","last_became_active":"2023-09-10T00:14:06.567687+0000","last_became_peered":"2023-09-10T00:14:06.567687+0000","last_unstale":"2023-09-10T00:14:08.542071+0000","last_undegraded":"2023-09-10T00:14:08.542071+0000","last_fullsized":"2023-09-10T00:14:08.542071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T00:54:19.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.567749+0000","last_change":"2023-09-10T00:14:07.558085+0000","last_active":"2023-09-10T00:14:07.567749+0000","last_peered":"2023-09-10T00:14:07.567749+0000","last_clean":"2023-09-10T00:14:07.567749+0000","last_became_active":"2023-09-10T00:14:07.557304+0000","last_became_peered":"2023-09-10T00:14:07.557304+0000","last_unstale":"2023-09-10T00:14:07.567749+0000","last_undegraded":"2023-09-10T00:14:07.567749+0000","last_fullsized":"2023-09-10T00:14:07.567749+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T06:01:22.718576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.546539+0000","last_change":"2023-09-10T00:14:06.558375+0000","last_active":"2023-09-10T00:14:07.546539+0000","last_peered":"2023-09-10T00:14:07.546539+0000","last_clean":"2023-09-10T00:14:07.546539+0000","last_became_active":"2023-09-10T00:14:06.558088+0000","last_became_peered":"2023-09-10T00:14:06.558088+0000","last_unstale":"2023-09-10T00:14:07.546539+0000","last_undegraded":"2023-09-10T00:14:07.546539+0000","last_fullsized":"2023-09-10T00:14:07.546539+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T01:15:30.242785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-09-10T00:14:08.738341+0000","last_change":"2023-09-10T00:14:07.595745+0000","last_active":"2023-09-10T00:14:08.738341+0000","last_peered":"2023-09-10T00:14:08.738341+0000","last_clean":"2023-09-10T00:14:08.738341+0000","last_became_active":"2023-09-10T00:14:07.595037+0000","last_became_peered":"2023-09-10T00:14:07.595037+0000","last_unstale":"2023-09-10T00:14:08.738341+0000","last_undegraded":"2023-09-10T00:14:08.738341+0000","last_fullsized":"2023-09-10T00:14:08.738341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:06.525568+0000","last_clean_scrub_stamp":"2023-09-10T00:14:06.525568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T05:02:51.052910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-09-10T00:14:07.544464+0000","last_change":"2023-09-10T00:14:06.588872+0000","last_active":"2023-09-10T00:14:07.544464+0000","last_peered":"2023-09-10T00:14:07.544464+0000","last_clean":"2023-09-10T00:14:07.544464+0000","last_became_active":"2023-09-10T00:14:06.587817+0000","last_became_peered":"2023-09-10T00:14:06.587817+0000","last_unstale":"2023-09-10T00:14:07.544464+0000","last_undegraded":"2023-09-10T00:14:07.544464+0000","last_fullsized":"2023-09-10T00:14:07.544464+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:14:05.521128+0000","last_clean_scrub_stamp":"2023-09-10T00:14:05.521128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:49:52.242117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-09-10T00:14:06.569046+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T00:14:06.569046+0000","last_peered":"2023-09-10T00:14:06.569046+0000","last_clean":"2023-09-10T00:14:06.569046+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T00:14:06.569046+0000","last_undegraded":"2023-09-10T00:14:06.569046+0000","last_fullsized":"2023-09-10T00:14:06.569046+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1052672,"data_stored":783240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.496}]},{"osd":1,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.123},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0640000000000001}]},{"osd":4,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0369999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.002},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98599999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":191772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":3.7639999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":4.6790000000000003}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":2.0169999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":3.0579999999999998}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":4.7809999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":2.109}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":3.1629999999999998},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":4.54}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":7.5049999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.411,"5min":1.411,"15min":1.411},"last":8.5790000000000006}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":14.475},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":14.391}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":2.972},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":2.1890000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":191302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":5.4390000000000001,"5min":5.4390000000000001,"15min":5.4390000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.61699999999999999}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":5.5279999999999996,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.93700000000000006}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":3.7040000000000002,"5min":3.7040000000000002,"15min":3.7040000000000002},"last":1.173}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":6.2629999999999999,"5min":6.2629999999999999,"15min":6.2629999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":1.337},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":6.1710000000000003,"5min":6.1710000000000003,"15min":6.1710000000000003},"last":1.2929999999999999}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":1.123},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":1.258}]}]},{"osd":4,"up_from":15,"seq":64424509462,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":191794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.248},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.1499999999999999}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.929,"5min":1.929,"15min":1.929},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.91900000000000004}]},{"osd":3,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.137,"5min":2.137,"15min":2.137},"last":1.204}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.1100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":184095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.68700000000000006}]},{"osd":2,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.752}]},{"osd":4,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1100000000000001}]},{"osd":5,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.0489999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":1.075}]},{"osd":7,"last update":"Sun Sep 10 00:13:29 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.1819999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":184095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98599999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.0289999999999999}]},{"osd":6,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.085}]},{"osd":7,"last update":"Sun Sep 10 00:13:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.224},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.1299999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":191280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.29799999999999999}]},{"osd":2,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.377},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.73999999999999999}]},{"osd":5,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.915,"5min":1.915,"15min":1.915},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.79500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":774463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.77600000000000002}]},{"osd":2,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.5739999999999998,"5min":3.5739999999999998,"15min":3.5739999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Sep 10 00:13:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.91900000000000004}]},{"osd":5,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.085}]},{"osd":7,"last update":"Sun Sep 10 00:13:31 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.135}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T00:14:10.964 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-10T00:14:10.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-09-10T00:14:11.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- 172.21.15.84:0/2676124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4514158a50 msgr2=0x7f45140cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- 172.21.15.84:0/2676124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4514158a50 0x7f45140cdd90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f45140b02d0 tx=0x7f450401c5b0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- 172.21.15.84:0/2676124734 shutdown_connections 2023-09-10T00:14:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- 172.21.15.84:0/2676124734 >> v2:172.21.15.100:3300/0 conn(0x7f45140c95f0 0x7f45140cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- 172.21.15.84:0/2676124734 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45140ce2d0 0x7f45140c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- 172.21.15.84:0/2676124734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4514158a50 0x7f45140cdd90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- 172.21.15.84:0/2676124734 >> 172.21.15.84:0/2676124734 conn(0x7f45140ce850 msgr2=0x7f45140cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- 172.21.15.84:0/2676124734 shutdown_connections 2023-09-10T00:14:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- 172.21.15.84:0/2676124734 wait complete. 2023-09-10T00:14:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 Processor -- start 2023-09-10T00:14:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- start start 2023-09-10T00:14:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45140c95f0 0x7f45141556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4514158a50 0x7f4514160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514162170 con 0x7f45140ce2d0 2023-09-10T00:14:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4514155c10 con 0x7f45140c95f0 2023-09-10T00:14:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4518f9f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45140c7410 con 0x7f4514158a50 2023-09-10T00:14:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46858/0 (socket says 172.21.15.84:46858) 2023-09-10T00:14:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 -- 172.21.15.84:0/1146944737 learned_addr learned my addr 172.21.15.84:0/1146944737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f451259c640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45140c95f0 0x7f45141556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4512d9d640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4514158a50 0x7f4514160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 -- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4514158a50 msgr2=0x7f4514160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4514158a50 0x7f4514160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 -- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45140c95f0 msgr2=0x7f45141556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45140c95f0 0x7f45141556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.092+0000 7f4511d9b640 1 -- 172.21.15.84:0/1146944737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009560 con 0x7f45140ce2d0 2023-09-10T00:14:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4511d9b640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f450800c970 tx=0x7f450800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508004220 con 0x7f45140ce2d0 2023-09-10T00:14:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4508004490 con 0x7f45140ce2d0 2023-09-10T00:14:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45140c76f0 con 0x7f45140ce2d0 2023-09-10T00:14:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508007c10 con 0x7f45140ce2d0 2023-09-10T00:14:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45140c7cb0 con 0x7f45140ce2d0 2023-09-10T00:14:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451406f210 con 0x7f45140ce2d0 2023-09-10T00:14:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4508003620 con 0x7f45140ce2d0 2023-09-10T00:14:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 0x7f44f4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4508083600 con 0x7f45140ce2d0 2023-09-10T00:14:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f451259c640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 0x7f44f4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.096+0000 7f451259c640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 0x7f44f4068010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f45040ae000 tx=0x7f450401adf0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.100+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4508050d90 con 0x7f45140ce2d0 2023-09-10T00:14:11.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.292+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f45140cf760 con 0x7f45140ce2d0 2023-09-10T00:14:11.304 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4502ffd640 1 -- 172.21.15.84:0/1146944737 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f45080543b0 con 0x7f45140ce2d0 2023-09-10T00:14:11.305 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2023-09-10T00:14:11.305 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC+Cf1kBBJYARAANCeEIrMyww1eYb9zY89mOw== 2023-09-10T00:14:11.305 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow" 2023-09-10T00:14:11.306 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow r" 2023-09-10T00:14:11.306 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-09-10T00:14:11.307 INFO:teuthology.orchestra.run.smithi084.stderr:updated caps for client.0 2023-09-10T00:14:11.307 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 msgr2=0x7f44f4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 0x7f44f4068010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f45040ae000 tx=0x7f450401adf0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 msgr2=0x7f45140c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f450800c970 tx=0x7f450800ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:11.308 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 shutdown_connections 2023-09-10T00:14:11.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f44f4065b50 0x7f44f4068010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4514158a50 0x7f4514160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45140ce2d0 0x7f45140c3d90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 --2- 172.21.15.84:0/1146944737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45140c95f0 0x7f45141556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 >> 172.21.15.84:0/1146944737 conn(0x7f45140ce850 msgr2=0x7f451415b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:11.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 shutdown_connections 2023-09-10T00:14:11.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.300+0000 7f4518f9f640 1 -- 172.21.15.84:0/1146944737 wait complete. 2023-09-10T00:14:11.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T00:14:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- 172.21.15.84:0/396217466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 msgr2=0x7f8274004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 --2- 172.21.15.84:0/396217466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f8274004c50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f82880cc060 tx=0x7f827801d1f0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- 172.21.15.84:0/396217466 shutdown_connections 2023-09-10T00:14:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 --2- 172.21.15.84:0/396217466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f8274004c50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- 172.21.15.84:0/396217466 >> 172.21.15.84:0/396217466 conn(0x7f82880b25b0 msgr2=0x7f82880b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- 172.21.15.84:0/396217466 shutdown_connections 2023-09-10T00:14:11.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- 172.21.15.84:0/396217466 wait complete. 2023-09-10T00:14:11.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 Processor -- start 2023-09-10T00:14:11.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.440+0000 7f828f53b640 1 -- start start 2023-09-10T00:14:11.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f828815d3b0 0x7f828815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 0x7f82880ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828806afb0 con 0x7f82740047d0 2023-09-10T00:14:11.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828814e780 con 0x7f828815d3b0 2023-09-10T00:14:11.451 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828815dd70 con 0x7f82880ca100 2023-09-10T00:14:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46868/0 (socket says 172.21.15.84:46868) 2023-09-10T00:14:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 -- 172.21.15.84:0/2696770729 learned_addr learned my addr 172.21.15.84:0/2696770729 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828dad8640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 0x7f82880ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828cad6640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f828815d3b0 0x7f828815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 -- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 msgr2=0x7f82880ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 0x7f82880ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 -- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f828815d3b0 msgr2=0x7f828815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f828815d3b0 0x7f828815d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 -- 172.21.15.84:0/2696770729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82880caac0 con 0x7f82740047d0 2023-09-10T00:14:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828dad8640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 0x7f82880ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828d2d7640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f828400d4b0 tx=0x7f828400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284012630 con 0x7f82740047d0 2023-09-10T00:14:11.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8284012790 con 0x7f82740047d0 2023-09-10T00:14:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828814db00 con 0x7f82740047d0 2023-09-10T00:14:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284012b60 con 0x7f82740047d0 2023-09-10T00:14:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828814e0c0 con 0x7f82740047d0 2023-09-10T00:14:11.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828814e9f0 con 0x7f82740047d0 2023-09-10T00:14:11.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f828401b400 con 0x7f82740047d0 2023-09-10T00:14:11.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 0x7f826c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:11.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82840835f0 con 0x7f82740047d0 2023-09-10T00:14:11.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.444+0000 7f828cad6640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 0x7f826c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:11.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.448+0000 7f828cad6640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 0x7f826c067fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82780ae000 tx=0x7f8278019f90 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:11.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.448+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8284054950 con 0x7f82740047d0 2023-09-10T00:14:11.640 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.632+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f828806c610 con 0x7f82740047d0 2023-09-10T00:14:11.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f827dffb640 1 -- 172.21.15.84:0/2696770729 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f8284001130 con 0x7f82740047d0 2023-09-10T00:14:11.641 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:11.642 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T00:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T00:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 msgr2=0x7f826c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 0x7f826c067fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82780ae000 tx=0x7f8278019f90 comp rx=0 tx=0).stop 2023-09-10T00:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 msgr2=0x7f828814d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:11.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f828400d4b0 tx=0x7f828400d970 comp rx=0 tx=0).stop 2023-09-10T00:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 shutdown_connections 2023-09-10T00:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f826c065b20 0x7f826c067fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82880ca100 0x7f82880ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f828815d3b0 0x7f828815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 --2- 172.21.15.84:0/2696770729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82740047d0 0x7f828814d190 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 >> 172.21.15.84:0/2696770729 conn(0x7f82880b25b0 msgr2=0x7f82880b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 shutdown_connections 2023-09-10T00:14:11.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:11.636+0000 7f828f53b640 1 -- 172.21.15.84:0/2696770729 wait complete. 2023-09-10T00:14:11.932 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T00:14:11.928+0000 7f9ccef27640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-10T00:14:12.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-10T00:14:06.904563+0000', 'modified': '2023-09-10T00:14:08.908584+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5619': {'gid': 5619, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.84:6836/2849085608', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.84:6834', 'nonce': 2849085608}, {'type': 'v1', 'addr': '172.21.15.84:6836', 'nonce': 2849085608}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-10T00:14:12.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-10T00:14:12.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-10T00:14:12.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 -- 172.21.15.84:0/3006471095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 msgr2=0x7ff45015b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 --2- 172.21.15.84:0/3006471095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff45015b160 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff4500b31d0 tx=0x7ff44001f090 comp rx=0 tx=0).stop 2023-09-10T00:14:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 -- 172.21.15.84:0/3006471095 shutdown_connections 2023-09-10T00:14:12.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 --2- 172.21.15.84:0/3006471095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff45015b160 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 --2- 172.21.15.84:0/3006471095 >> v2:172.21.15.100:3300/0 conn(0x7ff4500b6740 0x7ff4500b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 --2- 172.21.15.84:0/3006471095 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff45015ad80 0x7ff4500695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 -- 172.21.15.84:0/3006471095 >> 172.21.15.84:0/3006471095 conn(0x7ff4500d0b30 msgr2=0x7ff4500d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 -- 172.21.15.84:0/3006471095 shutdown_connections 2023-09-10T00:14:12.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.196+0000 7ff4568da640 1 -- 172.21.15.84:0/3006471095 wait complete. 2023-09-10T00:14:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 Processor -- start 2023-09-10T00:14:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- start start 2023-09-10T00:14:12.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4500b6740 0x7ff4500c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff45015ad80 0x7ff45015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500c9600 con 0x7ff4500b2af0 2023-09-10T00:14:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500c8c60 con 0x7ff4500b6740 2023-09-10T00:14:12.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4500c8f40 con 0x7ff45015ad80 2023-09-10T00:14:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46878/0 (socket says 172.21.15.84:46878) 2023-09-10T00:14:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 -- 172.21.15.84:0/3545883786 learned_addr learned my addr 172.21.15.84:0/3545883786 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 -- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff45015ad80 msgr2=0x7ff45015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff45015ad80 0x7ff45015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 -- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4500b6740 msgr2=0x7ff4500c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4500b6740 0x7ff4500c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 -- 172.21.15.84:0/3545883786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009560 con 0x7ff4500b2af0 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff44800eb00 tx=0x7ff44800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 -- 172.21.15.84:0/3545883786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004b30 con 0x7ff4500b2af0 2023-09-10T00:14:12.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 -- 172.21.15.84:0/3545883786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff448004cb0 con 0x7ff4500b2af0 2023-09-10T00:14:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4500c9220 con 0x7ff4500b2af0 2023-09-10T00:14:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 -- 172.21.15.84:0/3545883786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448005280 con 0x7ff4500b2af0 2023-09-10T00:14:12.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501e57d0 con 0x7ff4500b2af0 2023-09-10T00:14:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 -- 172.21.15.84:0/3545883786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff4480053e0 con 0x7ff4500b2af0 2023-09-10T00:14:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 0x7ff430067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44cff9640 1 -- 172.21.15.84:0/3545883786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff448014070 con 0x7ff4500b2af0 2023-09-10T00:14:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.200+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 0x7ff430067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 0x7ff430067fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff4500c75f0 tx=0x7ff438005f50 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 Processor -- start 2023-09-10T00:14:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- start start 2023-09-10T00:14:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb981df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb982710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7d9510 con 0x5596fb9cbed0 2023-09-10T00:14:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7d6a40 con 0x5596fb982330 2023-09-10T00:14:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7d2330 con 0x5596fb9cc7f0 2023-09-10T00:14:12.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46886/0 (socket says 172.21.15.84:46886) 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 -- 172.21.15.84:0/3399752450 learned_addr learned my addr 172.21.15.84:0/3399752450 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 -- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 msgr2=0x5596fb981df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb981df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 -- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 msgr2=0x5596fb982710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb982710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 -- 172.21.15.84:0/3399752450 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596fb4cc890 con 0x5596fb9cbed0 2023-09-10T00:14:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff448051bb0 tx=0x7ff448055320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff8dd72d743a7c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff445ffb640 1 -- 172.21.15.84:0/3399752450 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4480556b0 con 0x5596fb9cbed0 2023-09-10T00:14:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff445ffb640 1 -- 172.21.15.84:0/3399752450 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff44805d690 con 0x5596fb9cbed0 2023-09-10T00:14:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff445ffb640 1 -- 172.21.15.84:0/3399752450 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448051dc0 con 0x5596fb9cbed0 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- 172.21.15.84:0/3399752450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 msgr2=0x5596fb9cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff448051bb0 tx=0x7ff448055320 comp rx=0 tx=0).stop 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- 172.21.15.84:0/3399752450 shutdown_connections 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb982710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb981df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- 172.21.15.84:0/3399752450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9cc2b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- 172.21.15.84:0/3399752450 >> 172.21.15.84:0/3399752450 conn(0x5596fb988490 msgr2=0x5596fb9806d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- 172.21.15.84:0/3399752450 shutdown_connections 2023-09-10T00:14:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- 172.21.15.84:0/3399752450 wait complete. 2023-09-10T00:14:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- start start 2023-09-10T00:14:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 Processor -- start 2023-09-10T00:14:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb98ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb98d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb78ced0 con 0x5596fb9cbed0 2023-09-10T00:14:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb78cb70 con 0x5596fb982330 2023-09-10T00:14:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596fb48d940 con 0x5596fb9cc7f0 2023-09-10T00:14:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff459a07000 10 client.0 _ll_register_callbacks cb 0x5596fb8a04a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:14:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46888/0 (socket says 172.21.15.84:46888) 2023-09-10T00:14:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.204+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1834794897 learned_addr learned my addr 172.21.15.84:0/1834794897 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff454e77640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb98d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb98ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 msgr2=0x5596fb98d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb98d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 msgr2=0x5596fb98ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb98ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1834794897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501e57d0 con 0x5596fb9cbed0 2023-09-10T00:14:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb98ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T00:14:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff43800de70 tx=0x7ff438010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f7a6ba13e8be8b server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:14:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43801e630 con 0x5596fb9cbed0 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596fb789880 con 0x5596fb9cbed0 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff438005c60 con 0x5596fb9cbed0 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4380047d0 con 0x5596fb9cbed0 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 10 client.5805 fetch_fsmap learned FSMap version 16 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5596fb795290 con 0x5596fb9cbed0 2023-09-10T00:14:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5596fb789880 con 0x5596fb9cbed0 2023-09-10T00:14:12.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff4380049b0 con 0x5596fb9cbed0 2023-09-10T00:14:12.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 10 client.5805 fetch_fsmap finished waiting for FSMap version 16 2023-09-10T00:14:12.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 10 client.5805 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-10T00:14:12.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 20 client.5805 populate_metadata read hostname 'smithi084' 2023-09-10T00:14:12.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fb9db170 0x5596fb9dd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 4 client.5805 mds_command: new command op to 5619 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-10T00:14:12.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 --> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596fb792700 con 0x5596fb9db170 2023-09-10T00:14:12.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fb9db170 0x5596fb9dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 10 client.5805 ms_handle_connect on v2:172.21.15.84:6834/2849085608 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fb9db170 0x5596fb9dd560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae6f7348f4386e38 server_cookie=d6a2acb5496a399e in_seq=0 out_seq=0 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 1 -- 172.21.15.84:0/1834794897 <== mds.0 v2:172.21.15.84:6834/2849085608 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5596fb792700 con 0x5596fb9db170 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 10 client.5805 handle_command_reply: tid=0 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 client.5805 shutdown 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 msgr2=0x5596fb98d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff43800de70 tx=0x7ff438010830 comp rx=0 tx=0).stop 2023-09-10T00:14:12.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 shutdown_connections 2023-09-10T00:14:12.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fb98d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb98d3d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fb9db170 0x5596fb9dd560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 --2- 172.21.15.84:0/1834794897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb982330 0x5596fb98ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff42effd640 0 client.5805 ms_handle_reset on v2:172.21.15.84:6834/2849085608 2023-09-10T00:14:12.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 >> 172.21.15.84:0/1834794897 conn(0x5596fb988490 msgr2=0x5596fb980dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 shutdown_connections 2023-09-10T00:14:12.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 1 -- 172.21.15.84:0/1834794897 wait complete. 2023-09-10T00:14:12.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.208+0000 7ff459a07000 20 client.5805 trim_cache size 0 max 16384 2023-09-10T00:14:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 Processor -- start 2023-09-10T00:14:12.237 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- start start 2023-09-10T00:14:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cbed0 0x5596fba26eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fba273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.238 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7d11c0 con 0x5596fb982330 2023-09-10T00:14:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7dc1b0 con 0x5596fb9cbed0 2023-09-10T00:14:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596fb98a100 con 0x5596fb9cc7f0 2023-09-10T00:14:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46892/0 (socket says 172.21.15.84:46892) 2023-09-10T00:14:12.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 -- 172.21.15.84:0/1569839106 learned_addr learned my addr 172.21.15.84:0/1569839106 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 -- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 msgr2=0x5596fba273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fba273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 -- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cbed0 msgr2=0x5596fba26eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cbed0 0x5596fba26eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 -- 172.21.15.84:0/1569839106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596fb77b500 con 0x5596fb982330 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff4480553b0 tx=0x7ff44806a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5415ebb58621bd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff4467fc640 1 -- 172.21.15.84:0/1569839106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448070070 con 0x5596fb982330 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff4467fc640 1 -- 172.21.15.84:0/1569839106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4480822a0 con 0x5596fb982330 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff4467fc640 1 -- 172.21.15.84:0/1569839106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448053a50 con 0x5596fb982330 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- 172.21.15.84:0/1569839106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 msgr2=0x5596fba26970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff4480553b0 tx=0x7ff44806a040 comp rx=0 tx=0).stop 2023-09-10T00:14:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- 172.21.15.84:0/1569839106 shutdown_connections 2023-09-10T00:14:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb9cc7f0 0x5596fba273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cbed0 0x5596fba26eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 --2- 172.21.15.84:0/1569839106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb982330 0x5596fba26970 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.242 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- 172.21.15.84:0/1569839106 >> 172.21.15.84:0/1569839106 conn(0x5596fb988490 msgr2=0x5596fb9de470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- 172.21.15.84:0/1569839106 shutdown_connections 2023-09-10T00:14:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.224+0000 7ff459a07000 1 -- 172.21.15.84:0/1569839106 wait complete. 2023-09-10T00:14:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- start start 2023-09-10T00:14:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 Processor -- start 2023-09-10T00:14:12.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb982330 0x5596fba262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cc7f0 0x5596fb9caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb98d0c0 con 0x5596fb9cbed0 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596fb76ddb0 con 0x5596fb9cc7f0 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596fb7cb6e0 con 0x5596fb982330 2023-09-10T00:14:12.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 10 client.0 _ll_register_callbacks cb 0x5596fb771e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-10T00:14:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46906/0 (socket says 172.21.15.84:46906) 2023-09-10T00:14:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1630445612 learned_addr learned my addr 172.21.15.84:0/1630445612 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb982330 0x5596fba262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb982330 msgr2=0x5596fba262e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb982330 0x5596fba262e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff454e77640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cc7f0 0x5596fb9caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cc7f0 msgr2=0x5596fb9caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cc7f0 0x5596fb9caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 -- 172.21.15.84:0/1630445612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596fb4cc890 con 0x5596fb9cbed0 2023-09-10T00:14:12.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44f7fe640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff438004640 tx=0x7ff4380052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491c4252981cb4f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2023-09-10T00:14:12.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43801e630 con 0x5596fb9cbed0 2023-09-10T00:14:12.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff43800d700 con 0x5596fb9cbed0 2023-09-10T00:14:12.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596fb985aa0 con 0x5596fb9cbed0 2023-09-10T00:14:12.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4380056d0 con 0x5596fb9cbed0 2023-09-10T00:14:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 10 client.5811 fetch_fsmap learned FSMap version 16 2023-09-10T00:14:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5596fb4cccc0 con 0x5596fb9cbed0 2023-09-10T00:14:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5596fb985aa0 con 0x5596fb9cbed0 2023-09-10T00:14:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff438034020 con 0x5596fb9cbed0 2023-09-10T00:14:12.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 10 client.5811 fetch_fsmap finished waiting for FSMap version 16 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 10 client.5811 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 20 client.5811 populate_metadata read hostname 'smithi084' 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fba27000 0x5596fba273e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 4 client.5811 mds_command: new command op to 5619 tid=0[{"prefix": "status"}] 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 --> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5596fb7d8310 con 0x5596fba27000 2023-09-10T00:14:12.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fba27000 0x5596fba273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 10 client.5811 ms_handle_connect on v2:172.21.15.84:6834/2849085608 2023-09-10T00:14:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fba27000 0x5596fba273e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2725a2f61345a890 server_cookie=4771380a9668e26a in_seq=0 out_seq=0 2023-09-10T00:14:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 1 -- 172.21.15.84:0/1630445612 <== mds.0 v2:172.21.15.84:6834/2849085608 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5596fb7d8310 con 0x5596fba27000 2023-09-10T00:14:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 10 client.5811 handle_command_reply: tid=0 2023-09-10T00:14:12.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 client.5811 shutdown 2023-09-10T00:14:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 msgr2=0x5596fb9caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff438004640 tx=0x7ff4380052d0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 shutdown_connections 2023-09-10T00:14:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:6834/2849085608,v1:172.21.15.84:6836/2849085608] conn(0x5596fba27000 0x5596fba273e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.251 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596fb9cc7f0 0x5596fb9caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff42effd640 0 client.5811 ms_handle_reset on v2:172.21.15.84:6834/2849085608 2023-09-10T00:14:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5596fb9cbed0 0x5596fb9caa30 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 --2- 172.21.15.84:0/1630445612 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5596fb982330 0x5596fba262e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 >> 172.21.15.84:0/1630445612 conn(0x5596fb988490 msgr2=0x5596fb9deb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 shutdown_connections 2023-09-10T00:14:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 1 -- 172.21.15.84:0/1630445612 wait complete. 2023-09-10T00:14:12.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff459a07000 20 client.5811 trim_cache size 0 max 16384 2023-09-10T00:14:12.253 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:14:12.253 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "af9d6115-2022-4a0a-92c0-a49edd021b51", 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5619, 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2023-09-10T00:14:12.254 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 4.6503254959999998, 2023-09-10T00:14:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 16, 2023-09-10T00:14:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 40, 2023-09-10T00:14:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 40, 2023-09-10T00:14:12.255 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 12.184084795 2023-09-10T00:14:12.255 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:14:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 msgr2=0x7ff430067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 0x7ff430067fe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff4500c75f0 tx=0x7ff438005f50 comp rx=0 tx=0).stop 2023-09-10T00:14:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 msgr2=0x7ff4501e5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff44800eb00 tx=0x7ff44800c2d0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 shutdown_connections 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff430065b20 0x7ff430067fe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff45015ad80 0x7ff45015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4500b6740 0x7ff4500c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 --2- 172.21.15.84:0/3545883786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4500b2af0 0x7ff4501e5290 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 >> 172.21.15.84:0/3545883786 conn(0x7ff4500d0b30 msgr2=0x7ff4500cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 shutdown_connections 2023-09-10T00:14:12.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.228+0000 7ff4568da640 1 -- 172.21.15.84:0/3545883786 wait complete. 2023-09-10T00:14:12.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-10T00:14:12.377 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- 172.21.15.84:0/498740035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 msgr2=0x7f49240b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- 172.21.15.84:0/498740035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f49240b0230 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f491c009bc0 tx=0x7f491c01cb80 comp rx=0 tx=0).stop 2023-09-10T00:14:12.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- 172.21.15.84:0/498740035 shutdown_connections 2023-09-10T00:14:12.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- 172.21.15.84:0/498740035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f49240b0230 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.378 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- 172.21.15.84:0/498740035 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 0x7f4924070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- 172.21.15.84:0/498740035 >> 172.21.15.84:0/498740035 conn(0x7f49240cca70 msgr2=0x7f49240cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- 172.21.15.84:0/498740035 shutdown_connections 2023-09-10T00:14:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- 172.21.15.84:0/498740035 wait complete. 2023-09-10T00:14:12.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 Processor -- start 2023-09-10T00:14:12.382 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- start start 2023-09-10T00:14:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 0x7f492414e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240c7f40 0x7f4924156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492414bcf0 con 0x7f49240708a0 2023-09-10T00:14:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492414b170 con 0x7f49240c7f40 2023-09-10T00:14:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f492b498640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492414b450 con 0x7f492406bcf0 2023-09-10T00:14:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f4928a33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f4928a33640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46938/0 (socket says 172.21.15.84:46938) 2023-09-10T00:14:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.372+0000 7f4928a33640 1 -- 172.21.15.84:0/2804884693 learned_addr learned my addr 172.21.15.84:0/2804884693 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 -- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 msgr2=0x7f492414e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4929234640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 0x7f492414e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4929a35640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240c7f40 0x7f4924156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.385 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 0x7f492414e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 -- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240c7f40 msgr2=0x7f4924156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240c7f40 0x7f4924156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 -- 172.21.15.84:0/2804884693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009820 con 0x7f49240708a0 2023-09-10T00:14:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4928a33640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f492000c970 tx=0x7f492000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.386 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920007bb0 con 0x7f49240708a0 2023-09-10T00:14:12.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4920007e00 con 0x7f49240708a0 2023-09-10T00:14:12.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920005280 con 0x7f49240708a0 2023-09-10T00:14:12.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492414b730 con 0x7f49240708a0 2023-09-10T00:14:12.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492414ac00 con 0x7f49240708a0 2023-09-10T00:14:12.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49240ad6e0 con 0x7f49240708a0 2023-09-10T00:14:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f49200053e0 con 0x7f49240708a0 2023-09-10T00:14:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 0x7f4908067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49200839e0 con 0x7f49240708a0 2023-09-10T00:14:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4929234640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 0x7f4908067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:12.388 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.376+0000 7f4929234640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 0x7f4908067fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f49140011f0 tx=0x7f4914009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:12.389 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.380+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4920054d10 con 0x7f49240708a0 2023-09-10T00:14:12.576 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49240712c0 con 0x7f49240708a0 2023-09-10T00:14:12.577 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f4919ffb640 1 -- 172.21.15.84:0/2804884693 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f492001d070 con 0x7f49240708a0 2023-09-10T00:14:12.577 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-10T00:14:12.579 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 msgr2=0x7f4908067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 0x7f4908067fe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f49140011f0 tx=0x7f4914009040 comp rx=0 tx=0).stop 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 msgr2=0x7f492414e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f492000c970 tx=0x7f492000ce30 comp rx=0 tx=0).stop 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 shutdown_connections 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4908065b20 0x7f4908067fe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.580 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49240c7f40 0x7f4924156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f49240708a0 0x7f492414e880 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 --2- 172.21.15.84:0/2804884693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f492406bcf0 0x7f492414e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 >> 172.21.15.84:0/2804884693 conn(0x7f49240cca70 msgr2=0x7f49240c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 shutdown_connections 2023-09-10T00:14:12.581 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:12.572+0000 7f492b498640 1 -- 172.21.15.84:0/2804884693 wait complete. 2023-09-10T00:14:12.595 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-10T00:14:12.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-10T00:14:12.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2023-09-10T00:14:12.596 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-10T00:14:12.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:12.597 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-10T00:14:12.597 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-10T00:14:12.597 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-10T00:14:12.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-10T00:14:12.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.598 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2023-09-10T00:14:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-10T00:14:12.605 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-10T00:14:12.605 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2023-09-10T00:14:12.606 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.606 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2023-09-10T00:14:12.606 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.606 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:14:12.606 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.607 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2023-09-10T00:14:12.607 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:14:12.607 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.607 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2023-09-10T00:14:12.607 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-09-10T00:14:12.608 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.608 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-10T00:14:12.608 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.608 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-09-10T00:14:12.608 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 02:42:d2:3e:84:82 brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-09-10T00:14:12.609 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.610 INFO:teuthology.orchestra.run.smithi084.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-09-10T00:14:12.610 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-09-10T00:14:12.610 INFO:teuthology.orchestra.run.smithi084.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-09-10T00:14:12.610 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.610 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-09-10T00:14:12.611 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.611 INFO:teuthology.orchestra.run.smithi084.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-10T00:14:12.611 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-10T00:14:12.611 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-09-10T00:14:12.611 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.612 INFO:teuthology.orchestra.run.smithi084.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-09-10T00:14:12.612 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-10T00:14:12.612 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-09-10T00:14:12.612 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2023-09-10T00:14:12.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.613 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-10T00:14:12.656 INFO:teuthology.orchestra.run.smithi084.stdout:1 2023-09-10T00:14:12.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.658 DEBUG:teuthology.orchestra.run.smithi084:> route 2023-09-10T00:14:12.707 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2023-09-10T00:14:12.707 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-10T00:14:12.708 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-09-10T00:14:12.708 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-10T00:14:12.708 INFO:teuthology.orchestra.run.smithi084.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-09-10T00:14:12.708 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-10T00:14:12.709 INFO:teuthology.orchestra.run.smithi084.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:14:12.709 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:14:12.709 INFO:teuthology.orchestra.run.smithi084.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-09-10T00:14:12.709 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-10T00:14:12.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.710 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec bash -c ' 2023-09-10T00:14:12.710 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2023-09-10T00:14:12.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-10T00:14:12.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-10T00:14:12.711 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-10T00:14:12.712 DEBUG:teuthology.orchestra.run.smithi084:> ') 2023-09-10T00:14:12.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.783 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T00:14:12.832 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-10T00:14:12.833 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-10T00:14:12.833 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-10T00:14:12.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:12.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2023-09-10T00:14:12.888 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-10T00:14:12.889 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:14:12.889 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:12.936 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-10T00:14:12.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-10T00:14:12.936 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:12.984 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:14:13.041 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:14:13.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:14:13.095 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:14:13.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:14:13.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:13.098 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:14:13.145 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-10T00:14:13.145 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-10T00:14:13.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:14:13.205 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:14:13.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:14:13.258 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:14:13.258 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:14:13.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:13.260 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:14:13.270 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2023-09-10T00:14:13.264+0000 7f05c1e46580 -1 init, newargv = 0x55c62d23c570 newargc=15 2023-09-10T00:14:13.270 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[49683]: starting ceph client 2023-09-10T00:14:13.277 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[49683]: starting fuse 2023-09-10T00:14:14.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2023-09-10T00:14:14.393 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-09-10T00:14:14.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-09-10T00:14:14.448 INFO:teuthology.orchestra.run.smithi084.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-09-10T00:14:14.449 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-09-10T00:14:14.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.451 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2023-09-10T00:14:14.497 INFO:teuthology.orchestra.run.smithi084.stdout:45 2023-09-10T00:14:14.498 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-09-10T00:14:14.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2023-09-10T00:14:14.499 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2023-09-10T00:14:14.500 DEBUG:teuthology.orchestra.run.smithi084:> import re 2023-09-10T00:14:14.501 DEBUG:teuthology.orchestra.run.smithi084:> import os 2023-09-10T00:14:14.501 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2023-09-10T00:14:14.502 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:14:14.503 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2023-09-10T00:14:14.503 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-10T00:14:14.504 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2023-09-10T00:14:14.505 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-10T00:14:14.506 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:14:14.506 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2023-09-10T00:14:14.507 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2023-09-10T00:14:14.507 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2023-09-10T00:14:14.508 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2023-09-10T00:14:14.509 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:14:14.509 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2023-09-10T00:14:14.510 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-10T00:14:14.511 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-10T00:14:14.512 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-10T00:14:14.512 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2023-09-10T00:14:14.513 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2023-09-10T00:14:14.514 DEBUG:teuthology.orchestra.run.smithi084:> return f 2023-09-10T00:14:14.514 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-10T00:14:14.515 DEBUG:teuthology.orchestra.run.smithi084:> 2023-09-10T00:14:14.516 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2023-09-10T00:14:14.516 DEBUG:teuthology.orchestra.run.smithi084:> ' 2023-09-10T00:14:14.621 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.49683.asok 2023-09-10T00:14:14.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-10T00:14:14.633 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49683.asok 2023-09-10T00:14:14.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49683.asok status 2023-09-10T00:14:14.787 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T00:14:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2023-09-10T00:14:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "9670cca5bc8e17916865dc84939edfc10b1f2c00", 2023-09-10T00:14:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 18.0.0-6025-g9670cca5 (9670cca5bc8e17916865dc84939edfc10b1f2c00) reef (dev)", 2023-09-10T00:14:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2023-09-10T00:14:14.788 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2023-09-10T00:14:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-10T00:14:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "49683", 2023-09-10T00:14:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2023-09-10T00:14:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:14.789 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2023-09-10T00:14:14.790 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2023-09-10T00:14:14.790 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 5829, 2023-09-10T00:14:14.790 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2023-09-10T00:14:14.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2023-09-10T00:14:14.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2023-09-10T00:14:14.791 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 5829 2023-09-10T00:14:14.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:14.791 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:14:14.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 955559732 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: } 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2023-09-10T00:14:14.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2023-09-10T00:14:14.793 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2023-09-10T00:14:14.793 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 955559732 2023-09-10T00:14:14.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2023-09-10T00:14:14.793 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.5829 192.168.0.1:0/955559732", 2023-09-10T00:14:14.793 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/955559732", 2023-09-10T00:14:14.794 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2023-09-10T00:14:14.794 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 16, 2023-09-10T00:14:14.794 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 40, 2023-09-10T00:14:14.794 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2023-09-10T00:14:14.794 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2023-09-10T00:14:14.795 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2023-09-10T00:14:14.795 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T00:14:14.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.801 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2023-09-10T00:14:14.801 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:14.807 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2023-09-10T00:14:14.808 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:14.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-10T00:14:14.865 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=xfstests-dev 2023-09-10T00:14:14.911 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.4PMIK897QPxfstests-dev 2023-09-10T00:14:14.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.912 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.4PMIK897QPxfstests-dev) 2023-09-10T00:14:14.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:14.972 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.4PMIK897QPxfstests-dev) 2023-09-10T00:14:15.028 INFO:teuthology.orchestra.run.smithi084.stderr:Cloning into '/tmp/tmp.4PMIK897QPxfstests-dev'... 2023-09-10T00:14:15.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:15.844 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-09-10T00:14:15.899 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=test 2023-09-10T00:14:15.944 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.8YBtWphbTqtest 2023-09-10T00:14:15.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:14:15.945 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-09-10T00:14:15.998 DEBUG:teuthology.orchestra.run.smithi084:> mktemp -d --suffix=scratch 2023-09-10T00:14:16.048 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.LJr9WN1qALscratch 2023-09-10T00:14:16.049 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-09-10T00:14:16.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-09-10T00:14:16.157 INFO:teuthology.orchestra.run.smithi084.stdout:Reading package lists... 2023-09-10T00:14:16.343 INFO:teuthology.orchestra.run.smithi084.stdout:Building dependency tree... 2023-09-10T00:14:16.343 INFO:teuthology.orchestra.run.smithi084.stdout:Reading state information... 2023-09-10T00:14:16.509 INFO:teuthology.orchestra.run.smithi084.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-09-10T00:14:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-09-10T00:14:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:gawk is already the newest version (1:5.1.0-1build3). 2023-09-10T00:14:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-09-10T00:14:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:gcc set to manually installed. 2023-09-10T00:14:16.510 INFO:teuthology.orchestra.run.smithi084.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-09-10T00:14:16.511 INFO:teuthology.orchestra.run.smithi084.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-09-10T00:14:16.511 INFO:teuthology.orchestra.run.smithi084.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-09-10T00:14:16.511 INFO:teuthology.orchestra.run.smithi084.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-09-10T00:14:16.511 INFO:teuthology.orchestra.run.smithi084.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:14:16.511 INFO:teuthology.orchestra.run.smithi084.stdout:make is already the newest version (4.3-4.1build1). 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:make set to manually installed. 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:quota is already the newest version (4.06-1build2). 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-09-10T00:14:16.512 INFO:teuthology.orchestra.run.smithi084.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout:dbench is already the newest version (4.0-2build1). 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout:python2 is already the newest version (2.7.18-3). 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout:python2 set to manually installed. 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout:The following packages were automatically installed and are no longer required: 2023-09-10T00:14:16.513 INFO:teuthology.orchestra.run.smithi084.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-09-10T00:14:16.514 INFO:teuthology.orchestra.run.smithi084.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-09-10T00:14:16.514 INFO:teuthology.orchestra.run.smithi084.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-09-10T00:14:16.515 INFO:teuthology.orchestra.run.smithi084.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-10T00:14:16.515 INFO:teuthology.orchestra.run.smithi084.stdout:The following additional packages will be installed: 2023-09-10T00:14:16.515 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemblk1 2023-09-10T00:14:16.515 INFO:teuthology.orchestra.run.smithi084.stdout:Suggested packages: 2023-09-10T00:14:16.515 INFO:teuthology.orchestra.run.smithi084.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-09-10T00:14:16.538 INFO:teuthology.orchestra.run.smithi084.stdout:The following NEW packages will be installed: 2023-09-10T00:14:16.540 INFO:teuthology.orchestra.run.smithi084.stdout: fio libgdbm-dev libpmemblk1 sqlite3 2023-09-10T00:14:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:0 upgraded, 4 newly installed, 0 to remove and 240 not upgraded. 2023-09-10T00:14:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:Need to get 4,997 kB of archives. 2023-09-10T00:14:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:After this operation, 9,949 kB of additional disk space will be used. 2023-09-10T00:14:16.738 INFO:teuthology.orchestra.run.smithi084.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-09-10T00:14:17.022 INFO:teuthology.orchestra.run.smithi084.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-09-10T00:14:17.529 INFO:teuthology.orchestra.run.smithi084.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-09-10T00:14:17.532 INFO:teuthology.orchestra.run.smithi084.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-09-10T00:14:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: unable to initialize frontend: Dialog 2023-09-10T00:14:17.892 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-09-10T00:14:17.893 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: falling back to frontend: Readline 2023-09-10T00:14:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: unable to initialize frontend: Readline 2023-09-10T00:14:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: (This frontend requires a controlling tty.) 2023-09-10T00:14:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:debconf: falling back to frontend: Teletype 2023-09-10T00:14:17.914 INFO:teuthology.orchestra.run.smithi084.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-09-10T00:14:17.946 INFO:teuthology.orchestra.run.smithi084.stdout:Fetched 4,997 kB in 1s (4,981 kB/s) 2023-09-10T00:14:18.111 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-09-10T00:14:18.215 INFO:teuthology.orchestra.run.smithi084.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 175787 files and directories currently installed.) 2023-09-10T00:14:18.221 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-09-10T00:14:18.301 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-10T00:14:18.638 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package fio. 2023-09-10T00:14:18.666 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-09-10T00:14:18.704 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking fio (3.28-1) ... 2023-09-10T00:14:19.200 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-09-10T00:14:19.228 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../libgdbm-dev_1.23-1_amd64.deb ... 2023-09-10T00:14:19.267 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-09-10T00:14:19.562 INFO:teuthology.orchestra.run.smithi084.stdout:Selecting previously unselected package sqlite3. 2023-09-10T00:14:19.578 INFO:teuthology.orchestra.run.smithi084.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-09-10T00:14:19.620 INFO:teuthology.orchestra.run.smithi084.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-09-10T00:14:19.946 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-09-10T00:14:20.074 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-09-10T00:14:20.200 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-09-10T00:14:20.326 INFO:teuthology.orchestra.run.smithi084.stdout:Setting up fio (3.28-1) ... 2023-09-10T00:14:20.862 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-09-10T00:14:21.014 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-09-10T00:14:22.281 INFO:teuthology.orchestra.run.smithi084.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-09-10T00:14:22.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd -m fsgqa 2023-09-10T00:14:22.785 INFO:teuthology.orchestra.run.smithi084.stderr:useradd: user 'fsgqa' already exists 2023-09-10T00:14:22.785 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-10T00:14:22.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo groupadd fsgqa 2023-09-10T00:14:22.836 INFO:teuthology.orchestra.run.smithi084.stderr:groupadd: group 'fsgqa' already exists 2023-09-10T00:14:22.836 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-09-10T00:14:22.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd fsgqa2 2023-09-10T00:14:23.217 DEBUG:teuthology.orchestra.run.smithi084:> sudo useradd 123456-fsgqa 2023-09-10T00:14:23.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-09-10T00:14:23.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- 172.21.15.84:0/3889154652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c070410 msgr2=0x7f3e2c0af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:23.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- 172.21.15.84:0/3889154652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c070410 0x7f3e2c0af950 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009900 tx=0x7f3e2001c770 comp rx=0 tx=0).stop 2023-09-10T00:14:23.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- 172.21.15.84:0/3889154652 shutdown_connections 2023-09-10T00:14:23.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- 172.21.15.84:0/3889154652 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c0ca730 0x7f3e2c0afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- 172.21.15.84:0/3889154652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c070410 0x7f3e2c0af950 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- 172.21.15.84:0/3889154652 >> 172.21.15.84:0/3889154652 conn(0x7f3e2c0cca20 msgr2=0x7f3e2c0cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:23.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- 172.21.15.84:0/3889154652 shutdown_connections 2023-09-10T00:14:23.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- 172.21.15.84:0/3889154652 wait complete. 2023-09-10T00:14:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 Processor -- start 2023-09-10T00:14:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- start start 2023-09-10T00:14:23.736 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 0x7f3e2c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 0x7f3e2c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1564f0 con 0x7f3e2c0ca730 2023-09-10T00:14:23.737 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c1507d0 con 0x7f3e2c158a70 2023-09-10T00:14:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e30d71640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c150ab0 con 0x7f3e2c070410 2023-09-10T00:14:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50420/0 (socket says 172.21.15.84:50420) 2023-09-10T00:14:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 -- 172.21.15.84:0/1243637384 learned_addr learned my addr 172.21.15.84:0/1243637384 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:23.738 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e2ad9d640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 0x7f3e2c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e2a59c640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 0x7f3e2c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 -- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 msgr2=0x7f3e2c15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 0x7f3e2c15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 -- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 msgr2=0x7f3e2c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:23.739 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 0x7f3e2c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 -- 172.21.15.84:0/1243637384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20009560 con 0x7f3e2c0ca730 2023-09-10T00:14:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e2ad9d640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 0x7f3e2c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:14:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e2a59c640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 0x7f3e2c15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T00:14:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.728+0000 7f3e29d9b640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c10 tx=0x7f3e20005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e200ba070 con 0x7f3e2c0ca730 2023-09-10T00:14:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e20003710 con 0x7f3e2c0ca730 2023-09-10T00:14:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2c150d90 con 0x7f3e2c0ca730 2023-09-10T00:14:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e20003b20 con 0x7f3e2c0ca730 2023-09-10T00:14:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2c15a710 con 0x7f3e2c0ca730 2023-09-10T00:14:23.741 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2c15a900 con 0x7f3e2c0ca730 2023-09-10T00:14:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3e200b4040 con 0x7f3e2c0ca730 2023-09-10T00:14:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 0x7f3e0c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3e2011d9a0 con 0x7f3e2c0ca730 2023-09-10T00:14:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e2a59c640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 0x7f3e0c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:23.743 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.732+0000 7f3e2a59c640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 0x7f3e0c067fe0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c15c300 tx=0x7f3e1c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:23.744 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.736+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f3e2c15a900 con 0x7f3e2c0ca730 2023-09-10T00:14:23.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.952+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e2c15a900 con 0x7f3e2c0ca730 2023-09-10T00:14:23.957 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.952+0000 7f3e1affd640 1 -- 172.21.15.84:0/1243637384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f3e2c15a900 con 0x7f3e2c0ca730 2023-09-10T00:14:23.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:14:23.958 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","modified":"2023-09-10T00:11:40.911477Z","created":"2023-09-10T00:11:40.911477Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3301","nonce":0},{"type":"v1","addr":"172.21.15.100:6790","nonce":0}]},"addr":"172.21.15.100:6790/0","public_addr":"172.21.15.100:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-09-10T00:14:23.958 INFO:teuthology.orchestra.run.smithi084.stderr:dumped monmap epoch 1 2023-09-10T00:14:23.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 msgr2=0x7f3e0c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:23.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 0x7f3e0c067fe0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c15c300 tx=0x7f3e1c009040 comp rx=0 tx=0).stop 2023-09-10T00:14:23.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 msgr2=0x7f3e2c1500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:23.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000c10 tx=0x7f3e20005e90 comp rx=0 tx=0).stop 2023-09-10T00:14:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 shutdown_connections 2023-09-10T00:14:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f3e0c065b20 0x7f3e0c067fe0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c158a70 0x7f3e2c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3e2c0ca730 0x7f3e2c1500d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 --2- 172.21.15.84:0/1243637384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c070410 0x7f3e2c15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 >> 172.21.15.84:0/1243637384 conn(0x7f3e2c0cca20 msgr2=0x7f3e2c1591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 shutdown_connections 2023-09-10T00:14:23.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:23.956+0000 7f3e30d71640 1 -- 172.21.15.84:0/1243637384 wait complete. 2023-09-10T00:14:23.976 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-09-10T00:14:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- 172.21.15.84:0/663366560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1530004d10 msgr2=0x7f1530005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 --2- 172.21.15.84:0/663366560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1530004d10 0x7f1530005190 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f154000bb10 tx=0x7f154001cdc0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.102 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154cf7a640 1 -- 172.21.15.84:0/663366560 reap_dead start 2023-09-10T00:14:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- 172.21.15.84:0/663366560 shutdown_connections 2023-09-10T00:14:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- 172.21.15.84:0/663366560 >> 172.21.15.84:0/663366560 conn(0x7f15480ca240 msgr2=0x7f15480ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- 172.21.15.84:0/663366560 shutdown_connections 2023-09-10T00:14:24.103 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- 172.21.15.84:0/663366560 wait complete. 2023-09-10T00:14:24.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 Processor -- start 2023-09-10T00:14:24.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.096+0000 7f154e9dd640 1 -- start start 2023-09-10T00:14:24.106 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1530004d10 0x7f15480c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15480c72f0 0x7f15480c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c2e20 con 0x7f15480b26b0 2023-09-10T00:14:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c4620 con 0x7f15480c72f0 2023-09-10T00:14:24.107 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15480c3040 con 0x7f1530004d10 2023-09-10T00:14:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50430/0 (socket says 172.21.15.84:50430) 2023-09-10T00:14:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 -- 172.21.15.84:0/1650510650 learned_addr learned my addr 172.21.15.84:0/1650510650 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T00:14:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1547fff640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1530004d10 0x7f15480c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:24.108 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f15477fe640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15480c72f0 0x7f15480c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 -- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1530004d10 msgr2=0x7f15480c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1530004d10 0x7f15480c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 -- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15480c72f0 msgr2=0x7f15480c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15480c72f0 0x7f15480c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.109 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 -- 172.21.15.84:0/1650510650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15480c3320 con 0x7f15480b26b0 2023-09-10T00:14:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154cf7a640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f154001d660 tx=0x7f1540005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540005030 con 0x7f15480b26b0 2023-09-10T00:14:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1540005280 con 0x7f15480b26b0 2023-09-10T00:14:24.110 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15480c3600 con 0x7f15480b26b0 2023-09-10T00:14:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1540005650 con 0x7f15480b26b0 2023-09-10T00:14:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15480c3bc0 con 0x7f15480b26b0 2023-09-10T00:14:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15480c3db0 con 0x7f15480b26b0 2023-09-10T00:14:24.111 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f15400046d0 con 0x7f15480b26b0 2023-09-10T00:14:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 0x7f1534068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T00:14:24.112 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f154011d710 con 0x7f15480b26b0 2023-09-10T00:14:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1547fff640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 0x7f1534068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T00:14:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.100+0000 7f1547fff640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 0x7f1534068010 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1538001060 tx=0x7f1538001bd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T00:14:24.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.104+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f15400eb040 con 0x7f15480b26b0 2023-09-10T00:14:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f154815b460 con 0x7f15480b26b0 2023-09-10T00:14:24.320 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f1544ff9640 1 -- 172.21.15.84:0/1650510650 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f15400ab0b0 con 0x7f15480b26b0 2023-09-10T00:14:24.321 INFO:teuthology.orchestra.run.smithi084.stdout:[client.admin] 2023-09-10T00:14:24.321 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQC9Cf1kXXTnCBAAvC+YwpJbv/67jZ/pSq7qFg== 2023-09-10T00:14:24.321 INFO:teuthology.orchestra.run.smithi084.stdout: caps mds = "allow *" 2023-09-10T00:14:24.321 INFO:teuthology.orchestra.run.smithi084.stdout: caps mgr = "allow *" 2023-09-10T00:14:24.322 INFO:teuthology.orchestra.run.smithi084.stdout: caps mon = "allow *" 2023-09-10T00:14:24.322 INFO:teuthology.orchestra.run.smithi084.stdout: caps osd = "allow *" 2023-09-10T00:14:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 msgr2=0x7f1534068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 0x7f1534068010 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1538001060 tx=0x7f1538001bd0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.323 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 msgr2=0x7f15480b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f154001d660 tx=0x7f1540005e60 comp rx=0 tx=0).stop 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 shutdown_connections 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1534065b50 0x7f1534068010 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f15480b26b0 0x7f15480b0260 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15480c72f0 0x7f15480c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.324 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 --2- 172.21.15.84:0/1650510650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1530004d10 0x7f15480c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T00:14:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 >> 172.21.15.84:0/1650510650 conn(0x7f15480ca240 msgr2=0x7f154815c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T00:14:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 shutdown_connections 2023-09-10T00:14:24.325 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T00:14:24.316+0000 7f154e9dd640 1 -- 172.21.15.84:0/1650510650 wait complete. 2023-09-10T00:14:24.339 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-09-10T00:14:24.345 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.TboUcnJknq 2023-09-10T00:14:24.346 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:14:24.346 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/tmp/tmp.TboUcnJknq 2023-09-10T00:14:24.392 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:14:24.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.4PMIK897QPxfstests-dev/local.config 2023-09-10T00:14:24.447 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.8YBtWphbTqtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.LJr9WN1qALscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.84:6789 -k /tmp/tmp.TboUcnJknq --client_mountpoint /test" 2023-09-10T00:14:24.448 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T00:14:24.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/tmp/tmp.4PMIK897QPxfstests-dev/ceph.exclude 2023-09-10T00:14:24.504 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo make) 2023-09-10T00:14:24.564 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize -cfi 2023-09-10T00:14:24.877 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting auxiliary files in '.'. 2023-09-10T00:14:24.878 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.guess' 2023-09-10T00:14:24.882 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './config.sub' 2023-09-10T00:14:24.890 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './install-sh' 2023-09-10T00:14:24.896 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file './ltmain.sh' 2023-09-10T00:14:24.915 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-09-10T00:14:24.915 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-09-10T00:14:24.921 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-09-10T00:14:24.926 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-09-10T00:14:24.931 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-09-10T00:14:24.936 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-09-10T00:14:24.940 INFO:teuthology.orchestra.run.smithi084.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-09-10T00:14:24.941 INFO:teuthology.orchestra.run.smithi084.stdout:cp include/install-sh . 2023-09-10T00:14:24.942 INFO:teuthology.orchestra.run.smithi084.stdout:aclocal -I m4 2023-09-10T00:14:26.086 INFO:teuthology.orchestra.run.smithi084.stdout:autoheader 2023-09-10T00:14:26.463 INFO:teuthology.orchestra.run.smithi084.stdout:autoconf 2023-09-10T00:14:26.865 INFO:teuthology.orchestra.run.smithi084.stdout:./configure \ 2023-09-10T00:14:26.865 INFO:teuthology.orchestra.run.smithi084.stdout: --libexecdir=/usr/lib \ 2023-09-10T00:14:26.865 INFO:teuthology.orchestra.run.smithi084.stdout: --exec_prefix=/var/lib 2023-09-10T00:14:27.307 INFO:teuthology.orchestra.run.smithi084.stdout:checking build system type... x86_64-pc-linux-gnu 2023-09-10T00:14:27.308 INFO:teuthology.orchestra.run.smithi084.stdout:checking host system type... x86_64-pc-linux-gnu 2023-09-10T00:14:27.353 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to print strings... printf 2023-09-10T00:14:27.353 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... gcc 2023-09-10T00:14:27.535 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the C compiler works... yes 2023-09-10T00:14:27.535 INFO:teuthology.orchestra.run.smithi084.stdout:checking for C compiler default output file name... a.out 2023-09-10T00:14:27.572 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of executables... 2023-09-10T00:14:27.650 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether we are cross compiling... no 2023-09-10T00:14:27.672 INFO:teuthology.orchestra.run.smithi084.stdout:checking for suffix of object files... o 2023-09-10T00:14:27.692 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the compiler supports GNU C... yes 2023-09-10T00:14:27.710 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... yes 2023-09-10T00:14:27.836 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to enable C11 features... none needed 2023-09-10T00:14:27.841 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-09-10T00:14:27.844 INFO:teuthology.orchestra.run.smithi084.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-09-10T00:14:27.846 INFO:teuthology.orchestra.run.smithi084.stdout:checking for egrep... /usr/bin/grep -E 2023-09-10T00:14:27.848 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fgrep... /usr/bin/grep -F 2023-09-10T00:14:27.853 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ld used by gcc... /usr/bin/ld 2023-09-10T00:14:27.855 INFO:teuthology.orchestra.run.smithi084.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-09-10T00:14:27.862 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-09-10T00:14:27.884 INFO:teuthology.orchestra.run.smithi084.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-09-10T00:14:27.885 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2023-09-10T00:14:27.894 INFO:teuthology.orchestra.run.smithi084.stdout:checking the maximum length of command line arguments... 1572864 2023-09-10T00:14:27.897 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-09-10T00:14:27.897 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-09-10T00:14:27.898 INFO:teuthology.orchestra.run.smithi084.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-09-10T00:14:27.899 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdump... objdump 2023-09-10T00:14:27.899 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to recognize dependent libraries... pass_all 2023-09-10T00:14:27.899 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlltool... no 2023-09-10T00:14:27.900 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-09-10T00:14:27.900 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ar... ar 2023-09-10T00:14:27.937 INFO:teuthology.orchestra.run.smithi084.stdout:checking for archiver @FILE support... @ 2023-09-10T00:14:27.937 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strip... strip 2023-09-10T00:14:27.937 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ranlib... ranlib 2023-09-10T00:14:27.938 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gawk... gawk 2023-09-10T00:14:28.007 INFO:teuthology.orchestra.run.smithi084.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-09-10T00:14:28.008 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sysroot... no 2023-09-10T00:14:28.013 INFO:teuthology.orchestra.run.smithi084.stdout:checking for a working dd... /usr/bin/dd 2023-09-10T00:14:28.017 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-09-10T00:14:28.032 INFO:teuthology.orchestra.run.smithi084.stdout:checking for mt... mt 2023-09-10T00:14:28.041 INFO:teuthology.orchestra.run.smithi084.stdout:checking if mt is a manifest tool... no 2023-09-10T00:14:28.069 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdio.h... yes 2023-09-10T00:14:28.111 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdlib.h... yes 2023-09-10T00:14:28.145 INFO:teuthology.orchestra.run.smithi084.stdout:checking for string.h... yes 2023-09-10T00:14:28.178 INFO:teuthology.orchestra.run.smithi084.stdout:checking for inttypes.h... yes 2023-09-10T00:14:28.207 INFO:teuthology.orchestra.run.smithi084.stdout:checking for stdint.h... yes 2023-09-10T00:14:28.234 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... yes 2023-09-10T00:14:28.259 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... yes 2023-09-10T00:14:28.285 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... yes 2023-09-10T00:14:28.320 INFO:teuthology.orchestra.run.smithi084.stdout:checking for unistd.h... yes 2023-09-10T00:14:28.363 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dlfcn.h... yes 2023-09-10T00:14:28.366 INFO:teuthology.orchestra.run.smithi084.stdout:checking for objdir... .libs 2023-09-10T00:14:28.438 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-09-10T00:14:28.439 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-09-10T00:14:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-09-10T00:14:28.730 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc static flag -static works... yes 2023-09-10T00:14:28.759 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... yes 2023-09-10T00:14:28.759 INFO:teuthology.orchestra.run.smithi084.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-09-10T00:14:28.768 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-09-10T00:14:28.792 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether -lc should be explicitly linked in... no 2023-09-10T00:14:28.868 INFO:teuthology.orchestra.run.smithi084.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-09-10T00:14:28.869 INFO:teuthology.orchestra.run.smithi084.stdout:checking how to hardcode library paths into programs... immediate 2023-09-10T00:14:28.879 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether stripping libraries is possible... yes 2023-09-10T00:14:28.879 INFO:teuthology.orchestra.run.smithi084.stdout:checking if libtool supports shared libraries... yes 2023-09-10T00:14:28.879 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build shared libraries... yes 2023-09-10T00:14:28.879 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether to build static libraries... yes 2023-09-10T00:14:28.887 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc... (cached) gcc 2023-09-10T00:14:28.913 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-09-10T00:14:28.913 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc accepts -g... (cached) yes 2023-09-10T00:14:28.913 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-09-10T00:14:28.914 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gmake... /usr/bin/gmake 2023-09-10T00:14:28.914 INFO:teuthology.orchestra.run.smithi084.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-09-10T00:14:28.915 INFO:teuthology.orchestra.run.smithi084.stdout:checking for tar... /bin/tar 2023-09-10T00:14:28.915 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gzip... /bin/gzip 2023-09-10T00:14:28.925 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether gcc -MM is supported... yes 2023-09-10T00:14:28.926 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sort... /bin/sort 2023-09-10T00:14:28.926 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether ln -s works... yes 2023-09-10T00:14:28.927 INFO:teuthology.orchestra.run.smithi084.stdout:checking for rpm... no 2023-09-10T00:14:28.958 INFO:teuthology.orchestra.run.smithi084.stdout:checking for assert.h... yes 2023-09-10T00:14:28.992 INFO:teuthology.orchestra.run.smithi084.stdout:checking for bstring.h... no 2023-09-10T00:14:29.023 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libgen.h... yes 2023-09-10T00:14:29.088 INFO:teuthology.orchestra.run.smithi084.stdout:checking for dirent.h... yes 2023-09-10T00:14:29.182 INFO:teuthology.orchestra.run.smithi084.stdout:checking for errno.h... yes 2023-09-10T00:14:29.220 INFO:teuthology.orchestra.run.smithi084.stdout:checking for malloc.h... yes 2023-09-10T00:14:29.253 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid.h... no 2023-09-10T00:14:29.310 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid/uuid.h... yes 2023-09-10T00:14:29.360 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/uuid.h... no 2023-09-10T00:14:29.399 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/file.h... yes 2023-09-10T00:14:29.432 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fcntl.h... yes 2023-09-10T00:14:29.467 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/syssgi.h... no 2023-09-10T00:14:29.539 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/param.h... yes 2023-09-10T00:14:29.539 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/stat.h... (cached) yes 2023-09-10T00:14:29.576 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/statvfs.h... yes 2023-09-10T00:14:29.612 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/time.h... yes 2023-09-10T00:14:29.662 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/ioctl.h... yes 2023-09-10T00:14:29.700 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/wait.h... yes 2023-09-10T00:14:29.700 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/types.h... (cached) yes 2023-09-10T00:14:29.700 INFO:teuthology.orchestra.run.smithi084.stdout:checking for strings.h... (cached) yes 2023-09-10T00:14:29.737 INFO:teuthology.orchestra.run.smithi084.stdout:checking for err.h... yes 2023-09-10T00:14:29.771 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/falloc.h... yes 2023-09-10T00:14:29.803 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_fsops.h... no 2023-09-10T00:14:29.842 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/fs/xfs_itable.h... no 2023-09-10T00:14:29.882 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/platform_defs.h... no 2023-09-10T00:14:29.915 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfs/ioctl.h... no 2023-09-10T00:14:29.951 INFO:teuthology.orchestra.run.smithi084.stdout:checking for cifs/ioctl.h... no 2023-09-10T00:14:29.991 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/mman.h... yes 2023-09-10T00:14:30.005 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs_log_format.h... no 2023-09-10T00:14:30.047 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare... no 2023-09-10T00:14:30.082 INFO:teuthology.orchestra.run.smithi084.stdout:checking for uuid_compare in -luuid... yes 2023-09-10T00:14:30.207 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xfs.h... yes 2023-09-10T00:14:30.224 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/libxfs.h... no 2023-09-10T00:14:30.262 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-09-10T00:14:30.283 INFO:teuthology.orchestra.run.smithi084.stdout:checking whether xlog_assign_lsn is declared... no 2023-09-10T00:14:30.331 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/xqm.h... yes 2023-09-10T00:14:30.399 INFO:teuthology.orchestra.run.smithi084.stdout:checking xfsctl from xfs/xfs.h... ok 2023-09-10T00:14:30.433 INFO:teuthology.orchestra.run.smithi084.stdout:checking for xfs/handle.h... yes 2023-09-10T00:14:30.468 INFO:teuthology.orchestra.run.smithi084.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-09-10T00:14:30.509 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/acl.h... yes 2023-09-10T00:14:30.542 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl/libacl.h... yes 2023-09-10T00:14:30.577 INFO:teuthology.orchestra.run.smithi084.stdout:checking for acl_init in -lacl... yes 2023-09-10T00:14:30.608 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm-ndbm.h... no 2023-09-10T00:14:30.639 INFO:teuthology.orchestra.run.smithi084.stdout:checking for gdbm/ndbm.h... no 2023-09-10T00:14:30.672 INFO:teuthology.orchestra.run.smithi084.stdout:checking for ndbm.h... no 2023-09-10T00:14:30.709 INFO:teuthology.orchestra.run.smithi084.stdout:checking for libaio.h... yes 2023-09-10T00:14:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:checking for liburing.h... no 2023-09-10T00:14:30.776 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/capability.h... no 2023-09-10T00:14:30.807 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fiemap.h... yes 2023-09-10T00:14:30.842 INFO:teuthology.orchestra.run.smithi084.stdout:checking for fallocate... yes 2023-09-10T00:14:30.881 INFO:teuthology.orchestra.run.smithi084.stdout:checking for open_by_handle_at... yes 2023-09-10T00:14:30.914 INFO:teuthology.orchestra.run.smithi084.stdout:checking for sys/prctl.h... yes 2023-09-10T00:14:30.944 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/fs.h... yes 2023-09-10T00:14:30.973 INFO:teuthology.orchestra.run.smithi084.stdout:checking for btrfsutil.h... no 2023-09-10T00:14:31.030 INFO:teuthology.orchestra.run.smithi084.stdout:checking for copy_file_range... yes 2023-09-10T00:14:31.078 INFO:teuthology.orchestra.run.smithi084.stdout:checking for SEEK_DATA... yes 2023-09-10T00:14:31.138 INFO:teuthology.orchestra.run.smithi084.stdout:checking for BMV_OF_SHARED... yes 2023-09-10T00:14:31.186 INFO:teuthology.orchestra.run.smithi084.stdout:checking for nftw... yes 2023-09-10T00:14:31.230 INFO:teuthology.orchestra.run.smithi084.stdout:checking for RLIMIT_NOFILE... yes 2023-09-10T00:14:31.255 INFO:teuthology.orchestra.run.smithi084.stdout:checking for FIEXCHANGE_RANGE... no 2023-09-10T00:14:31.296 INFO:teuthology.orchestra.run.smithi084.stdout:checking for renameat2... yes 2023-09-10T00:14:31.336 INFO:teuthology.orchestra.run.smithi084.stdout:checking for reallocarray... yes 2023-09-10T00:14:31.370 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct mount_attr... yes 2023-09-10T00:14:31.415 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_limit... yes 2023-09-10T00:14:31.450 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-09-10T00:14:31.484 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-09-10T00:14:31.521 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-09-10T00:14:31.555 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-09-10T00:14:31.590 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-09-10T00:14:31.623 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-09-10T00:14:31.656 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs.h... yes 2023-09-10T00:14:31.687 INFO:teuthology.orchestra.run.smithi084.stdout:checking for linux/btrfs_tree.h... yes 2023-09-10T00:14:31.707 INFO:teuthology.orchestra.run.smithi084.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-09-10T00:14:31.725 INFO:teuthology.orchestra.run.smithi084.stdout:configure: creating ./config.status 2023-09-10T00:14:32.126 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/builddefs 2023-09-10T00:14:32.140 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: creating include/config.h 2023-09-10T00:14:32.151 INFO:teuthology.orchestra.run.smithi084.stdout:config.status: executing libtool commands 2023-09-10T00:14:32.197 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2023-09-10T00:14:32.200 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2023-09-10T00:14:32.204 INFO:teuthology.orchestra.run.smithi084.stdout: [LTDEP] 2023-09-10T00:14:32.359 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dataascii.lo 2023-09-10T00:14:32.477 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] databin.lo 2023-09-10T00:14:32.632 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] datapid.lo 2023-09-10T00:14:32.738 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] file_lock.lo 2023-09-10T00:14:32.901 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] forker.lo 2023-09-10T00:14:33.038 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pattern.lo 2023-09-10T00:14:33.149 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_flags.lo 2023-09-10T00:14:33.294 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random_range.lo 2023-09-10T00:14:33.529 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] string_to_tokens.lo 2023-09-10T00:14:33.625 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] str_to_bytes.lo 2023-09-10T00:14:33.758 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] tlibio.lo 2023-09-10T00:14:34.018 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] write_log.lo 2023-09-10T00:14:34.084 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c: In function 'wlog_record_write': 2023-09-10T00:14:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:34.085 INFO:teuthology.orchestra.run.smithi084.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-09-10T00:14:34.085 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:34.085 INFO:teuthology.orchestra.run.smithi084.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-09-10T00:14:34.086 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:34.282 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] random.lo 2023-09-10T00:14:34.375 INFO:teuthology.orchestra.run.smithi084.stdout: [LD] 2023-09-10T00:14:34.446 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2023-09-10T00:14:34.449 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:34.676 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] doio 2023-09-10T00:14:35.389 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsstress 2023-09-10T00:14:36.826 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsx 2023-09-10T00:14:37.576 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] growfiles 2023-09-10T00:14:38.137 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] iogen 2023-09-10T00:14:38.253 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c: In function 'main': 2023-09-10T00:14:38.254 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:38.254 INFO:teuthology.orchestra.run.smithi084.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-09-10T00:14:38.254 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c: In function 'parse_cmdline': 2023-09-10T00:14:38.256 INFO:teuthology.orchestra.run.smithi084.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:38.256 INFO:teuthology.orchestra.run.smithi084.stderr: 1535 | getcwd(fptr->f_path, 2023-09-10T00:14:38.257 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:38.257 INFO:teuthology.orchestra.run.smithi084.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-09-10T00:14:38.257 INFO:teuthology.orchestra.run.smithi084.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-stress 2023-09-10T00:14:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-09-10T00:14:38.631 INFO:teuthology.orchestra.run.smithi084.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:38.631 INFO:teuthology.orchestra.run.smithi084.stderr: 1013 | ftruncate(fd, total_ram); 2023-09-10T00:14:38.632 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:38.939 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2023-09-10T00:14:38.946 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:39.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:14:39.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:14:41.007 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:41.042 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:41.049 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:41.321 INFO:teuthology.orchestra.run.smithi084.stdout: [DEP] 2023-09-10T00:14:41.347 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirstress 2023-09-10T00:14:41.604 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill 2023-09-10T00:14:41.764 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fill2 2023-09-10T00:14:42.000 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getpagesize 2023-09-10T00:14:42.126 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holes 2023-09-10T00:14:42.316 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] lstat64 2023-09-10T00:14:42.502 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nametest 2023-09-10T00:14:42.620 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c: In function 'main': 2023-09-10T00:14:42.621 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:42.621 INFO:teuthology.orchestra.run.smithi084.stderr: 236 | write(1, "\n", 1); 2023-09-10T00:14:42.621 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:42.621 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:42.621 INFO:teuthology.orchestra.run.smithi084.stderr: 238 | write(1, ".", 1); 2023-09-10T00:14:42.622 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:42.622 INFO:teuthology.orchestra.run.smithi084.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:42.622 INFO:teuthology.orchestra.run.smithi084.stderr: 288 | write(1, ".", 1); 2023-09-10T00:14:42.622 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:42.745 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] permname 2023-09-10T00:14:42.947 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] randholes 2023-09-10T00:14:43.212 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] runas 2023-09-10T00:14:43.385 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] truncfile 2023-09-10T00:14:43.562 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] usemem 2023-09-10T00:14:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmapcat 2023-09-10T00:14:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:mmapcat.c: In function 'main': 2023-09-10T00:14:43.798 INFO:teuthology.orchestra.run.smithi084.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:43.798 INFO:teuthology.orchestra.run.smithi084.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-09-10T00:14:43.799 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:43.833 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_reader 2023-09-10T00:14:43.961 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] append_writer 2023-09-10T00:14:44.090 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirperf 2023-09-10T00:14:44.306 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] metaperf 2023-09-10T00:14:44.417 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'crfiles': 2023-09-10T00:14:44.418 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.418 INFO:teuthology.orchestra.run.smithi084.stderr: 166 | write(fd, buf, fsize); 2023-09-10T00:14:44.418 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:44.418 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 't_linkun': 2023-09-10T00:14:44.418 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.419 INFO:teuthology.orchestra.run.smithi084.stderr: 454 | link("a", *fnp); 2023-09-10T00:14:44.419 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~ 2023-09-10T00:14:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 't_chown': 2023-09-10T00:14:44.419 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.419 INFO:teuthology.orchestra.run.smithi084.stderr: 404 | chown(*fnp, 2, -1); 2023-09-10T00:14:44.420 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.420 INFO:teuthology.orchestra.run.smithi084.stderr: 406 | chown(*fnp, 1, -1); 2023-09-10T00:14:44.420 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:44.420 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'i_chown': 2023-09-10T00:14:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.421 INFO:teuthology.orchestra.run.smithi084.stderr: 291 | chown(*fnp, 1, -1); 2023-09-10T00:14:44.421 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c: In function 'main': 2023-09-10T00:14:44.421 INFO:teuthology.orchestra.run.smithi084.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:44.422 INFO:teuthology.orchestra.run.smithi084.stderr: 152 | chdir(".."); 2023-09-10T00:14:44.422 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~ 2023-09-10T00:14:44.591 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] devzero 2023-09-10T00:14:44.755 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] feature 2023-09-10T00:14:44.968 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] alloc 2023-09-10T00:14:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:alloc.c: In function 'main': 2023-09-10T00:14:45.087 INFO:teuthology.orchestra.run.smithi084.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:45.087 INFO:teuthology.orchestra.run.smithi084.stderr: 247 | mkstemp(tmpfile); 2023-09-10T00:14:45.088 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:45.183 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fault 2023-09-10T00:14:45.334 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fstest 2023-09-10T00:14:45.568 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_access_root 2023-09-10T00:14:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:t_access_root.c: In function 'main': 2023-09-10T00:14:45.665 INFO:teuthology.orchestra.run.smithi084.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:45.666 INFO:teuthology.orchestra.run.smithi084.stderr: 55 | system(cmd); 2023-09-10T00:14:45.666 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~ 2023-09-10T00:14:45.708 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] godown 2023-09-10T00:14:45.870 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] resvtest 2023-09-10T00:14:46.047 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writemod 2023-09-10T00:14:46.177 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] writev_on_pagefault 2023-09-10T00:14:46.324 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] makeextents 2023-09-10T00:14:46.502 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] itrash 2023-09-10T00:14:46.644 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] rename 2023-09-10T00:14:46.763 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] multi_open_unlink 2023-09-10T00:14:46.911 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_sync 2023-09-10T00:14:47.080 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] genhashnames 2023-09-10T00:14:47.249 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_holes 2023-09-10T00:14:47.380 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev 2023-09-10T00:14:47.504 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_cmtime 2023-09-10T00:14:47.640 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dirhash_collide 2023-09-10T00:14:47.801 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_rename_overwrite 2023-09-10T00:14:47.918 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] holetest 2023-09-10T00:14:48.029 INFO:teuthology.orchestra.run.smithi084.stderr:holetest.c: In function 'pt_write_marker': 2023-09-10T00:14:48.030 INFO:teuthology.orchestra.run.smithi084.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.030 INFO:teuthology.orchestra.run.smithi084.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-09-10T00:14:48.030 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.148 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_truncate_self 2023-09-10T00:14:48.283 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] af_unix 2023-09-10T00:14:48.438 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_stale_pmd 2023-09-10T00:14:48.545 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-09-10T00:14:48.545 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.546 INFO:teuthology.orchestra.run.smithi084.stderr: 42 | ftruncate(fd, 0); 2023-09-10T00:14:48.546 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.546 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.546 INFO:teuthology.orchestra.run.smithi084.stderr: 43 | ftruncate(fd, MiB(4)); 2023-09-10T00:14:48.547 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.547 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.547 INFO:teuthology.orchestra.run.smithi084.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-09-10T00:14:48.547 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.583 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_race 2023-09-10T00:14:48.688 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c: In function 'main': 2023-09-10T00:14:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.689 INFO:teuthology.orchestra.run.smithi084.stderr: 61 | ftruncate(fd, 0); 2023-09-10T00:14:48.689 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.689 INFO:teuthology.orchestra.run.smithi084.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:48.689 INFO:teuthology.orchestra.run.smithi084.stderr: 62 | ftruncate(fd, MiB(2)); 2023-09-10T00:14:48.690 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:48.738 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_fallocate 2023-09-10T00:14:48.871 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-err 2023-09-10T00:14:49.064 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_write_ro 2023-09-10T00:14:49.212 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_journal_corruption 2023-09-10T00:14:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-09-10T00:14:49.317 INFO:teuthology.orchestra.run.smithi084.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:49.317 INFO:teuthology.orchestra.run.smithi084.stderr: 61 | ftruncate(fd, 0); 2023-09-10T00:14:49.317 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:49.360 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ext4_dax_inline_corruption 2023-09-10T00:14:49.503 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_ofd_locks 2023-09-10T00:14:49.687 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_collision 2023-09-10T00:14:49.883 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-write-concurrent 2023-09-10T00:14:50.059 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_get_file_time 2023-09-10T00:14:50.183 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_short_dirs 2023-09-10T00:14:50.337 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_create_long_dirs 2023-09-10T00:14:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_enospc 2023-09-10T00:14:50.683 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_writev_overlap 2023-09-10T00:14:50.843 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] checkpoint_journal 2023-09-10T00:14:50.985 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mmap-rw-fault 2023-09-10T00:14:51.156 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] allocstale 2023-09-10T00:14:51.320 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_cow_memory_failure 2023-09-10T00:14:51.485 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fake-dump-rootino 2023-09-10T00:14:51.632 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-buf-fault 2023-09-10T00:14:51.771 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsctl 2023-09-10T00:14:51.950 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bstat 2023-09-10T00:14:52.160 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mtab 2023-09-10T00:14:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:t_mtab.c: In function 'update_mtab': 2023-09-10T00:14:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:52.265 INFO:teuthology.orchestra.run.smithi084.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-09-10T00:14:52.265 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:52.342 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] getdevicesize 2023-09-10T00:14:52.471 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_reader 2023-09-10T00:14:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-09-10T00:14:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c: In function 'main': 2023-09-10T00:14:52.587 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:52.587 INFO:teuthology.orchestra.run.smithi084.stderr: 38 | read(fd, &x, 1048576); 2023-09-10T00:14:52.588 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:52.622 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] preallo_rw_pattern_writer 2023-09-10T00:14:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-09-10T00:14:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c: In function 'main': 2023-09-10T00:14:52.738 INFO:teuthology.orchestra.run.smithi084.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:52.739 INFO:teuthology.orchestra.run.smithi084.stderr: 34 | write(fd, &x, 1048576); 2023-09-10T00:14:52.739 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:52.771 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ftrunc 2023-09-10T00:14:52.912 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] trunc 2023-09-10T00:14:53.070 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fs_perms 2023-09-10T00:14:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'main': 2023-09-10T00:14:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:53.183 INFO:teuthology.orchestra.run.smithi084.stderr: 54 | system("rm -f test.file"); 2023-09-10T00:14:53.184 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'testsetup': 2023-09-10T00:14:53.184 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:53.184 INFO:teuthology.orchestra.run.smithi084.stderr: 67 | system("cp testx.file test.file"); 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c: In function 'testfperm': 2023-09-10T00:14:53.185 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:53.186 INFO:teuthology.orchestra.run.smithi084.stderr: 123 | seteuid(0); 2023-09-10T00:14:53.186 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~ 2023-09-10T00:14:53.186 INFO:teuthology.orchestra.run.smithi084.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:53.186 INFO:teuthology.orchestra.run.smithi084.stderr: 124 | setegid(0); 2023-09-10T00:14:53.187 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~ 2023-09-10T00:14:53.236 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] testx 2023-09-10T00:14:53.357 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] looptest 2023-09-10T00:14:53.555 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] locktest 2023-09-10T00:14:53.876 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] unwritten_mmap 2023-09-10T00:14:54.041 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test 2023-09-10T00:14:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c: In function 'main': 2023-09-10T00:14:54.165 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:54.166 INFO:teuthology.orchestra.run.smithi084.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-09-10T00:14:54.166 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:54.166 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:54.166 INFO:teuthology.orchestra.run.smithi084.stderr: 178 | system(fname); 2023-09-10T00:14:54.167 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~ 2023-09-10T00:14:54.250 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] deduperace 2023-09-10T00:14:54.443 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_unlink_test_modified 2023-09-10T00:14:54.569 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-09-10T00:14:54.570 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:54.570 INFO:teuthology.orchestra.run.smithi084.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-09-10T00:14:54.570 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:54.570 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:54.571 INFO:teuthology.orchestra.run.smithi084.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-09-10T00:14:54.571 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:54.571 INFO:teuthology.orchestra.run.smithi084.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:54.571 INFO:teuthology.orchestra.run.smithi084.stderr: 185 | system(fname); 2023-09-10T00:14:54.571 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~ 2023-09-10T00:14:54.651 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset 2023-09-10T00:14:54.799 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_futimens 2023-09-10T00:14:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_immutable 2023-09-10T00:14:55.060 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'create_test_area': 2023-09-10T00:14:55.060 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.061 INFO:teuthology.orchestra.run.smithi084.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-09-10T00:14:55.061 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.061 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.061 INFO:teuthology.orchestra.run.smithi084.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-09-10T00:14:55.061 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.064 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'remove_test_area': 2023-09-10T00:14:55.064 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.064 INFO:teuthology.orchestra.run.smithi084.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-09-10T00:14:55.064 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.064 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.065 INFO:teuthology.orchestra.run.smithi084.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-09-10T00:14:55.065 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.065 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.065 INFO:teuthology.orchestra.run.smithi084.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-09-10T00:14:55.066 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.066 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.066 INFO:teuthology.orchestra.run.smithi084.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-09-10T00:14:55.066 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.067 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.067 INFO:teuthology.orchestra.run.smithi084.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-09-10T00:14:55.067 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.067 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.067 INFO:teuthology.orchestra.run.smithi084.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-09-10T00:14:55.068 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.068 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'check_test_area': 2023-09-10T00:14:55.068 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.068 INFO:teuthology.orchestra.run.smithi084.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-09-10T00:14:55.068 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.069 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.069 INFO:teuthology.orchestra.run.smithi084.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-09-10T00:14:55.069 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.069 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.069 INFO:teuthology.orchestra.run.smithi084.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-09-10T00:14:55.070 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.070 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.070 INFO:teuthology.orchestra.run.smithi084.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-09-10T00:14:55.070 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.070 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.071 INFO:teuthology.orchestra.run.smithi084.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-09-10T00:14:55.071 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.071 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.071 INFO:teuthology.orchestra.run.smithi084.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-09-10T00:14:55.071 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.072 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.072 INFO:teuthology.orchestra.run.smithi084.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-09-10T00:14:55.072 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.072 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.072 INFO:teuthology.orchestra.run.smithi084.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-09-10T00:14:55.073 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.073 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.073 INFO:teuthology.orchestra.run.smithi084.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-09-10T00:14:55.073 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.077 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'test_immutable': 2023-09-10T00:14:55.077 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.078 INFO:teuthology.orchestra.run.smithi084.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-09-10T00:14:55.078 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.078 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.078 INFO:teuthology.orchestra.run.smithi084.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-09-10T00:14:55.078 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.079 INFO:teuthology.orchestra.run.smithi084.stderr: 408 | chown(path, 0, 0); 2023-09-10T00:14:55.079 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.079 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.079 INFO:teuthology.orchestra.run.smithi084.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-09-10T00:14:55.080 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.080 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.080 INFO:teuthology.orchestra.run.smithi084.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-09-10T00:14:55.080 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.080 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.081 INFO:teuthology.orchestra.run.smithi084.stderr: 553 | chown(path, 0, 0); 2023-09-10T00:14:55.081 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.081 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.081 INFO:teuthology.orchestra.run.smithi084.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-09-10T00:14:55.081 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.082 INFO:teuthology.orchestra.run.smithi084.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-09-10T00:14:55.082 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.082 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.082 INFO:teuthology.orchestra.run.smithi084.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-09-10T00:14:55.083 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.083 INFO:teuthology.orchestra.run.smithi084.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-09-10T00:14:55.083 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.083 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.084 INFO:teuthology.orchestra.run.smithi084.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-09-10T00:14:55.084 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.084 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.084 INFO:teuthology.orchestra.run.smithi084.stderr: 653 | chown(path, 0, 0); 2023-09-10T00:14:55.084 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.085 INFO:teuthology.orchestra.run.smithi084.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-09-10T00:14:55.085 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.085 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.085 INFO:teuthology.orchestra.run.smithi084.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-09-10T00:14:55.086 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.086 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.086 INFO:teuthology.orchestra.run.smithi084.stderr: 705 | chown(path, 0, 0); 2023-09-10T00:14:55.086 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.086 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.087 INFO:teuthology.orchestra.run.smithi084.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-09-10T00:14:55.087 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.087 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c: In function 'test_append': 2023-09-10T00:14:55.087 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.087 INFO:teuthology.orchestra.run.smithi084.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-09-10T00:14:55.088 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.088 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.088 INFO:teuthology.orchestra.run.smithi084.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-09-10T00:14:55.088 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.088 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr: 1051 | chown(path, 0, 0); 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.089 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.090 INFO:teuthology.orchestra.run.smithi084.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-09-10T00:14:55.090 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.090 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.090 INFO:teuthology.orchestra.run.smithi084.stderr: 1516 | chown(path, 0, 0); 2023-09-10T00:14:55.091 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.091 INFO:teuthology.orchestra.run.smithi084.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-09-10T00:14:55.091 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.091 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.092 INFO:teuthology.orchestra.run.smithi084.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-09-10T00:14:55.092 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.092 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.092 INFO:teuthology.orchestra.run.smithi084.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-09-10T00:14:55.092 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.093 INFO:teuthology.orchestra.run.smithi084.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-09-10T00:14:55.093 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.093 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.093 INFO:teuthology.orchestra.run.smithi084.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-09-10T00:14:55.094 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.094 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.094 INFO:teuthology.orchestra.run.smithi084.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-09-10T00:14:55.095 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.095 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.095 INFO:teuthology.orchestra.run.smithi084.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-09-10T00:14:55.095 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.095 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr: 1618 | chown(path, 0, 0); 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.096 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.097 INFO:teuthology.orchestra.run.smithi084.stderr: 1644 | chown(path, 0, 0); 2023-09-10T00:14:55.097 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.097 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.097 INFO:teuthology.orchestra.run.smithi084.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-09-10T00:14:55.097 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.098 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.098 INFO:teuthology.orchestra.run.smithi084.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-09-10T00:14:55.098 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.098 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.098 INFO:teuthology.orchestra.run.smithi084.stderr: 1692 | chown(path, 0, 0); 2023-09-10T00:14:55.099 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.099 INFO:teuthology.orchestra.run.smithi084.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.099 INFO:teuthology.orchestra.run.smithi084.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-09-10T00:14:55.099 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.639 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stale_handle 2023-09-10T00:14:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:stale_handle.c: In function 'main': 2023-09-10T00:14:55.744 INFO:teuthology.orchestra.run.smithi084.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:55.744 INFO:teuthology.orchestra.run.smithi084.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-09-10T00:14:55.744 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:55.791 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] pwrite_mmap_blocked 2023-09-10T00:14:55.923 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_offset2 2023-09-10T00:14:56.098 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_sanity_test 2023-09-10T00:14:56.214 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'test18': 2023-09-10T00:14:56.215 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.215 INFO:teuthology.orchestra.run.smithi084.stderr: 460 | ftruncate(fd, 0); 2023-09-10T00:14:56.215 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.217 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-09-10T00:14:56.218 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.218 INFO:teuthology.orchestra.run.smithi084.stderr: 1207 | ftruncate(fd, 0); 2023-09-10T00:14:56.218 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.218 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.218 INFO:teuthology.orchestra.run.smithi084.stderr: 1256 | ftruncate(fd, 0); 2023-09-10T00:14:56.219 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.219 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-09-10T00:14:56.219 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.219 INFO:teuthology.orchestra.run.smithi084.stderr: 88 | ftruncate(fd, 0); 2023-09-10T00:14:56.219 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.220 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.220 INFO:teuthology.orchestra.run.smithi084.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-09-10T00:14:56.220 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.220 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.220 INFO:teuthology.orchestra.run.smithi084.stderr: 98 | ftruncate(fd, 0); 2023-09-10T00:14:56.221 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.221 INFO:teuthology.orchestra.run.smithi084.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.221 INFO:teuthology.orchestra.run.smithi084.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-09-10T00:14:56.221 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.552 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] seek_copy_test 2023-09-10T00:14:56.734 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_1 2023-09-10T00:14:56.837 INFO:teuthology.orchestra.run.smithi084.stderr:t_readdir_1.c: In function 'main': 2023-09-10T00:14:56.838 INFO:teuthology.orchestra.run.smithi084.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:56.838 INFO:teuthology.orchestra.run.smithi084.stderr: 30 | read(fd, buf, 100); 2023-09-10T00:14:56.838 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:56.871 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_2 2023-09-10T00:14:57.003 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fsync-tester 2023-09-10T00:14:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c: In function 'main': 2023-09-10T00:14:57.108 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:57.108 INFO:teuthology.orchestra.run.smithi084.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-09-10T00:14:57.108 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:57.109 INFO:teuthology.orchestra.run.smithi084.stderr: 541 | system("reboot -fn"); 2023-09-10T00:14:57.109 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:57.109 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-09-10T00:14:57.110 INFO:teuthology.orchestra.run.smithi084.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:57.110 INFO:teuthology.orchestra.run.smithi084.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-09-10T00:14:57.110 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:57.253 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] nsexec 2023-09-10T00:14:57.430 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] cloner 2023-09-10T00:14:57.592 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] renameat2 2023-09-10T00:14:57.762 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_getcwd 2023-09-10T00:14:57.863 INFO:teuthology.orchestra.run.smithi084.stderr:t_getcwd.c: In function 'test_getcwd': 2023-09-10T00:14:57.863 INFO:teuthology.orchestra.run.smithi084.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:57.863 INFO:teuthology.orchestra.run.smithi084.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-09-10T00:14:57.863 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:57.907 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] e4compact 2023-09-10T00:14:58.101 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] test-nextquota 2023-09-10T00:14:58.269 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] punch-alternating 2023-09-10T00:14:58.440 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr-list-by-handle-cursor-test 2023-09-10T00:14:58.599 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] listxattr 2023-09-10T00:14:58.724 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-interleaved 2023-09-10T00:14:58.863 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_dir_type 2023-09-10T00:14:58.998 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] dio-invalidate-cache 2023-09-10T00:14:59.095 INFO:teuthology.orchestra.run.smithi084.stderr:dio-invalidate-cache.c: In function 'main': 2023-09-10T00:14:59.096 INFO:teuthology.orchestra.run.smithi084.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:14:59.096 INFO:teuthology.orchestra.run.smithi084.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-09-10T00:14:59.096 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:14:59.193 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] stat_test 2023-09-10T00:14:59.499 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_encrypted_d_revalidate 2023-09-10T00:14:59.652 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] attr_replace_test 2023-09-10T00:14:59.802 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] swapon 2023-09-10T00:14:59.967 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mkswap 2023-09-10T00:15:00.117 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_attr_corruption 2023-09-10T00:15:00.254 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_open_tmpfiles 2023-09-10T00:15:00.427 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fscrypt-crypt-util 2023-09-10T00:15:01.089 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] bulkstat_null_ocount 2023-09-10T00:15:01.236 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice-test 2023-09-10T00:15:01.412 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] chprojid_fail 2023-09-10T00:15:01.568 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] detached_mounts_propagation 2023-09-10T00:15:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] ext4_resize 2023-09-10T00:15:01.885 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_readdir_3 2023-09-10T00:15:02.084 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] splice2pipe 2023-09-10T00:15:02.192 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-09-10T00:15:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:15:02.193 INFO:teuthology.orchestra.run.smithi084.stderr: 57 | write(p[1], buffer, n); 2023-09-10T00:15:02.193 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:15:02.193 INFO:teuthology.orchestra.run.smithi084.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:15:02.194 INFO:teuthology.orchestra.run.smithi084.stderr: 65 | read(p[0], buffer, n); 2023-09-10T00:15:02.194 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:15:02.246 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] uuid_ioctl 2023-09-10T00:15:02.403 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fiemap-tester 2023-09-10T00:15:02.672 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_stripealign 2023-09-10T00:15:02.832 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] open_by_handle 2023-09-10T00:15:03.096 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] t_mmap_dio 2023-09-10T00:15:03.246 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] xfsfind 2023-09-10T00:15:03.440 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] fssum 2023-09-10T00:15:03.908 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-10T00:15:03.916 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] replay-log 2023-09-10T00:15:04.247 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-10T00:15:04.251 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-10T00:15:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiocp 2023-09-10T00:15:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-fallocate-race 2023-09-10T00:15:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-append-write-read-race 2023-09-10T00:15:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cow-race 2023-09-10T00:15:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-cycle-write 2023-09-10T00:15:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-09-10T00:15:05.070 INFO:teuthology.orchestra.run.smithi084.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:15:05.070 INFO:teuthology.orchestra.run.smithi084.stderr: 83 | ftruncate(fd, buf_size); 2023-09-10T00:15:05.071 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:15:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-eof-race 2023-09-10T00:15:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-extend-stat 2023-09-10T00:15:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-fcntl-race 2023-09-10T00:15:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-hole-filling-race 2023-09-10T00:15:05.841 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-failure 2023-09-10T00:15:06.007 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-invalidate-readahead 2023-09-10T00:15:06.176 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aiodio_sparse2 2023-09-10T00:15:06.277 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-09-10T00:15:06.278 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:15:06.278 INFO:teuthology.orchestra.run.smithi084.stderr: 111 | ftruncate(fd, filesize); 2023-09-10T00:15:06.278 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-09-10T00:15:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-09-10T00:15:06.279 INFO:teuthology.orchestra.run.smithi084.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-09-10T00:15:06.279 INFO:teuthology.orchestra.run.smithi084.stderr: 274 | ftruncate(fd, size); 2023-09-10T00:15:06.280 INFO:teuthology.orchestra.run.smithi084.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-09-10T00:15:06.402 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-subblock-eof-read 2023-09-10T00:15:06.546 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-dio-write-verify 2023-09-10T00:15:06.739 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-09-10T00:15:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-09-10T00:15:06.994 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] aio-last-ref-held-by-io 2023-09-10T00:15:07.164 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-10T00:15:07.170 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] vfstest 2023-09-10T00:15:09.404 INFO:teuthology.orchestra.run.smithi084.stdout: [CC] mount-idmapped 2023-09-10T00:15:09.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:15:09.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:15:09.811 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2023-09-10T00:15:09.818 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2023-09-10T00:15:09.821 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2023-09-10T00:15:09.828 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2023-09-10T00:15:09.836 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/btrfs/group.list 2023-09-10T00:15:09.897 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2023-09-10T00:15:09.902 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ceph/group.list 2023-09-10T00:15:09.917 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2023-09-10T00:15:09.922 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/cifs/group.list 2023-09-10T00:15:09.935 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2023-09-10T00:15:09.941 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ext4/group.list 2023-09-10T00:15:09.981 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2023-09-10T00:15:09.986 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/f2fs/group.list 2023-09-10T00:15:10.004 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2023-09-10T00:15:10.012 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/generic/group.list 2023-09-10T00:15:10.110 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2023-09-10T00:15:10.115 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/nfs/group.list 2023-09-10T00:15:10.129 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2023-09-10T00:15:10.134 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ocfs2/group.list 2023-09-10T00:15:10.147 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2023-09-10T00:15:10.153 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/overlay/group.list 2023-09-10T00:15:10.188 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-10T00:15:10.193 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/perf/group.list 2023-09-10T00:15:10.203 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2023-09-10T00:15:10.208 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/selftest/group.list 2023-09-10T00:15:10.219 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2023-09-10T00:15:10.224 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/shared/group.list 2023-09-10T00:15:10.240 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2023-09-10T00:15:10.245 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/tmpfs/group.list 2023-09-10T00:15:10.257 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2023-09-10T00:15:10.262 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/udf/group.list 2023-09-10T00:15:10.273 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2023-09-10T00:15:10.279 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/xfs/group.list 2023-09-10T00:15:10.367 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo make install) 2023-09-10T00:15:10.387 INFO:teuthology.orchestra.run.smithi084.stdout:Building include 2023-09-10T00:15:10.391 INFO:teuthology.orchestra.run.smithi084.stdout:Building lib 2023-09-10T00:15:10.394 INFO:teuthology.orchestra.run.smithi084.stdout:Building ltp 2023-09-10T00:15:10.398 INFO:teuthology.orchestra.run.smithi084.stdout:Building src 2023-09-10T00:15:10.432 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-10T00:15:10.435 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-10T00:15:10.438 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-10T00:15:10.442 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-10T00:15:10.446 INFO:teuthology.orchestra.run.smithi084.stdout:Building m4 2023-09-10T00:15:10.449 INFO:teuthology.orchestra.run.smithi084.stdout:Building common 2023-09-10T00:15:10.452 INFO:teuthology.orchestra.run.smithi084.stdout:Building tests 2023-09-10T00:15:10.457 INFO:teuthology.orchestra.run.smithi084.stdout:Building btrfs 2023-09-10T00:15:10.463 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/btrfs/group.list 2023-09-10T00:15:10.516 INFO:teuthology.orchestra.run.smithi084.stdout:Building ceph 2023-09-10T00:15:10.521 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ceph/group.list 2023-09-10T00:15:10.533 INFO:teuthology.orchestra.run.smithi084.stdout:Building cifs 2023-09-10T00:15:10.537 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/cifs/group.list 2023-09-10T00:15:10.548 INFO:teuthology.orchestra.run.smithi084.stdout:Building ext4 2023-09-10T00:15:10.552 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ext4/group.list 2023-09-10T00:15:10.585 INFO:teuthology.orchestra.run.smithi084.stdout:Building f2fs 2023-09-10T00:15:10.590 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/f2fs/group.list 2023-09-10T00:15:10.605 INFO:teuthology.orchestra.run.smithi084.stdout:Building generic 2023-09-10T00:15:10.611 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/generic/group.list 2023-09-10T00:15:10.694 INFO:teuthology.orchestra.run.smithi084.stdout:Building nfs 2023-09-10T00:15:10.699 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/nfs/group.list 2023-09-10T00:15:10.711 INFO:teuthology.orchestra.run.smithi084.stdout:Building ocfs2 2023-09-10T00:15:10.715 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/ocfs2/group.list 2023-09-10T00:15:10.728 INFO:teuthology.orchestra.run.smithi084.stdout:Building overlay 2023-09-10T00:15:10.733 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/overlay/group.list 2023-09-10T00:15:10.767 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-10T00:15:10.772 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/perf/group.list 2023-09-10T00:15:10.784 INFO:teuthology.orchestra.run.smithi084.stdout:Building selftest 2023-09-10T00:15:10.789 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/selftest/group.list 2023-09-10T00:15:10.802 INFO:teuthology.orchestra.run.smithi084.stdout:Building shared 2023-09-10T00:15:10.807 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/shared/group.list 2023-09-10T00:15:10.823 INFO:teuthology.orchestra.run.smithi084.stdout:Building tmpfs 2023-09-10T00:15:10.828 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/tmpfs/group.list 2023-09-10T00:15:10.840 INFO:teuthology.orchestra.run.smithi084.stdout:Building udf 2023-09-10T00:15:10.845 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/udf/group.list 2023-09-10T00:15:10.856 INFO:teuthology.orchestra.run.smithi084.stdout:Building xfs 2023-09-10T00:15:10.862 INFO:teuthology.orchestra.run.smithi084.stdout: [GROUP] /tmp/tmp.4PMIK897QPxfstests-dev/tests/xfs/group.list 2023-09-10T00:15:10.951 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-09-10T00:15:10.953 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-10T00:15:10.953 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-09-10T00:15:10.956 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-10T00:15:10.956 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-09-10T00:15:10.959 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-09-10T00:15:10.966 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-09-10T00:15:11.035 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-09-10T00:15:11.043 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-09-10T00:15:11.059 INFO:teuthology.orchestra.run.smithi084.stdout:Building log-writes 2023-09-10T00:15:11.062 INFO:teuthology.orchestra.run.smithi084.stdout:Building perf 2023-09-10T00:15:11.065 INFO:teuthology.orchestra.run.smithi084.stdout:Building aio-dio-regress 2023-09-10T00:15:11.069 INFO:teuthology.orchestra.run.smithi084.stdout:Building vfs 2023-09-10T00:15:11.071 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C log-writes install 2023-09-10T00:15:11.073 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-09-10T00:15:11.081 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-09-10T00:15:11.090 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C perf install 2023-09-10T00:15:11.091 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-09-10T00:15:11.099 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-09-10T00:15:11.116 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-09-10T00:15:11.119 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-09-10T00:15:11.128 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-09-10T00:15:11.170 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake -C vfs install 2023-09-10T00:15:11.172 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-09-10T00:15:11.179 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-09-10T00:15:11.190 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-09-10T00:15:11.198 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-09-10T00:15:12.365 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-09-10T00:15:12.464 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-09-10T00:15:12.489 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-09-10T00:15:12.491 INFO:teuthology.orchestra.run.smithi084.stdout:gmake[1]: Nothing to be done for 'install'. 2023-09-10T00:15:12.492 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-09-10T00:15:12.493 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-09-10T00:15:12.502 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-09-10T00:15:12.613 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-09-10T00:15:12.616 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/btrfs/ install 2023-09-10T00:15:12.620 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-09-10T00:15:12.630 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-09-10T00:15:13.302 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-09-10T00:15:13.311 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-09-10T00:15:14.260 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/ceph/ install 2023-09-10T00:15:14.263 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-09-10T00:15:14.277 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-09-10T00:15:14.301 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-09-10T00:15:14.312 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-09-10T00:15:14.336 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/cifs/ install 2023-09-10T00:15:14.338 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-09-10T00:15:14.350 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-09-10T00:15:14.362 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-09-10T00:15:14.374 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-09-10T00:15:14.386 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/ext4/ install 2023-09-10T00:15:14.389 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-09-10T00:15:14.401 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-09-10T00:15:14.618 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-09-10T00:15:14.630 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-09-10T00:15:14.893 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/f2fs/ install 2023-09-10T00:15:14.895 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-09-10T00:15:14.907 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-09-10T00:15:14.921 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-09-10T00:15:14.933 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-09-10T00:15:14.947 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/generic/ install 2023-09-10T00:15:14.955 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-09-10T00:15:14.966 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-09-10T00:15:17.290 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-09-10T00:15:17.303 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-09-10T00:15:19.680 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/nfs/ install 2023-09-10T00:15:19.683 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-09-10T00:15:19.695 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-09-10T00:15:19.707 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-09-10T00:15:19.718 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-09-10T00:15:19.729 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/ocfs2/ install 2023-09-10T00:15:19.733 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-09-10T00:15:19.744 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-09-10T00:15:19.754 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-09-10T00:15:19.765 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-09-10T00:15:19.775 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/overlay/ install 2023-09-10T00:15:19.778 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-09-10T00:15:19.790 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-09-10T00:15:20.101 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-09-10T00:15:20.113 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-09-10T00:15:20.435 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/perf/ install 2023-09-10T00:15:20.438 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-09-10T00:15:20.450 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-09-10T00:15:20.462 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-09-10T00:15:20.474 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-09-10T00:15:20.486 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/selftest/ install 2023-09-10T00:15:20.489 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-09-10T00:15:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-09-10T00:15:20.528 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-09-10T00:15:20.539 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-09-10T00:15:20.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/shared/ install 2023-09-10T00:15:20.568 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-09-10T00:15:20.579 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-09-10T00:15:20.596 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-09-10T00:15:20.607 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-09-10T00:15:20.624 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/tmpfs/ install 2023-09-10T00:15:20.627 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-09-10T00:15:20.638 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-09-10T00:15:20.648 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-09-10T00:15:20.659 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-09-10T00:15:20.670 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/udf/ install 2023-09-10T00:15:20.672 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-09-10T00:15:20.683 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-09-10T00:15:20.694 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-09-10T00:15:20.704 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-09-10T00:15:20.715 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.4PMIK897QPxfstests-dev/tests/xfs/ install 2023-09-10T00:15:20.721 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-09-10T00:15:20.732 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-09-10T00:15:22.944 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-09-10T00:15:22.956 INFO:teuthology.orchestra.run.smithi084.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-09-10T00:15:25.220 INFO:teuthology.orchestra.run.smithi084.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-09-10T00:15:25.234 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-09-10T00:15:25.246 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-09-10T00:15:25.258 INFO:teuthology.orchestra.run.smithi084.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-09-10T00:15:25.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T00:15:25.275 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec ls tests/generic) 2023-09-10T00:15:25.322 INFO:teuthology.orchestra.run.smithi084.stdout:001 2023-09-10T00:15:25.323 INFO:teuthology.orchestra.run.smithi084.stdout:001.out 2023-09-10T00:15:25.323 INFO:teuthology.orchestra.run.smithi084.stdout:002 2023-09-10T00:15:25.323 INFO:teuthology.orchestra.run.smithi084.stdout:002.out 2023-09-10T00:15:25.323 INFO:teuthology.orchestra.run.smithi084.stdout:003 2023-09-10T00:15:25.324 INFO:teuthology.orchestra.run.smithi084.stdout:003.out 2023-09-10T00:15:25.324 INFO:teuthology.orchestra.run.smithi084.stdout:004 2023-09-10T00:15:25.324 INFO:teuthology.orchestra.run.smithi084.stdout:004.out 2023-09-10T00:15:25.324 INFO:teuthology.orchestra.run.smithi084.stdout:005 2023-09-10T00:15:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:005.out 2023-09-10T00:15:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:006 2023-09-10T00:15:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:006.out 2023-09-10T00:15:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:007 2023-09-10T00:15:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:007.out 2023-09-10T00:15:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:008 2023-09-10T00:15:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:008.out 2023-09-10T00:15:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:009 2023-09-10T00:15:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:009.out 2023-09-10T00:15:25.326 INFO:teuthology.orchestra.run.smithi084.stdout:010 2023-09-10T00:15:25.327 INFO:teuthology.orchestra.run.smithi084.stdout:010.out 2023-09-10T00:15:25.327 INFO:teuthology.orchestra.run.smithi084.stdout:011 2023-09-10T00:15:25.327 INFO:teuthology.orchestra.run.smithi084.stdout:011.out 2023-09-10T00:15:25.327 INFO:teuthology.orchestra.run.smithi084.stdout:012 2023-09-10T00:15:25.328 INFO:teuthology.orchestra.run.smithi084.stdout:012.out 2023-09-10T00:15:25.328 INFO:teuthology.orchestra.run.smithi084.stdout:013 2023-09-10T00:15:25.328 INFO:teuthology.orchestra.run.smithi084.stdout:013.out 2023-09-10T00:15:25.328 INFO:teuthology.orchestra.run.smithi084.stdout:014 2023-09-10T00:15:25.328 INFO:teuthology.orchestra.run.smithi084.stdout:014.out 2023-09-10T00:15:25.329 INFO:teuthology.orchestra.run.smithi084.stdout:015 2023-09-10T00:15:25.329 INFO:teuthology.orchestra.run.smithi084.stdout:015.out 2023-09-10T00:15:25.329 INFO:teuthology.orchestra.run.smithi084.stdout:016 2023-09-10T00:15:25.329 INFO:teuthology.orchestra.run.smithi084.stdout:016.out 2023-09-10T00:15:25.329 INFO:teuthology.orchestra.run.smithi084.stdout:017 2023-09-10T00:15:25.330 INFO:teuthology.orchestra.run.smithi084.stdout:017.out 2023-09-10T00:15:25.330 INFO:teuthology.orchestra.run.smithi084.stdout:018 2023-09-10T00:15:25.330 INFO:teuthology.orchestra.run.smithi084.stdout:018.out 2023-09-10T00:15:25.330 INFO:teuthology.orchestra.run.smithi084.stdout:019 2023-09-10T00:15:25.330 INFO:teuthology.orchestra.run.smithi084.stdout:019.out 2023-09-10T00:15:25.331 INFO:teuthology.orchestra.run.smithi084.stdout:020 2023-09-10T00:15:25.331 INFO:teuthology.orchestra.run.smithi084.stdout:020.out 2023-09-10T00:15:25.331 INFO:teuthology.orchestra.run.smithi084.stdout:021 2023-09-10T00:15:25.331 INFO:teuthology.orchestra.run.smithi084.stdout:021.out 2023-09-10T00:15:25.331 INFO:teuthology.orchestra.run.smithi084.stdout:022 2023-09-10T00:15:25.332 INFO:teuthology.orchestra.run.smithi084.stdout:022.out 2023-09-10T00:15:25.332 INFO:teuthology.orchestra.run.smithi084.stdout:023 2023-09-10T00:15:25.332 INFO:teuthology.orchestra.run.smithi084.stdout:023.out 2023-09-10T00:15:25.332 INFO:teuthology.orchestra.run.smithi084.stdout:024 2023-09-10T00:15:25.333 INFO:teuthology.orchestra.run.smithi084.stdout:024.out 2023-09-10T00:15:25.333 INFO:teuthology.orchestra.run.smithi084.stdout:025 2023-09-10T00:15:25.333 INFO:teuthology.orchestra.run.smithi084.stdout:025.out 2023-09-10T00:15:25.333 INFO:teuthology.orchestra.run.smithi084.stdout:026 2023-09-10T00:15:25.334 INFO:teuthology.orchestra.run.smithi084.stdout:026.out 2023-09-10T00:15:25.334 INFO:teuthology.orchestra.run.smithi084.stdout:027 2023-09-10T00:15:25.334 INFO:teuthology.orchestra.run.smithi084.stdout:027.out 2023-09-10T00:15:25.334 INFO:teuthology.orchestra.run.smithi084.stdout:028 2023-09-10T00:15:25.335 INFO:teuthology.orchestra.run.smithi084.stdout:028.out 2023-09-10T00:15:25.335 INFO:teuthology.orchestra.run.smithi084.stdout:029 2023-09-10T00:15:25.335 INFO:teuthology.orchestra.run.smithi084.stdout:029.out 2023-09-10T00:15:25.335 INFO:teuthology.orchestra.run.smithi084.stdout:030 2023-09-10T00:15:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:030.out 2023-09-10T00:15:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:031 2023-09-10T00:15:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:031.out 2023-09-10T00:15:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:032 2023-09-10T00:15:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:032.out 2023-09-10T00:15:25.337 INFO:teuthology.orchestra.run.smithi084.stdout:033 2023-09-10T00:15:25.337 INFO:teuthology.orchestra.run.smithi084.stdout:033.out 2023-09-10T00:15:25.337 INFO:teuthology.orchestra.run.smithi084.stdout:034 2023-09-10T00:15:25.337 INFO:teuthology.orchestra.run.smithi084.stdout:034.out 2023-09-10T00:15:25.338 INFO:teuthology.orchestra.run.smithi084.stdout:035 2023-09-10T00:15:25.338 INFO:teuthology.orchestra.run.smithi084.stdout:035.cfg 2023-09-10T00:15:25.338 INFO:teuthology.orchestra.run.smithi084.stdout:035.out.default 2023-09-10T00:15:25.338 INFO:teuthology.orchestra.run.smithi084.stdout:035.out.nfs 2023-09-10T00:15:25.338 INFO:teuthology.orchestra.run.smithi084.stdout:036 2023-09-10T00:15:25.339 INFO:teuthology.orchestra.run.smithi084.stdout:036.out 2023-09-10T00:15:25.339 INFO:teuthology.orchestra.run.smithi084.stdout:037 2023-09-10T00:15:25.339 INFO:teuthology.orchestra.run.smithi084.stdout:037.out 2023-09-10T00:15:25.339 INFO:teuthology.orchestra.run.smithi084.stdout:038 2023-09-10T00:15:25.340 INFO:teuthology.orchestra.run.smithi084.stdout:038.out 2023-09-10T00:15:25.340 INFO:teuthology.orchestra.run.smithi084.stdout:039 2023-09-10T00:15:25.340 INFO:teuthology.orchestra.run.smithi084.stdout:039.out 2023-09-10T00:15:25.340 INFO:teuthology.orchestra.run.smithi084.stdout:040 2023-09-10T00:15:25.341 INFO:teuthology.orchestra.run.smithi084.stdout:040.out 2023-09-10T00:15:25.341 INFO:teuthology.orchestra.run.smithi084.stdout:041 2023-09-10T00:15:25.341 INFO:teuthology.orchestra.run.smithi084.stdout:041.out 2023-09-10T00:15:25.341 INFO:teuthology.orchestra.run.smithi084.stdout:042 2023-09-10T00:15:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:042.out 2023-09-10T00:15:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:043 2023-09-10T00:15:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:043.out 2023-09-10T00:15:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:044 2023-09-10T00:15:25.342 INFO:teuthology.orchestra.run.smithi084.stdout:044.out 2023-09-10T00:15:25.343 INFO:teuthology.orchestra.run.smithi084.stdout:045 2023-09-10T00:15:25.343 INFO:teuthology.orchestra.run.smithi084.stdout:045.out 2023-09-10T00:15:25.343 INFO:teuthology.orchestra.run.smithi084.stdout:046 2023-09-10T00:15:25.343 INFO:teuthology.orchestra.run.smithi084.stdout:046.out 2023-09-10T00:15:25.344 INFO:teuthology.orchestra.run.smithi084.stdout:047 2023-09-10T00:15:25.344 INFO:teuthology.orchestra.run.smithi084.stdout:047.out 2023-09-10T00:15:25.344 INFO:teuthology.orchestra.run.smithi084.stdout:048 2023-09-10T00:15:25.344 INFO:teuthology.orchestra.run.smithi084.stdout:048.out 2023-09-10T00:15:25.345 INFO:teuthology.orchestra.run.smithi084.stdout:049 2023-09-10T00:15:25.345 INFO:teuthology.orchestra.run.smithi084.stdout:049.out 2023-09-10T00:15:25.345 INFO:teuthology.orchestra.run.smithi084.stdout:050 2023-09-10T00:15:25.345 INFO:teuthology.orchestra.run.smithi084.stdout:050.cfg 2023-09-10T00:15:25.345 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.default 2023-09-10T00:15:25.346 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.nojournal 2023-09-10T00:15:25.346 INFO:teuthology.orchestra.run.smithi084.stdout:050.out.xfsquota 2023-09-10T00:15:25.346 INFO:teuthology.orchestra.run.smithi084.stdout:051 2023-09-10T00:15:25.346 INFO:teuthology.orchestra.run.smithi084.stdout:051.out 2023-09-10T00:15:25.347 INFO:teuthology.orchestra.run.smithi084.stdout:052 2023-09-10T00:15:25.347 INFO:teuthology.orchestra.run.smithi084.stdout:052.out 2023-09-10T00:15:25.347 INFO:teuthology.orchestra.run.smithi084.stdout:053 2023-09-10T00:15:25.347 INFO:teuthology.orchestra.run.smithi084.stdout:053.out 2023-09-10T00:15:25.347 INFO:teuthology.orchestra.run.smithi084.stdout:054 2023-09-10T00:15:25.348 INFO:teuthology.orchestra.run.smithi084.stdout:054.out 2023-09-10T00:15:25.348 INFO:teuthology.orchestra.run.smithi084.stdout:055 2023-09-10T00:15:25.348 INFO:teuthology.orchestra.run.smithi084.stdout:055.out 2023-09-10T00:15:25.348 INFO:teuthology.orchestra.run.smithi084.stdout:056 2023-09-10T00:15:25.349 INFO:teuthology.orchestra.run.smithi084.stdout:056.out 2023-09-10T00:15:25.349 INFO:teuthology.orchestra.run.smithi084.stdout:057 2023-09-10T00:15:25.349 INFO:teuthology.orchestra.run.smithi084.stdout:057.out 2023-09-10T00:15:25.349 INFO:teuthology.orchestra.run.smithi084.stdout:058 2023-09-10T00:15:25.349 INFO:teuthology.orchestra.run.smithi084.stdout:058.out 2023-09-10T00:15:25.350 INFO:teuthology.orchestra.run.smithi084.stdout:059 2023-09-10T00:15:25.350 INFO:teuthology.orchestra.run.smithi084.stdout:059.out 2023-09-10T00:15:25.350 INFO:teuthology.orchestra.run.smithi084.stdout:060 2023-09-10T00:15:25.350 INFO:teuthology.orchestra.run.smithi084.stdout:060.out 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:061 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:061.out 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:062 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:062.out 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:063 2023-09-10T00:15:25.351 INFO:teuthology.orchestra.run.smithi084.stdout:063.out 2023-09-10T00:15:25.352 INFO:teuthology.orchestra.run.smithi084.stdout:064 2023-09-10T00:15:25.352 INFO:teuthology.orchestra.run.smithi084.stdout:064.out 2023-09-10T00:15:25.352 INFO:teuthology.orchestra.run.smithi084.stdout:065 2023-09-10T00:15:25.352 INFO:teuthology.orchestra.run.smithi084.stdout:065.out 2023-09-10T00:15:25.352 INFO:teuthology.orchestra.run.smithi084.stdout:066 2023-09-10T00:15:25.353 INFO:teuthology.orchestra.run.smithi084.stdout:066.out 2023-09-10T00:15:25.353 INFO:teuthology.orchestra.run.smithi084.stdout:067 2023-09-10T00:15:25.353 INFO:teuthology.orchestra.run.smithi084.stdout:067.out 2023-09-10T00:15:25.353 INFO:teuthology.orchestra.run.smithi084.stdout:068 2023-09-10T00:15:25.353 INFO:teuthology.orchestra.run.smithi084.stdout:068.out 2023-09-10T00:15:25.354 INFO:teuthology.orchestra.run.smithi084.stdout:069 2023-09-10T00:15:25.354 INFO:teuthology.orchestra.run.smithi084.stdout:069.out 2023-09-10T00:15:25.354 INFO:teuthology.orchestra.run.smithi084.stdout:070 2023-09-10T00:15:25.354 INFO:teuthology.orchestra.run.smithi084.stdout:070.out 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:071 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:071.out 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:072 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:072.out 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:073 2023-09-10T00:15:25.355 INFO:teuthology.orchestra.run.smithi084.stdout:073.out 2023-09-10T00:15:25.356 INFO:teuthology.orchestra.run.smithi084.stdout:074 2023-09-10T00:15:25.356 INFO:teuthology.orchestra.run.smithi084.stdout:074.out 2023-09-10T00:15:25.356 INFO:teuthology.orchestra.run.smithi084.stdout:075 2023-09-10T00:15:25.356 INFO:teuthology.orchestra.run.smithi084.stdout:075.out 2023-09-10T00:15:25.356 INFO:teuthology.orchestra.run.smithi084.stdout:076 2023-09-10T00:15:25.357 INFO:teuthology.orchestra.run.smithi084.stdout:076.out 2023-09-10T00:15:25.357 INFO:teuthology.orchestra.run.smithi084.stdout:077 2023-09-10T00:15:25.357 INFO:teuthology.orchestra.run.smithi084.stdout:077.out 2023-09-10T00:15:25.357 INFO:teuthology.orchestra.run.smithi084.stdout:078 2023-09-10T00:15:25.357 INFO:teuthology.orchestra.run.smithi084.stdout:078.out 2023-09-10T00:15:25.358 INFO:teuthology.orchestra.run.smithi084.stdout:079 2023-09-10T00:15:25.358 INFO:teuthology.orchestra.run.smithi084.stdout:079.out 2023-09-10T00:15:25.358 INFO:teuthology.orchestra.run.smithi084.stdout:080 2023-09-10T00:15:25.358 INFO:teuthology.orchestra.run.smithi084.stdout:080.out 2023-09-10T00:15:25.358 INFO:teuthology.orchestra.run.smithi084.stdout:081 2023-09-10T00:15:25.359 INFO:teuthology.orchestra.run.smithi084.stdout:081.out 2023-09-10T00:15:25.359 INFO:teuthology.orchestra.run.smithi084.stdout:082 2023-09-10T00:15:25.359 INFO:teuthology.orchestra.run.smithi084.stdout:082.out 2023-09-10T00:15:25.359 INFO:teuthology.orchestra.run.smithi084.stdout:083 2023-09-10T00:15:25.359 INFO:teuthology.orchestra.run.smithi084.stdout:083.out 2023-09-10T00:15:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:084 2023-09-10T00:15:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:084.out 2023-09-10T00:15:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:085 2023-09-10T00:15:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:085.out 2023-09-10T00:15:25.360 INFO:teuthology.orchestra.run.smithi084.stdout:086 2023-09-10T00:15:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:086.out 2023-09-10T00:15:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:087 2023-09-10T00:15:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:087.out 2023-09-10T00:15:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:088 2023-09-10T00:15:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:088.out 2023-09-10T00:15:25.362 INFO:teuthology.orchestra.run.smithi084.stdout:089 2023-09-10T00:15:25.362 INFO:teuthology.orchestra.run.smithi084.stdout:089.out 2023-09-10T00:15:25.362 INFO:teuthology.orchestra.run.smithi084.stdout:090 2023-09-10T00:15:25.362 INFO:teuthology.orchestra.run.smithi084.stdout:090.out 2023-09-10T00:15:25.362 INFO:teuthology.orchestra.run.smithi084.stdout:091 2023-09-10T00:15:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:091.out 2023-09-10T00:15:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:092 2023-09-10T00:15:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:092.out 2023-09-10T00:15:25.363 INFO:teuthology.orchestra.run.smithi084.stdout:093 2023-09-10T00:15:25.364 INFO:teuthology.orchestra.run.smithi084.stdout:093.out 2023-09-10T00:15:25.364 INFO:teuthology.orchestra.run.smithi084.stdout:094 2023-09-10T00:15:25.364 INFO:teuthology.orchestra.run.smithi084.stdout:094.out 2023-09-10T00:15:25.364 INFO:teuthology.orchestra.run.smithi084.stdout:095 2023-09-10T00:15:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:095.out 2023-09-10T00:15:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:096 2023-09-10T00:15:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:096.out 2023-09-10T00:15:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:097 2023-09-10T00:15:25.365 INFO:teuthology.orchestra.run.smithi084.stdout:097.out 2023-09-10T00:15:25.366 INFO:teuthology.orchestra.run.smithi084.stdout:098 2023-09-10T00:15:25.366 INFO:teuthology.orchestra.run.smithi084.stdout:098.out 2023-09-10T00:15:25.366 INFO:teuthology.orchestra.run.smithi084.stdout:099 2023-09-10T00:15:25.366 INFO:teuthology.orchestra.run.smithi084.stdout:099.out 2023-09-10T00:15:25.367 INFO:teuthology.orchestra.run.smithi084.stdout:100 2023-09-10T00:15:25.367 INFO:teuthology.orchestra.run.smithi084.stdout:100.out 2023-09-10T00:15:25.367 INFO:teuthology.orchestra.run.smithi084.stdout:101 2023-09-10T00:15:25.367 INFO:teuthology.orchestra.run.smithi084.stdout:101.out 2023-09-10T00:15:25.368 INFO:teuthology.orchestra.run.smithi084.stdout:102 2023-09-10T00:15:25.368 INFO:teuthology.orchestra.run.smithi084.stdout:102.out 2023-09-10T00:15:25.368 INFO:teuthology.orchestra.run.smithi084.stdout:103 2023-09-10T00:15:25.368 INFO:teuthology.orchestra.run.smithi084.stdout:103.out 2023-09-10T00:15:25.368 INFO:teuthology.orchestra.run.smithi084.stdout:104 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:104.out 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:105 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:105.out 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:106 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:106.out 2023-09-10T00:15:25.369 INFO:teuthology.orchestra.run.smithi084.stdout:107 2023-09-10T00:15:25.370 INFO:teuthology.orchestra.run.smithi084.stdout:107.out 2023-09-10T00:15:25.370 INFO:teuthology.orchestra.run.smithi084.stdout:108 2023-09-10T00:15:25.370 INFO:teuthology.orchestra.run.smithi084.stdout:108.out 2023-09-10T00:15:25.370 INFO:teuthology.orchestra.run.smithi084.stdout:109 2023-09-10T00:15:25.370 INFO:teuthology.orchestra.run.smithi084.stdout:109.out 2023-09-10T00:15:25.371 INFO:teuthology.orchestra.run.smithi084.stdout:110 2023-09-10T00:15:25.371 INFO:teuthology.orchestra.run.smithi084.stdout:110.out 2023-09-10T00:15:25.371 INFO:teuthology.orchestra.run.smithi084.stdout:111 2023-09-10T00:15:25.371 INFO:teuthology.orchestra.run.smithi084.stdout:111.out 2023-09-10T00:15:25.371 INFO:teuthology.orchestra.run.smithi084.stdout:112 2023-09-10T00:15:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:112.out 2023-09-10T00:15:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:113 2023-09-10T00:15:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:113.out 2023-09-10T00:15:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:114 2023-09-10T00:15:25.372 INFO:teuthology.orchestra.run.smithi084.stdout:114.out 2023-09-10T00:15:25.373 INFO:teuthology.orchestra.run.smithi084.stdout:115 2023-09-10T00:15:25.373 INFO:teuthology.orchestra.run.smithi084.stdout:115.out 2023-09-10T00:15:25.373 INFO:teuthology.orchestra.run.smithi084.stdout:116 2023-09-10T00:15:25.373 INFO:teuthology.orchestra.run.smithi084.stdout:116.out 2023-09-10T00:15:25.373 INFO:teuthology.orchestra.run.smithi084.stdout:117 2023-09-10T00:15:25.374 INFO:teuthology.orchestra.run.smithi084.stdout:117.out 2023-09-10T00:15:25.374 INFO:teuthology.orchestra.run.smithi084.stdout:118 2023-09-10T00:15:25.374 INFO:teuthology.orchestra.run.smithi084.stdout:118.out 2023-09-10T00:15:25.374 INFO:teuthology.orchestra.run.smithi084.stdout:119 2023-09-10T00:15:25.374 INFO:teuthology.orchestra.run.smithi084.stdout:119.out 2023-09-10T00:15:25.375 INFO:teuthology.orchestra.run.smithi084.stdout:120 2023-09-10T00:15:25.375 INFO:teuthology.orchestra.run.smithi084.stdout:120.out 2023-09-10T00:15:25.375 INFO:teuthology.orchestra.run.smithi084.stdout:121 2023-09-10T00:15:25.375 INFO:teuthology.orchestra.run.smithi084.stdout:121.out 2023-09-10T00:15:25.375 INFO:teuthology.orchestra.run.smithi084.stdout:122 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:122.out 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:123 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:123.out 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:124 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:124.out 2023-09-10T00:15:25.376 INFO:teuthology.orchestra.run.smithi084.stdout:125 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:125.out 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:126 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:126.out 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:127 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:127.out 2023-09-10T00:15:25.377 INFO:teuthology.orchestra.run.smithi084.stdout:128 2023-09-10T00:15:25.378 INFO:teuthology.orchestra.run.smithi084.stdout:128.out 2023-09-10T00:15:25.378 INFO:teuthology.orchestra.run.smithi084.stdout:129 2023-09-10T00:15:25.378 INFO:teuthology.orchestra.run.smithi084.stdout:129.out 2023-09-10T00:15:25.378 INFO:teuthology.orchestra.run.smithi084.stdout:130 2023-09-10T00:15:25.378 INFO:teuthology.orchestra.run.smithi084.stdout:130.out 2023-09-10T00:15:25.379 INFO:teuthology.orchestra.run.smithi084.stdout:131 2023-09-10T00:15:25.379 INFO:teuthology.orchestra.run.smithi084.stdout:131.out 2023-09-10T00:15:25.379 INFO:teuthology.orchestra.run.smithi084.stdout:132 2023-09-10T00:15:25.379 INFO:teuthology.orchestra.run.smithi084.stdout:132.out 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:133 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:133.out 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:134 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:134.out 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:135 2023-09-10T00:15:25.380 INFO:teuthology.orchestra.run.smithi084.stdout:135.out 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:136 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:136.out 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:137 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:137.out 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:138 2023-09-10T00:15:25.381 INFO:teuthology.orchestra.run.smithi084.stdout:138.out 2023-09-10T00:15:25.382 INFO:teuthology.orchestra.run.smithi084.stdout:139 2023-09-10T00:15:25.382 INFO:teuthology.orchestra.run.smithi084.stdout:139.out 2023-09-10T00:15:25.382 INFO:teuthology.orchestra.run.smithi084.stdout:140 2023-09-10T00:15:25.382 INFO:teuthology.orchestra.run.smithi084.stdout:140.out 2023-09-10T00:15:25.382 INFO:teuthology.orchestra.run.smithi084.stdout:141 2023-09-10T00:15:25.383 INFO:teuthology.orchestra.run.smithi084.stdout:141.out 2023-09-10T00:15:25.383 INFO:teuthology.orchestra.run.smithi084.stdout:142 2023-09-10T00:15:25.383 INFO:teuthology.orchestra.run.smithi084.stdout:142.out 2023-09-10T00:15:25.383 INFO:teuthology.orchestra.run.smithi084.stdout:143 2023-09-10T00:15:25.383 INFO:teuthology.orchestra.run.smithi084.stdout:143.out 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:144 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:144.out 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:145 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:145.out 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:146 2023-09-10T00:15:25.384 INFO:teuthology.orchestra.run.smithi084.stdout:146.out 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:147 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:147.out 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:148 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:148.out 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:149 2023-09-10T00:15:25.385 INFO:teuthology.orchestra.run.smithi084.stdout:149.out 2023-09-10T00:15:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:150 2023-09-10T00:15:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:150.out 2023-09-10T00:15:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:151 2023-09-10T00:15:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:151.out 2023-09-10T00:15:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:152 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:152.out 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:153 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:153.out 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:154 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:154.out 2023-09-10T00:15:25.387 INFO:teuthology.orchestra.run.smithi084.stdout:155 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:155.out 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:156 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:156.out 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:157 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:157.out 2023-09-10T00:15:25.388 INFO:teuthology.orchestra.run.smithi084.stdout:158 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:158.out 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:159 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:159.out 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:160 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:160.out 2023-09-10T00:15:25.389 INFO:teuthology.orchestra.run.smithi084.stdout:161 2023-09-10T00:15:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:161.out 2023-09-10T00:15:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:162 2023-09-10T00:15:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:162.out 2023-09-10T00:15:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:163 2023-09-10T00:15:25.390 INFO:teuthology.orchestra.run.smithi084.stdout:163.out 2023-09-10T00:15:25.391 INFO:teuthology.orchestra.run.smithi084.stdout:164 2023-09-10T00:15:25.391 INFO:teuthology.orchestra.run.smithi084.stdout:164.out 2023-09-10T00:15:25.391 INFO:teuthology.orchestra.run.smithi084.stdout:165 2023-09-10T00:15:25.391 INFO:teuthology.orchestra.run.smithi084.stdout:165.out 2023-09-10T00:15:25.391 INFO:teuthology.orchestra.run.smithi084.stdout:166 2023-09-10T00:15:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:166.out 2023-09-10T00:15:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:167 2023-09-10T00:15:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:167.out 2023-09-10T00:15:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:168 2023-09-10T00:15:25.392 INFO:teuthology.orchestra.run.smithi084.stdout:168.out 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:169 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:169.out 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:170 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:170.out 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:171 2023-09-10T00:15:25.393 INFO:teuthology.orchestra.run.smithi084.stdout:171.out 2023-09-10T00:15:25.394 INFO:teuthology.orchestra.run.smithi084.stdout:172 2023-09-10T00:15:25.394 INFO:teuthology.orchestra.run.smithi084.stdout:172.out 2023-09-10T00:15:25.394 INFO:teuthology.orchestra.run.smithi084.stdout:173 2023-09-10T00:15:25.394 INFO:teuthology.orchestra.run.smithi084.stdout:173.out 2023-09-10T00:15:25.395 INFO:teuthology.orchestra.run.smithi084.stdout:174 2023-09-10T00:15:25.395 INFO:teuthology.orchestra.run.smithi084.stdout:174.out 2023-09-10T00:15:25.395 INFO:teuthology.orchestra.run.smithi084.stdout:175 2023-09-10T00:15:25.395 INFO:teuthology.orchestra.run.smithi084.stdout:175.out 2023-09-10T00:15:25.395 INFO:teuthology.orchestra.run.smithi084.stdout:176 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:176.out 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:177 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:177.out 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:178 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:178.out 2023-09-10T00:15:25.396 INFO:teuthology.orchestra.run.smithi084.stdout:179 2023-09-10T00:15:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:179.out 2023-09-10T00:15:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:180 2023-09-10T00:15:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:180.out 2023-09-10T00:15:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:181 2023-09-10T00:15:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:181.out 2023-09-10T00:15:25.398 INFO:teuthology.orchestra.run.smithi084.stdout:182 2023-09-10T00:15:25.398 INFO:teuthology.orchestra.run.smithi084.stdout:182.out 2023-09-10T00:15:25.398 INFO:teuthology.orchestra.run.smithi084.stdout:183 2023-09-10T00:15:25.398 INFO:teuthology.orchestra.run.smithi084.stdout:183.out 2023-09-10T00:15:25.398 INFO:teuthology.orchestra.run.smithi084.stdout:184 2023-09-10T00:15:25.399 INFO:teuthology.orchestra.run.smithi084.stdout:184.out 2023-09-10T00:15:25.399 INFO:teuthology.orchestra.run.smithi084.stdout:185 2023-09-10T00:15:25.399 INFO:teuthology.orchestra.run.smithi084.stdout:185.out 2023-09-10T00:15:25.399 INFO:teuthology.orchestra.run.smithi084.stdout:186 2023-09-10T00:15:25.399 INFO:teuthology.orchestra.run.smithi084.stdout:186.out 2023-09-10T00:15:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:187 2023-09-10T00:15:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:187.out 2023-09-10T00:15:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:188 2023-09-10T00:15:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:188.out 2023-09-10T00:15:25.400 INFO:teuthology.orchestra.run.smithi084.stdout:189 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:189.out 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:190 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:190.out 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:191 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:191.out 2023-09-10T00:15:25.401 INFO:teuthology.orchestra.run.smithi084.stdout:192 2023-09-10T00:15:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:192.out 2023-09-10T00:15:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:193 2023-09-10T00:15:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:193.out 2023-09-10T00:15:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:194 2023-09-10T00:15:25.402 INFO:teuthology.orchestra.run.smithi084.stdout:194.out 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:195 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:195.out 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:196 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:196.out 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:197 2023-09-10T00:15:25.403 INFO:teuthology.orchestra.run.smithi084.stdout:197.out 2023-09-10T00:15:25.404 INFO:teuthology.orchestra.run.smithi084.stdout:198 2023-09-10T00:15:25.404 INFO:teuthology.orchestra.run.smithi084.stdout:198.out 2023-09-10T00:15:25.404 INFO:teuthology.orchestra.run.smithi084.stdout:199 2023-09-10T00:15:25.404 INFO:teuthology.orchestra.run.smithi084.stdout:199.out 2023-09-10T00:15:25.404 INFO:teuthology.orchestra.run.smithi084.stdout:200 2023-09-10T00:15:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:200.out 2023-09-10T00:15:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:201 2023-09-10T00:15:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:201.out 2023-09-10T00:15:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:202 2023-09-10T00:15:25.405 INFO:teuthology.orchestra.run.smithi084.stdout:202.out 2023-09-10T00:15:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:203 2023-09-10T00:15:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:203.out 2023-09-10T00:15:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:204 2023-09-10T00:15:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:204.out 2023-09-10T00:15:25.406 INFO:teuthology.orchestra.run.smithi084.stdout:205 2023-09-10T00:15:25.407 INFO:teuthology.orchestra.run.smithi084.stdout:205.out 2023-09-10T00:15:25.407 INFO:teuthology.orchestra.run.smithi084.stdout:206 2023-09-10T00:15:25.407 INFO:teuthology.orchestra.run.smithi084.stdout:206.out 2023-09-10T00:15:25.407 INFO:teuthology.orchestra.run.smithi084.stdout:207 2023-09-10T00:15:25.407 INFO:teuthology.orchestra.run.smithi084.stdout:207.out 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:208 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:208.out 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:209 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:209.out 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:210 2023-09-10T00:15:25.408 INFO:teuthology.orchestra.run.smithi084.stdout:210.out 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:211 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:211.out 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:212 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:212.out 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:213 2023-09-10T00:15:25.409 INFO:teuthology.orchestra.run.smithi084.stdout:213.out 2023-09-10T00:15:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:214 2023-09-10T00:15:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:214.out 2023-09-10T00:15:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:215 2023-09-10T00:15:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:215.out 2023-09-10T00:15:25.410 INFO:teuthology.orchestra.run.smithi084.stdout:216 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:216.out 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:217 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:217.out 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:218 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:218.out 2023-09-10T00:15:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:219 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:219.out 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:220 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:220.out 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:221 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:221.out 2023-09-10T00:15:25.412 INFO:teuthology.orchestra.run.smithi084.stdout:222 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:222.out 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:223 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:223.out 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:224 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:224.out 2023-09-10T00:15:25.413 INFO:teuthology.orchestra.run.smithi084.stdout:225 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:225.out 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:226 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:226.out 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:227 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:227.out 2023-09-10T00:15:25.414 INFO:teuthology.orchestra.run.smithi084.stdout:228 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:228.out 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:229 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:229.out 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:230 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:230.out 2023-09-10T00:15:25.415 INFO:teuthology.orchestra.run.smithi084.stdout:231 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:231.out 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:232 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:232.out 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:233 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:233.out 2023-09-10T00:15:25.416 INFO:teuthology.orchestra.run.smithi084.stdout:234 2023-09-10T00:15:25.417 INFO:teuthology.orchestra.run.smithi084.stdout:234.out 2023-09-10T00:15:25.417 INFO:teuthology.orchestra.run.smithi084.stdout:235 2023-09-10T00:15:25.417 INFO:teuthology.orchestra.run.smithi084.stdout:235.out 2023-09-10T00:15:25.417 INFO:teuthology.orchestra.run.smithi084.stdout:236 2023-09-10T00:15:25.417 INFO:teuthology.orchestra.run.smithi084.stdout:236.out 2023-09-10T00:15:25.418 INFO:teuthology.orchestra.run.smithi084.stdout:237 2023-09-10T00:15:25.418 INFO:teuthology.orchestra.run.smithi084.stdout:237.out 2023-09-10T00:15:25.418 INFO:teuthology.orchestra.run.smithi084.stdout:238 2023-09-10T00:15:25.418 INFO:teuthology.orchestra.run.smithi084.stdout:238.out 2023-09-10T00:15:25.418 INFO:teuthology.orchestra.run.smithi084.stdout:239 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:239.out 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:240 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:240.out 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:241 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:241.out 2023-09-10T00:15:25.419 INFO:teuthology.orchestra.run.smithi084.stdout:242 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:242.out 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:243 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:243.out 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:244 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:244.out 2023-09-10T00:15:25.420 INFO:teuthology.orchestra.run.smithi084.stdout:245 2023-09-10T00:15:25.421 INFO:teuthology.orchestra.run.smithi084.stdout:245.out 2023-09-10T00:15:25.421 INFO:teuthology.orchestra.run.smithi084.stdout:246 2023-09-10T00:15:25.421 INFO:teuthology.orchestra.run.smithi084.stdout:246.out 2023-09-10T00:15:25.421 INFO:teuthology.orchestra.run.smithi084.stdout:247 2023-09-10T00:15:25.421 INFO:teuthology.orchestra.run.smithi084.stdout:247.out 2023-09-10T00:15:25.422 INFO:teuthology.orchestra.run.smithi084.stdout:248 2023-09-10T00:15:25.422 INFO:teuthology.orchestra.run.smithi084.stdout:248.out 2023-09-10T00:15:25.422 INFO:teuthology.orchestra.run.smithi084.stdout:249 2023-09-10T00:15:25.422 INFO:teuthology.orchestra.run.smithi084.stdout:249.out 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:250 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:250.out 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:251 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:251.out 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:252 2023-09-10T00:15:25.423 INFO:teuthology.orchestra.run.smithi084.stdout:252.out 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:253 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:253.out 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:254 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:254.out 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:255 2023-09-10T00:15:25.424 INFO:teuthology.orchestra.run.smithi084.stdout:255.out 2023-09-10T00:15:25.425 INFO:teuthology.orchestra.run.smithi084.stdout:256 2023-09-10T00:15:25.425 INFO:teuthology.orchestra.run.smithi084.stdout:256.out 2023-09-10T00:15:25.425 INFO:teuthology.orchestra.run.smithi084.stdout:257 2023-09-10T00:15:25.425 INFO:teuthology.orchestra.run.smithi084.stdout:257.out 2023-09-10T00:15:25.425 INFO:teuthology.orchestra.run.smithi084.stdout:258 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:258.out 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:259 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:259.out 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:260 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:260.out 2023-09-10T00:15:25.426 INFO:teuthology.orchestra.run.smithi084.stdout:261 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:261.out 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:262 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:262.out 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:263 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:263.out 2023-09-10T00:15:25.427 INFO:teuthology.orchestra.run.smithi084.stdout:264 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:264.out 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:265 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:265.out 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:266 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:266.out 2023-09-10T00:15:25.428 INFO:teuthology.orchestra.run.smithi084.stdout:267 2023-09-10T00:15:25.429 INFO:teuthology.orchestra.run.smithi084.stdout:267.out 2023-09-10T00:15:25.429 INFO:teuthology.orchestra.run.smithi084.stdout:268 2023-09-10T00:15:25.429 INFO:teuthology.orchestra.run.smithi084.stdout:268.out 2023-09-10T00:15:25.429 INFO:teuthology.orchestra.run.smithi084.stdout:269 2023-09-10T00:15:25.429 INFO:teuthology.orchestra.run.smithi084.stdout:269.out 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:270 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:270.out 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:271 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:271.out 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:272 2023-09-10T00:15:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:272.out 2023-09-10T00:15:25.431 INFO:teuthology.orchestra.run.smithi084.stdout:273 2023-09-10T00:15:25.431 INFO:teuthology.orchestra.run.smithi084.stdout:273.out 2023-09-10T00:15:25.431 INFO:teuthology.orchestra.run.smithi084.stdout:274 2023-09-10T00:15:25.431 INFO:teuthology.orchestra.run.smithi084.stdout:274.out 2023-09-10T00:15:25.431 INFO:teuthology.orchestra.run.smithi084.stdout:275 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:275.out 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:276 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:276.out 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:277 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:277.out 2023-09-10T00:15:25.432 INFO:teuthology.orchestra.run.smithi084.stdout:278 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:278.out 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:279 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:279.out 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:280 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:280.out 2023-09-10T00:15:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:281 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:281.out 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:282 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:282.out 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:283 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:283.out 2023-09-10T00:15:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:284 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:284.out 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:285 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:285.out 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:286 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:286.out 2023-09-10T00:15:25.435 INFO:teuthology.orchestra.run.smithi084.stdout:287 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:287.out 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:288 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:288.out 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:289 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:289.out 2023-09-10T00:15:25.436 INFO:teuthology.orchestra.run.smithi084.stdout:290 2023-09-10T00:15:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:290.out 2023-09-10T00:15:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:291 2023-09-10T00:15:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:291.out 2023-09-10T00:15:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:292 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:292.out 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:293 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:293.out 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:294 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:294.out 2023-09-10T00:15:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:295 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:295.out 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:296 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:296.out 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:297 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:297.out 2023-09-10T00:15:25.439 INFO:teuthology.orchestra.run.smithi084.stdout:298 2023-09-10T00:15:25.440 INFO:teuthology.orchestra.run.smithi084.stdout:298.out 2023-09-10T00:15:25.440 INFO:teuthology.orchestra.run.smithi084.stdout:299 2023-09-10T00:15:25.440 INFO:teuthology.orchestra.run.smithi084.stdout:299.out 2023-09-10T00:15:25.440 INFO:teuthology.orchestra.run.smithi084.stdout:300 2023-09-10T00:15:25.440 INFO:teuthology.orchestra.run.smithi084.stdout:300.out 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:301 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:301.out 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:302 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:302.out 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:303 2023-09-10T00:15:25.441 INFO:teuthology.orchestra.run.smithi084.stdout:303.out 2023-09-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi084.stdout:304 2023-09-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi084.stdout:304.out 2023-09-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi084.stdout:305 2023-09-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi084.stdout:305.out 2023-09-10T00:15:25.442 INFO:teuthology.orchestra.run.smithi084.stdout:306 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:306.out 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:307 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:307.out 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:308 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:308.out 2023-09-10T00:15:25.443 INFO:teuthology.orchestra.run.smithi084.stdout:309 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:309.out 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:310 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:310.out 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:311 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:311.out 2023-09-10T00:15:25.444 INFO:teuthology.orchestra.run.smithi084.stdout:312 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:312.out 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:313 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:313.out 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:314 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:314.out 2023-09-10T00:15:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:315 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:315.out 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:316 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:316.out 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:317 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:317.out 2023-09-10T00:15:25.446 INFO:teuthology.orchestra.run.smithi084.stdout:318 2023-09-10T00:15:25.447 INFO:teuthology.orchestra.run.smithi084.stdout:318.out 2023-09-10T00:15:25.447 INFO:teuthology.orchestra.run.smithi084.stdout:319 2023-09-10T00:15:25.447 INFO:teuthology.orchestra.run.smithi084.stdout:319.out 2023-09-10T00:15:25.447 INFO:teuthology.orchestra.run.smithi084.stdout:320 2023-09-10T00:15:25.447 INFO:teuthology.orchestra.run.smithi084.stdout:320.out 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:321 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:321.out 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:322 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:322.out 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:323 2023-09-10T00:15:25.448 INFO:teuthology.orchestra.run.smithi084.stdout:323.out 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:324 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:324.out 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:325 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:325.out 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:326 2023-09-10T00:15:25.449 INFO:teuthology.orchestra.run.smithi084.stdout:326.out 2023-09-10T00:15:25.450 INFO:teuthology.orchestra.run.smithi084.stdout:327 2023-09-10T00:15:25.450 INFO:teuthology.orchestra.run.smithi084.stdout:327.out 2023-09-10T00:15:25.450 INFO:teuthology.orchestra.run.smithi084.stdout:328 2023-09-10T00:15:25.450 INFO:teuthology.orchestra.run.smithi084.stdout:328.out 2023-09-10T00:15:25.450 INFO:teuthology.orchestra.run.smithi084.stdout:329 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:329.out 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:330 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:330.out 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:331 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:331.out 2023-09-10T00:15:25.451 INFO:teuthology.orchestra.run.smithi084.stdout:332 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:332.out 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:333 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:333.out 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:334 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:334.out 2023-09-10T00:15:25.452 INFO:teuthology.orchestra.run.smithi084.stdout:335 2023-09-10T00:15:25.453 INFO:teuthology.orchestra.run.smithi084.stdout:335.out 2023-09-10T00:15:25.453 INFO:teuthology.orchestra.run.smithi084.stdout:336 2023-09-10T00:15:25.453 INFO:teuthology.orchestra.run.smithi084.stdout:336.out 2023-09-10T00:15:25.453 INFO:teuthology.orchestra.run.smithi084.stdout:337 2023-09-10T00:15:25.453 INFO:teuthology.orchestra.run.smithi084.stdout:337.out 2023-09-10T00:15:25.454 INFO:teuthology.orchestra.run.smithi084.stdout:338 2023-09-10T00:15:25.454 INFO:teuthology.orchestra.run.smithi084.stdout:338.out 2023-09-10T00:15:25.454 INFO:teuthology.orchestra.run.smithi084.stdout:339 2023-09-10T00:15:25.454 INFO:teuthology.orchestra.run.smithi084.stdout:339.out 2023-09-10T00:15:25.454 INFO:teuthology.orchestra.run.smithi084.stdout:340 2023-09-10T00:15:25.455 INFO:teuthology.orchestra.run.smithi084.stdout:340.out 2023-09-10T00:15:25.455 INFO:teuthology.orchestra.run.smithi084.stdout:341 2023-09-10T00:15:25.455 INFO:teuthology.orchestra.run.smithi084.stdout:341.out 2023-09-10T00:15:25.455 INFO:teuthology.orchestra.run.smithi084.stdout:342 2023-09-10T00:15:25.455 INFO:teuthology.orchestra.run.smithi084.stdout:342.out 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:343 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:343.out 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:344 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:344.out 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:345 2023-09-10T00:15:25.456 INFO:teuthology.orchestra.run.smithi084.stdout:345.out 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:346 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:346.out 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:347 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:347.out 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:348 2023-09-10T00:15:25.457 INFO:teuthology.orchestra.run.smithi084.stdout:348.out 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:349 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:349.out 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:350 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:350.out 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:351 2023-09-10T00:15:25.458 INFO:teuthology.orchestra.run.smithi084.stdout:351.out 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:352 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:352.out 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:353 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:353.out 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:354 2023-09-10T00:15:25.459 INFO:teuthology.orchestra.run.smithi084.stdout:354.out 2023-09-10T00:15:25.460 INFO:teuthology.orchestra.run.smithi084.stdout:355 2023-09-10T00:15:25.460 INFO:teuthology.orchestra.run.smithi084.stdout:355.out 2023-09-10T00:15:25.460 INFO:teuthology.orchestra.run.smithi084.stdout:356 2023-09-10T00:15:25.460 INFO:teuthology.orchestra.run.smithi084.stdout:356.out 2023-09-10T00:15:25.460 INFO:teuthology.orchestra.run.smithi084.stdout:357 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:357.out 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:358 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:358.out 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:359 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:359.out 2023-09-10T00:15:25.461 INFO:teuthology.orchestra.run.smithi084.stdout:360 2023-09-10T00:15:25.462 INFO:teuthology.orchestra.run.smithi084.stdout:360.out 2023-09-10T00:15:25.462 INFO:teuthology.orchestra.run.smithi084.stdout:361 2023-09-10T00:15:25.462 INFO:teuthology.orchestra.run.smithi084.stdout:361.out 2023-09-10T00:15:25.462 INFO:teuthology.orchestra.run.smithi084.stdout:362 2023-09-10T00:15:25.462 INFO:teuthology.orchestra.run.smithi084.stdout:362.out 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:363 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:363.out 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:364 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:364.out 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:365 2023-09-10T00:15:25.463 INFO:teuthology.orchestra.run.smithi084.stdout:365.out 2023-09-10T00:15:25.464 INFO:teuthology.orchestra.run.smithi084.stdout:366 2023-09-10T00:15:25.464 INFO:teuthology.orchestra.run.smithi084.stdout:366.out 2023-09-10T00:15:25.464 INFO:teuthology.orchestra.run.smithi084.stdout:367 2023-09-10T00:15:25.464 INFO:teuthology.orchestra.run.smithi084.stdout:367.out 2023-09-10T00:15:25.464 INFO:teuthology.orchestra.run.smithi084.stdout:368 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:368.out 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:369 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:369.out 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:370 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:370.out 2023-09-10T00:15:25.465 INFO:teuthology.orchestra.run.smithi084.stdout:371 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:371.out 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:372 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:372.out 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:373 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:373.out 2023-09-10T00:15:25.466 INFO:teuthology.orchestra.run.smithi084.stdout:374 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:374.out 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:375 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:375.out 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:376 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:376.out 2023-09-10T00:15:25.467 INFO:teuthology.orchestra.run.smithi084.stdout:377 2023-09-10T00:15:25.468 INFO:teuthology.orchestra.run.smithi084.stdout:377.out 2023-09-10T00:15:25.468 INFO:teuthology.orchestra.run.smithi084.stdout:378 2023-09-10T00:15:25.468 INFO:teuthology.orchestra.run.smithi084.stdout:378.out 2023-09-10T00:15:25.468 INFO:teuthology.orchestra.run.smithi084.stdout:379 2023-09-10T00:15:25.468 INFO:teuthology.orchestra.run.smithi084.stdout:379.out 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:380 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:380.out 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:381 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:381.out 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:382 2023-09-10T00:15:25.469 INFO:teuthology.orchestra.run.smithi084.stdout:382.out 2023-09-10T00:15:25.470 INFO:teuthology.orchestra.run.smithi084.stdout:383 2023-09-10T00:15:25.470 INFO:teuthology.orchestra.run.smithi084.stdout:383.out 2023-09-10T00:15:25.470 INFO:teuthology.orchestra.run.smithi084.stdout:384 2023-09-10T00:15:25.470 INFO:teuthology.orchestra.run.smithi084.stdout:384.out 2023-09-10T00:15:25.470 INFO:teuthology.orchestra.run.smithi084.stdout:385 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:385.out 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:386 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:386.out 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:387 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:387.out 2023-09-10T00:15:25.471 INFO:teuthology.orchestra.run.smithi084.stdout:388 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:388.out 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:389 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:389.out 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:390 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:390.out 2023-09-10T00:15:25.472 INFO:teuthology.orchestra.run.smithi084.stdout:391 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:391.out 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:392 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:392.out 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:393 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:393.out 2023-09-10T00:15:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:394 2023-09-10T00:15:25.474 INFO:teuthology.orchestra.run.smithi084.stdout:394.out 2023-09-10T00:15:25.474 INFO:teuthology.orchestra.run.smithi084.stdout:395 2023-09-10T00:15:25.474 INFO:teuthology.orchestra.run.smithi084.stdout:395.out 2023-09-10T00:15:25.474 INFO:teuthology.orchestra.run.smithi084.stdout:396 2023-09-10T00:15:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:396.out 2023-09-10T00:15:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:397 2023-09-10T00:15:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:397.out 2023-09-10T00:15:25.475 INFO:teuthology.orchestra.run.smithi084.stdout:398 2023-09-10T00:15:25.476 INFO:teuthology.orchestra.run.smithi084.stdout:398.out 2023-09-10T00:15:25.476 INFO:teuthology.orchestra.run.smithi084.stdout:399 2023-09-10T00:15:25.476 INFO:teuthology.orchestra.run.smithi084.stdout:399.out 2023-09-10T00:15:25.476 INFO:teuthology.orchestra.run.smithi084.stdout:400 2023-09-10T00:15:25.476 INFO:teuthology.orchestra.run.smithi084.stdout:400.out 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:401 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:401.out 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:402 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:402.out 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:403 2023-09-10T00:15:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:403.out 2023-09-10T00:15:25.478 INFO:teuthology.orchestra.run.smithi084.stdout:404 2023-09-10T00:15:25.478 INFO:teuthology.orchestra.run.smithi084.stdout:404.out 2023-09-10T00:15:25.478 INFO:teuthology.orchestra.run.smithi084.stdout:405 2023-09-10T00:15:25.478 INFO:teuthology.orchestra.run.smithi084.stdout:405.out 2023-09-10T00:15:25.478 INFO:teuthology.orchestra.run.smithi084.stdout:406 2023-09-10T00:15:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:406.out 2023-09-10T00:15:25.480 INFO:teuthology.orchestra.run.smithi084.stdout:407 2023-09-10T00:15:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:407.out 2023-09-10T00:15:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:408 2023-09-10T00:15:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:408.out 2023-09-10T00:15:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:409 2023-09-10T00:15:25.481 INFO:teuthology.orchestra.run.smithi084.stdout:409.out 2023-09-10T00:15:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:410 2023-09-10T00:15:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:410.out 2023-09-10T00:15:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:411 2023-09-10T00:15:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:411.out 2023-09-10T00:15:25.482 INFO:teuthology.orchestra.run.smithi084.stdout:412 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:412.out 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:413 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:413.out 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:414 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:414.out 2023-09-10T00:15:25.483 INFO:teuthology.orchestra.run.smithi084.stdout:415 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:415.out 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:416 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:416.out 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:417 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:417.out 2023-09-10T00:15:25.484 INFO:teuthology.orchestra.run.smithi084.stdout:418 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:418.out 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:419 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:419.out 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:420 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:420.out 2023-09-10T00:15:25.485 INFO:teuthology.orchestra.run.smithi084.stdout:421 2023-09-10T00:15:25.486 INFO:teuthology.orchestra.run.smithi084.stdout:421.out 2023-09-10T00:15:25.486 INFO:teuthology.orchestra.run.smithi084.stdout:422 2023-09-10T00:15:25.486 INFO:teuthology.orchestra.run.smithi084.stdout:422.out 2023-09-10T00:15:25.486 INFO:teuthology.orchestra.run.smithi084.stdout:423 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:423.out 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:424 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:424.out 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:425 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:425.out 2023-09-10T00:15:25.487 INFO:teuthology.orchestra.run.smithi084.stdout:426 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:426.out 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:427 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:427.out 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:428 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:428.out 2023-09-10T00:15:25.488 INFO:teuthology.orchestra.run.smithi084.stdout:429 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:429.out 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:430 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:430.out 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:431 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:431.out 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:432 2023-09-10T00:15:25.489 INFO:teuthology.orchestra.run.smithi084.stdout:432.out 2023-09-10T00:15:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:433 2023-09-10T00:15:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:433.out 2023-09-10T00:15:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:434 2023-09-10T00:15:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:434.out 2023-09-10T00:15:25.490 INFO:teuthology.orchestra.run.smithi084.stdout:435 2023-09-10T00:15:25.491 INFO:teuthology.orchestra.run.smithi084.stdout:435.out 2023-09-10T00:15:25.491 INFO:teuthology.orchestra.run.smithi084.stdout:436 2023-09-10T00:15:25.491 INFO:teuthology.orchestra.run.smithi084.stdout:436.out 2023-09-10T00:15:25.491 INFO:teuthology.orchestra.run.smithi084.stdout:437 2023-09-10T00:15:25.491 INFO:teuthology.orchestra.run.smithi084.stdout:437.out 2023-09-10T00:15:25.492 INFO:teuthology.orchestra.run.smithi084.stdout:438 2023-09-10T00:15:25.492 INFO:teuthology.orchestra.run.smithi084.stdout:438.out 2023-09-10T00:15:25.492 INFO:teuthology.orchestra.run.smithi084.stdout:439 2023-09-10T00:15:25.492 INFO:teuthology.orchestra.run.smithi084.stdout:439.out 2023-09-10T00:15:25.492 INFO:teuthology.orchestra.run.smithi084.stdout:440 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:440.out 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:441 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:441.out 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:442 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:442.out 2023-09-10T00:15:25.493 INFO:teuthology.orchestra.run.smithi084.stdout:443 2023-09-10T00:15:25.494 INFO:teuthology.orchestra.run.smithi084.stdout:443.out 2023-09-10T00:15:25.494 INFO:teuthology.orchestra.run.smithi084.stdout:444 2023-09-10T00:15:25.494 INFO:teuthology.orchestra.run.smithi084.stdout:444.out 2023-09-10T00:15:25.494 INFO:teuthology.orchestra.run.smithi084.stdout:445 2023-09-10T00:15:25.494 INFO:teuthology.orchestra.run.smithi084.stdout:445.out 2023-09-10T00:15:25.495 INFO:teuthology.orchestra.run.smithi084.stdout:446 2023-09-10T00:15:25.495 INFO:teuthology.orchestra.run.smithi084.stdout:446.out 2023-09-10T00:15:25.495 INFO:teuthology.orchestra.run.smithi084.stdout:447 2023-09-10T00:15:25.495 INFO:teuthology.orchestra.run.smithi084.stdout:447.out 2023-09-10T00:15:25.495 INFO:teuthology.orchestra.run.smithi084.stdout:448 2023-09-10T00:15:25.496 INFO:teuthology.orchestra.run.smithi084.stdout:448.out 2023-09-10T00:15:25.496 INFO:teuthology.orchestra.run.smithi084.stdout:449 2023-09-10T00:15:25.496 INFO:teuthology.orchestra.run.smithi084.stdout:449.out 2023-09-10T00:15:25.496 INFO:teuthology.orchestra.run.smithi084.stdout:450 2023-09-10T00:15:25.496 INFO:teuthology.orchestra.run.smithi084.stdout:450.out 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:451 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:451.out 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:452 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:452.out 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:453 2023-09-10T00:15:25.497 INFO:teuthology.orchestra.run.smithi084.stdout:453.out 2023-09-10T00:15:25.498 INFO:teuthology.orchestra.run.smithi084.stdout:454 2023-09-10T00:15:25.498 INFO:teuthology.orchestra.run.smithi084.stdout:454.out 2023-09-10T00:15:25.498 INFO:teuthology.orchestra.run.smithi084.stdout:455 2023-09-10T00:15:25.498 INFO:teuthology.orchestra.run.smithi084.stdout:455.out 2023-09-10T00:15:25.498 INFO:teuthology.orchestra.run.smithi084.stdout:456 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:456.out 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:457 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:457.out 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:458 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:458.out 2023-09-10T00:15:25.499 INFO:teuthology.orchestra.run.smithi084.stdout:459 2023-09-10T00:15:25.500 INFO:teuthology.orchestra.run.smithi084.stdout:459.out 2023-09-10T00:15:25.500 INFO:teuthology.orchestra.run.smithi084.stdout:460 2023-09-10T00:15:25.500 INFO:teuthology.orchestra.run.smithi084.stdout:460.out 2023-09-10T00:15:25.500 INFO:teuthology.orchestra.run.smithi084.stdout:461 2023-09-10T00:15:25.500 INFO:teuthology.orchestra.run.smithi084.stdout:461.out 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:462 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:462.out 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:463 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:463.out 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:464 2023-09-10T00:15:25.501 INFO:teuthology.orchestra.run.smithi084.stdout:464.out 2023-09-10T00:15:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:465 2023-09-10T00:15:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:465.out 2023-09-10T00:15:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:466 2023-09-10T00:15:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:466.out 2023-09-10T00:15:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:467 2023-09-10T00:15:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:467.out 2023-09-10T00:15:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:468 2023-09-10T00:15:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:468.out 2023-09-10T00:15:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:469 2023-09-10T00:15:25.503 INFO:teuthology.orchestra.run.smithi084.stdout:469.out 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:470 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:470.out 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:472 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:472.out 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:473 2023-09-10T00:15:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:473.out 2023-09-10T00:15:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:474 2023-09-10T00:15:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:474.out 2023-09-10T00:15:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:475 2023-09-10T00:15:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:475.out 2023-09-10T00:15:25.505 INFO:teuthology.orchestra.run.smithi084.stdout:476 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:476.out 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:477 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:477.out 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:478 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:478.out 2023-09-10T00:15:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:479 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:479.out 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:480 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:480.out 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:481 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:481.out 2023-09-10T00:15:25.507 INFO:teuthology.orchestra.run.smithi084.stdout:482 2023-09-10T00:15:25.508 INFO:teuthology.orchestra.run.smithi084.stdout:482.out 2023-09-10T00:15:25.508 INFO:teuthology.orchestra.run.smithi084.stdout:483 2023-09-10T00:15:25.508 INFO:teuthology.orchestra.run.smithi084.stdout:483.out 2023-09-10T00:15:25.508 INFO:teuthology.orchestra.run.smithi084.stdout:484 2023-09-10T00:15:25.508 INFO:teuthology.orchestra.run.smithi084.stdout:484.out 2023-09-10T00:15:25.509 INFO:teuthology.orchestra.run.smithi084.stdout:485 2023-09-10T00:15:25.509 INFO:teuthology.orchestra.run.smithi084.stdout:485.out 2023-09-10T00:15:25.509 INFO:teuthology.orchestra.run.smithi084.stdout:486 2023-09-10T00:15:25.509 INFO:teuthology.orchestra.run.smithi084.stdout:486.out 2023-09-10T00:15:25.509 INFO:teuthology.orchestra.run.smithi084.stdout:487 2023-09-10T00:15:25.510 INFO:teuthology.orchestra.run.smithi084.stdout:487.out 2023-09-10T00:15:25.510 INFO:teuthology.orchestra.run.smithi084.stdout:488 2023-09-10T00:15:25.510 INFO:teuthology.orchestra.run.smithi084.stdout:488.out 2023-09-10T00:15:25.510 INFO:teuthology.orchestra.run.smithi084.stdout:489 2023-09-10T00:15:25.510 INFO:teuthology.orchestra.run.smithi084.stdout:489.out 2023-09-10T00:15:25.511 INFO:teuthology.orchestra.run.smithi084.stdout:490 2023-09-10T00:15:25.511 INFO:teuthology.orchestra.run.smithi084.stdout:490.out 2023-09-10T00:15:25.511 INFO:teuthology.orchestra.run.smithi084.stdout:491 2023-09-10T00:15:25.511 INFO:teuthology.orchestra.run.smithi084.stdout:491.out 2023-09-10T00:15:25.511 INFO:teuthology.orchestra.run.smithi084.stdout:492 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:492.out 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:493 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:493.out 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:494 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:494.out 2023-09-10T00:15:25.512 INFO:teuthology.orchestra.run.smithi084.stdout:495 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:495.out 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:496 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:496.out 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:497 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:497.out 2023-09-10T00:15:25.513 INFO:teuthology.orchestra.run.smithi084.stdout:498 2023-09-10T00:15:25.514 INFO:teuthology.orchestra.run.smithi084.stdout:498.out 2023-09-10T00:15:25.514 INFO:teuthology.orchestra.run.smithi084.stdout:499 2023-09-10T00:15:25.514 INFO:teuthology.orchestra.run.smithi084.stdout:499.out 2023-09-10T00:15:25.514 INFO:teuthology.orchestra.run.smithi084.stdout:500 2023-09-10T00:15:25.514 INFO:teuthology.orchestra.run.smithi084.stdout:500.out 2023-09-10T00:15:25.515 INFO:teuthology.orchestra.run.smithi084.stdout:501 2023-09-10T00:15:25.515 INFO:teuthology.orchestra.run.smithi084.stdout:501.out 2023-09-10T00:15:25.515 INFO:teuthology.orchestra.run.smithi084.stdout:502 2023-09-10T00:15:25.515 INFO:teuthology.orchestra.run.smithi084.stdout:502.out 2023-09-10T00:15:25.515 INFO:teuthology.orchestra.run.smithi084.stdout:503 2023-09-10T00:15:25.516 INFO:teuthology.orchestra.run.smithi084.stdout:503.out 2023-09-10T00:15:25.516 INFO:teuthology.orchestra.run.smithi084.stdout:504 2023-09-10T00:15:25.516 INFO:teuthology.orchestra.run.smithi084.stdout:504.out 2023-09-10T00:15:25.516 INFO:teuthology.orchestra.run.smithi084.stdout:505 2023-09-10T00:15:25.516 INFO:teuthology.orchestra.run.smithi084.stdout:505.out 2023-09-10T00:15:25.517 INFO:teuthology.orchestra.run.smithi084.stdout:506 2023-09-10T00:15:25.517 INFO:teuthology.orchestra.run.smithi084.stdout:506.out 2023-09-10T00:15:25.517 INFO:teuthology.orchestra.run.smithi084.stdout:507 2023-09-10T00:15:25.517 INFO:teuthology.orchestra.run.smithi084.stdout:507.out 2023-09-10T00:15:25.517 INFO:teuthology.orchestra.run.smithi084.stdout:508 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:508.out 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:509 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:509.out 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:510 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:510.out 2023-09-10T00:15:25.518 INFO:teuthology.orchestra.run.smithi084.stdout:511 2023-09-10T00:15:25.519 INFO:teuthology.orchestra.run.smithi084.stdout:511.out 2023-09-10T00:15:25.519 INFO:teuthology.orchestra.run.smithi084.stdout:512 2023-09-10T00:15:25.519 INFO:teuthology.orchestra.run.smithi084.stdout:512.out 2023-09-10T00:15:25.519 INFO:teuthology.orchestra.run.smithi084.stdout:513 2023-09-10T00:15:25.519 INFO:teuthology.orchestra.run.smithi084.stdout:513.out 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:514 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:514.out 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:515 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:515.out 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:516 2023-09-10T00:15:25.520 INFO:teuthology.orchestra.run.smithi084.stdout:516.out 2023-09-10T00:15:25.521 INFO:teuthology.orchestra.run.smithi084.stdout:517 2023-09-10T00:15:25.521 INFO:teuthology.orchestra.run.smithi084.stdout:517.out 2023-09-10T00:15:25.521 INFO:teuthology.orchestra.run.smithi084.stdout:518 2023-09-10T00:15:25.521 INFO:teuthology.orchestra.run.smithi084.stdout:518.out 2023-09-10T00:15:25.521 INFO:teuthology.orchestra.run.smithi084.stdout:519 2023-09-10T00:15:25.522 INFO:teuthology.orchestra.run.smithi084.stdout:519.out 2023-09-10T00:15:25.522 INFO:teuthology.orchestra.run.smithi084.stdout:520 2023-09-10T00:15:25.522 INFO:teuthology.orchestra.run.smithi084.stdout:520.out 2023-09-10T00:15:25.522 INFO:teuthology.orchestra.run.smithi084.stdout:521 2023-09-10T00:15:25.522 INFO:teuthology.orchestra.run.smithi084.stdout:521.out 2023-09-10T00:15:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:522 2023-09-10T00:15:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:522.out 2023-09-10T00:15:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:523 2023-09-10T00:15:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:523.out 2023-09-10T00:15:25.523 INFO:teuthology.orchestra.run.smithi084.stdout:524 2023-09-10T00:15:25.524 INFO:teuthology.orchestra.run.smithi084.stdout:524.out 2023-09-10T00:15:25.524 INFO:teuthology.orchestra.run.smithi084.stdout:525 2023-09-10T00:15:25.524 INFO:teuthology.orchestra.run.smithi084.stdout:525.out 2023-09-10T00:15:25.524 INFO:teuthology.orchestra.run.smithi084.stdout:526 2023-09-10T00:15:25.525 INFO:teuthology.orchestra.run.smithi084.stdout:526.out 2023-09-10T00:15:25.525 INFO:teuthology.orchestra.run.smithi084.stdout:527 2023-09-10T00:15:25.525 INFO:teuthology.orchestra.run.smithi084.stdout:527.out 2023-09-10T00:15:25.525 INFO:teuthology.orchestra.run.smithi084.stdout:528 2023-09-10T00:15:25.525 INFO:teuthology.orchestra.run.smithi084.stdout:528.out 2023-09-10T00:15:25.526 INFO:teuthology.orchestra.run.smithi084.stdout:529 2023-09-10T00:15:25.526 INFO:teuthology.orchestra.run.smithi084.stdout:529.out 2023-09-10T00:15:25.526 INFO:teuthology.orchestra.run.smithi084.stdout:530 2023-09-10T00:15:25.526 INFO:teuthology.orchestra.run.smithi084.stdout:530.out 2023-09-10T00:15:25.526 INFO:teuthology.orchestra.run.smithi084.stdout:531 2023-09-10T00:15:25.527 INFO:teuthology.orchestra.run.smithi084.stdout:531.out 2023-09-10T00:15:25.527 INFO:teuthology.orchestra.run.smithi084.stdout:532 2023-09-10T00:15:25.527 INFO:teuthology.orchestra.run.smithi084.stdout:532.out 2023-09-10T00:15:25.527 INFO:teuthology.orchestra.run.smithi084.stdout:533 2023-09-10T00:15:25.527 INFO:teuthology.orchestra.run.smithi084.stdout:533.out 2023-09-10T00:15:25.528 INFO:teuthology.orchestra.run.smithi084.stdout:534 2023-09-10T00:15:25.528 INFO:teuthology.orchestra.run.smithi084.stdout:534.out 2023-09-10T00:15:25.528 INFO:teuthology.orchestra.run.smithi084.stdout:535 2023-09-10T00:15:25.528 INFO:teuthology.orchestra.run.smithi084.stdout:535.out 2023-09-10T00:15:25.528 INFO:teuthology.orchestra.run.smithi084.stdout:536 2023-09-10T00:15:25.529 INFO:teuthology.orchestra.run.smithi084.stdout:536.out 2023-09-10T00:15:25.529 INFO:teuthology.orchestra.run.smithi084.stdout:537 2023-09-10T00:15:25.529 INFO:teuthology.orchestra.run.smithi084.stdout:537.out 2023-09-10T00:15:25.529 INFO:teuthology.orchestra.run.smithi084.stdout:538 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:538.out 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:539 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:539.out 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:540 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:540.out 2023-09-10T00:15:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:541 2023-09-10T00:15:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:541.out 2023-09-10T00:15:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:542 2023-09-10T00:15:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:542.out 2023-09-10T00:15:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:543 2023-09-10T00:15:25.531 INFO:teuthology.orchestra.run.smithi084.stdout:543.out 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:544 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:544.out 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:545 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:545.out 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:546 2023-09-10T00:15:25.532 INFO:teuthology.orchestra.run.smithi084.stdout:546.out 2023-09-10T00:15:25.533 INFO:teuthology.orchestra.run.smithi084.stdout:547 2023-09-10T00:15:25.533 INFO:teuthology.orchestra.run.smithi084.stdout:547.out 2023-09-10T00:15:25.533 INFO:teuthology.orchestra.run.smithi084.stdout:548 2023-09-10T00:15:25.533 INFO:teuthology.orchestra.run.smithi084.stdout:548.out 2023-09-10T00:15:25.533 INFO:teuthology.orchestra.run.smithi084.stdout:549 2023-09-10T00:15:25.534 INFO:teuthology.orchestra.run.smithi084.stdout:549.out 2023-09-10T00:15:25.534 INFO:teuthology.orchestra.run.smithi084.stdout:550 2023-09-10T00:15:25.534 INFO:teuthology.orchestra.run.smithi084.stdout:550.out 2023-09-10T00:15:25.534 INFO:teuthology.orchestra.run.smithi084.stdout:551 2023-09-10T00:15:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:551.out 2023-09-10T00:15:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:552 2023-09-10T00:15:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:552.out 2023-09-10T00:15:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:553 2023-09-10T00:15:25.535 INFO:teuthology.orchestra.run.smithi084.stdout:553.out 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:554 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:554.out 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:555 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:555.out 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:556 2023-09-10T00:15:25.536 INFO:teuthology.orchestra.run.smithi084.stdout:556.out 2023-09-10T00:15:25.537 INFO:teuthology.orchestra.run.smithi084.stdout:557 2023-09-10T00:15:25.537 INFO:teuthology.orchestra.run.smithi084.stdout:557.out 2023-09-10T00:15:25.537 INFO:teuthology.orchestra.run.smithi084.stdout:558 2023-09-10T00:15:25.537 INFO:teuthology.orchestra.run.smithi084.stdout:558.out 2023-09-10T00:15:25.537 INFO:teuthology.orchestra.run.smithi084.stdout:559 2023-09-10T00:15:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:559.out 2023-09-10T00:15:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:560 2023-09-10T00:15:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:560.out 2023-09-10T00:15:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:561 2023-09-10T00:15:25.538 INFO:teuthology.orchestra.run.smithi084.stdout:561.out 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:562 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:562.out 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:563 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:563.out 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:564 2023-09-10T00:15:25.539 INFO:teuthology.orchestra.run.smithi084.stdout:564.out 2023-09-10T00:15:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:565 2023-09-10T00:15:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:565.out 2023-09-10T00:15:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:566 2023-09-10T00:15:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:566.out 2023-09-10T00:15:25.540 INFO:teuthology.orchestra.run.smithi084.stdout:567 2023-09-10T00:15:25.541 INFO:teuthology.orchestra.run.smithi084.stdout:567.out 2023-09-10T00:15:25.541 INFO:teuthology.orchestra.run.smithi084.stdout:568 2023-09-10T00:15:25.541 INFO:teuthology.orchestra.run.smithi084.stdout:568.out 2023-09-10T00:15:25.541 INFO:teuthology.orchestra.run.smithi084.stdout:569 2023-09-10T00:15:25.541 INFO:teuthology.orchestra.run.smithi084.stdout:569.out 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:570 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:570.out 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:571 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:571.out 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:572 2023-09-10T00:15:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:572.out 2023-09-10T00:15:25.543 INFO:teuthology.orchestra.run.smithi084.stdout:573 2023-09-10T00:15:25.543 INFO:teuthology.orchestra.run.smithi084.stdout:573.out 2023-09-10T00:15:25.543 INFO:teuthology.orchestra.run.smithi084.stdout:574 2023-09-10T00:15:25.543 INFO:teuthology.orchestra.run.smithi084.stdout:574.out 2023-09-10T00:15:25.543 INFO:teuthology.orchestra.run.smithi084.stdout:575 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:575.out 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:576 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:576.out 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:577 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:577.out 2023-09-10T00:15:25.544 INFO:teuthology.orchestra.run.smithi084.stdout:578 2023-09-10T00:15:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:578.out 2023-09-10T00:15:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:579 2023-09-10T00:15:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:579.out 2023-09-10T00:15:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:580 2023-09-10T00:15:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:580.out 2023-09-10T00:15:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:581 2023-09-10T00:15:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:581.out 2023-09-10T00:15:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:582 2023-09-10T00:15:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:582.out 2023-09-10T00:15:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:583 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:583.out 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:584 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:584.out 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:585 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:585.out 2023-09-10T00:15:25.547 INFO:teuthology.orchestra.run.smithi084.stdout:586 2023-09-10T00:15:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:586.out 2023-09-10T00:15:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:587 2023-09-10T00:15:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:587.out 2023-09-10T00:15:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:588 2023-09-10T00:15:25.548 INFO:teuthology.orchestra.run.smithi084.stdout:588.out 2023-09-10T00:15:25.549 INFO:teuthology.orchestra.run.smithi084.stdout:589 2023-09-10T00:15:25.549 INFO:teuthology.orchestra.run.smithi084.stdout:589.out 2023-09-10T00:15:25.549 INFO:teuthology.orchestra.run.smithi084.stdout:590 2023-09-10T00:15:25.549 INFO:teuthology.orchestra.run.smithi084.stdout:590.out 2023-09-10T00:15:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:591 2023-09-10T00:15:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:591.out 2023-09-10T00:15:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:592 2023-09-10T00:15:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:592.out 2023-09-10T00:15:25.550 INFO:teuthology.orchestra.run.smithi084.stdout:593 2023-09-10T00:15:25.551 INFO:teuthology.orchestra.run.smithi084.stdout:593.out 2023-09-10T00:15:25.551 INFO:teuthology.orchestra.run.smithi084.stdout:594 2023-09-10T00:15:25.551 INFO:teuthology.orchestra.run.smithi084.stdout:594.out 2023-09-10T00:15:25.551 INFO:teuthology.orchestra.run.smithi084.stdout:595 2023-09-10T00:15:25.552 INFO:teuthology.orchestra.run.smithi084.stdout:595.out 2023-09-10T00:15:25.552 INFO:teuthology.orchestra.run.smithi084.stdout:596 2023-09-10T00:15:25.552 INFO:teuthology.orchestra.run.smithi084.stdout:596.out 2023-09-10T00:15:25.552 INFO:teuthology.orchestra.run.smithi084.stdout:597 2023-09-10T00:15:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:597.out 2023-09-10T00:15:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:598 2023-09-10T00:15:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:598.out 2023-09-10T00:15:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:599 2023-09-10T00:15:25.553 INFO:teuthology.orchestra.run.smithi084.stdout:599.out 2023-09-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi084.stdout:600 2023-09-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi084.stdout:600.out 2023-09-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi084.stdout:601 2023-09-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi084.stdout:601.out 2023-09-10T00:15:25.554 INFO:teuthology.orchestra.run.smithi084.stdout:602 2023-09-10T00:15:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:602.out 2023-09-10T00:15:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:603 2023-09-10T00:15:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:603.out 2023-09-10T00:15:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:604 2023-09-10T00:15:25.555 INFO:teuthology.orchestra.run.smithi084.stdout:604.out 2023-09-10T00:15:25.556 INFO:teuthology.orchestra.run.smithi084.stdout:605 2023-09-10T00:15:25.556 INFO:teuthology.orchestra.run.smithi084.stdout:605.out 2023-09-10T00:15:25.556 INFO:teuthology.orchestra.run.smithi084.stdout:606 2023-09-10T00:15:25.556 INFO:teuthology.orchestra.run.smithi084.stdout:606.out 2023-09-10T00:15:25.556 INFO:teuthology.orchestra.run.smithi084.stdout:607 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:607.out 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:608 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:608.out 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:609 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:609.out 2023-09-10T00:15:25.557 INFO:teuthology.orchestra.run.smithi084.stdout:610 2023-09-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:610.out 2023-09-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:611 2023-09-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:611.out 2023-09-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:612 2023-09-10T00:15:25.558 INFO:teuthology.orchestra.run.smithi084.stdout:612.out 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:613 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:613.out 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:614 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:614.out 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:615 2023-09-10T00:15:25.559 INFO:teuthology.orchestra.run.smithi084.stdout:615.out 2023-09-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:616 2023-09-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:616.out 2023-09-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:617 2023-09-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:617.out 2023-09-10T00:15:25.560 INFO:teuthology.orchestra.run.smithi084.stdout:618 2023-09-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:618.out 2023-09-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:619 2023-09-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:619.out 2023-09-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:620 2023-09-10T00:15:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:620.out 2023-09-10T00:15:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:621 2023-09-10T00:15:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:621.out 2023-09-10T00:15:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:622 2023-09-10T00:15:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:622.out 2023-09-10T00:15:25.562 INFO:teuthology.orchestra.run.smithi084.stdout:623 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:623.out 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:624 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:624.out 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:625 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:625.out 2023-09-10T00:15:25.563 INFO:teuthology.orchestra.run.smithi084.stdout:626 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:626.out 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:627 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:627.out 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:628 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:628.out 2023-09-10T00:15:25.564 INFO:teuthology.orchestra.run.smithi084.stdout:629 2023-09-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:629.out 2023-09-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:630 2023-09-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:630.out 2023-09-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:631 2023-09-10T00:15:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:631.out 2023-09-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi084.stdout:632 2023-09-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi084.stdout:632.out 2023-09-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi084.stdout:633 2023-09-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi084.stdout:633.out 2023-09-10T00:15:25.566 INFO:teuthology.orchestra.run.smithi084.stdout:634 2023-09-10T00:15:25.567 INFO:teuthology.orchestra.run.smithi084.stdout:634.out 2023-09-10T00:15:25.567 INFO:teuthology.orchestra.run.smithi084.stdout:635 2023-09-10T00:15:25.567 INFO:teuthology.orchestra.run.smithi084.stdout:635.out 2023-09-10T00:15:25.567 INFO:teuthology.orchestra.run.smithi084.stdout:636 2023-09-10T00:15:25.567 INFO:teuthology.orchestra.run.smithi084.stdout:636.out 2023-09-10T00:15:25.568 INFO:teuthology.orchestra.run.smithi084.stdout:637 2023-09-10T00:15:25.568 INFO:teuthology.orchestra.run.smithi084.stdout:637.out 2023-09-10T00:15:25.568 INFO:teuthology.orchestra.run.smithi084.stdout:638 2023-09-10T00:15:25.568 INFO:teuthology.orchestra.run.smithi084.stdout:638.out 2023-09-10T00:15:25.568 INFO:teuthology.orchestra.run.smithi084.stdout:639 2023-09-10T00:15:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:639.out 2023-09-10T00:15:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:640 2023-09-10T00:15:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:640.out 2023-09-10T00:15:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:641 2023-09-10T00:15:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:641.out 2023-09-10T00:15:25.570 INFO:teuthology.orchestra.run.smithi084.stdout:642 2023-09-10T00:15:25.570 INFO:teuthology.orchestra.run.smithi084.stdout:642.out 2023-09-10T00:15:25.570 INFO:teuthology.orchestra.run.smithi084.stdout:643 2023-09-10T00:15:25.570 INFO:teuthology.orchestra.run.smithi084.stdout:643.out 2023-09-10T00:15:25.570 INFO:teuthology.orchestra.run.smithi084.stdout:644 2023-09-10T00:15:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:644.out 2023-09-10T00:15:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:645 2023-09-10T00:15:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:645.out 2023-09-10T00:15:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:646 2023-09-10T00:15:25.571 INFO:teuthology.orchestra.run.smithi084.stdout:646.out 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:647 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:647.out 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:648 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:648.out 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:649 2023-09-10T00:15:25.572 INFO:teuthology.orchestra.run.smithi084.stdout:649.out 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:650 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:650.out 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:651 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:651.out 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:652 2023-09-10T00:15:25.573 INFO:teuthology.orchestra.run.smithi084.stdout:652.out 2023-09-10T00:15:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:653 2023-09-10T00:15:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:653.out 2023-09-10T00:15:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:654 2023-09-10T00:15:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:654.out 2023-09-10T00:15:25.574 INFO:teuthology.orchestra.run.smithi084.stdout:655 2023-09-10T00:15:25.575 INFO:teuthology.orchestra.run.smithi084.stdout:655.out 2023-09-10T00:15:25.575 INFO:teuthology.orchestra.run.smithi084.stdout:656 2023-09-10T00:15:25.575 INFO:teuthology.orchestra.run.smithi084.stdout:656.out 2023-09-10T00:15:25.575 INFO:teuthology.orchestra.run.smithi084.stdout:657 2023-09-10T00:15:25.575 INFO:teuthology.orchestra.run.smithi084.stdout:657.out 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:658 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:658.out 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:659 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:659.out 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:660 2023-09-10T00:15:25.576 INFO:teuthology.orchestra.run.smithi084.stdout:660.out 2023-09-10T00:15:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:661 2023-09-10T00:15:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:661.out 2023-09-10T00:15:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:662 2023-09-10T00:15:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:662.out 2023-09-10T00:15:25.577 INFO:teuthology.orchestra.run.smithi084.stdout:663 2023-09-10T00:15:25.578 INFO:teuthology.orchestra.run.smithi084.stdout:663.out 2023-09-10T00:15:25.578 INFO:teuthology.orchestra.run.smithi084.stdout:664 2023-09-10T00:15:25.578 INFO:teuthology.orchestra.run.smithi084.stdout:664.out 2023-09-10T00:15:25.578 INFO:teuthology.orchestra.run.smithi084.stdout:665 2023-09-10T00:15:25.578 INFO:teuthology.orchestra.run.smithi084.stdout:665.out 2023-09-10T00:15:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:666 2023-09-10T00:15:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:666.out 2023-09-10T00:15:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:667 2023-09-10T00:15:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:667.out 2023-09-10T00:15:25.579 INFO:teuthology.orchestra.run.smithi084.stdout:668 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:668.out 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:669 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:669.out 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:670 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:670.out 2023-09-10T00:15:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:671 2023-09-10T00:15:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:671.out 2023-09-10T00:15:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:672 2023-09-10T00:15:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:672.out 2023-09-10T00:15:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:673 2023-09-10T00:15:25.581 INFO:teuthology.orchestra.run.smithi084.stdout:673.out 2023-09-10T00:15:25.582 INFO:teuthology.orchestra.run.smithi084.stdout:674 2023-09-10T00:15:25.582 INFO:teuthology.orchestra.run.smithi084.stdout:674.out 2023-09-10T00:15:25.582 INFO:teuthology.orchestra.run.smithi084.stdout:675 2023-09-10T00:15:25.582 INFO:teuthology.orchestra.run.smithi084.stdout:675.out 2023-09-10T00:15:25.582 INFO:teuthology.orchestra.run.smithi084.stdout:676 2023-09-10T00:15:25.583 INFO:teuthology.orchestra.run.smithi084.stdout:676.out 2023-09-10T00:15:25.583 INFO:teuthology.orchestra.run.smithi084.stdout:677 2023-09-10T00:15:25.583 INFO:teuthology.orchestra.run.smithi084.stdout:677.out 2023-09-10T00:15:25.583 INFO:teuthology.orchestra.run.smithi084.stdout:678 2023-09-10T00:15:25.583 INFO:teuthology.orchestra.run.smithi084.stdout:678.out 2023-09-10T00:15:25.584 INFO:teuthology.orchestra.run.smithi084.stdout:679 2023-09-10T00:15:25.584 INFO:teuthology.orchestra.run.smithi084.stdout:679.out 2023-09-10T00:15:25.584 INFO:teuthology.orchestra.run.smithi084.stdout:680 2023-09-10T00:15:25.584 INFO:teuthology.orchestra.run.smithi084.stdout:680.out 2023-09-10T00:15:25.584 INFO:teuthology.orchestra.run.smithi084.stdout:681 2023-09-10T00:15:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:681.out 2023-09-10T00:15:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:682 2023-09-10T00:15:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:682.out 2023-09-10T00:15:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:683 2023-09-10T00:15:25.585 INFO:teuthology.orchestra.run.smithi084.stdout:683.out 2023-09-10T00:15:25.586 INFO:teuthology.orchestra.run.smithi084.stdout:684 2023-09-10T00:15:25.586 INFO:teuthology.orchestra.run.smithi084.stdout:684.out 2023-09-10T00:15:25.586 INFO:teuthology.orchestra.run.smithi084.stdout:685 2023-09-10T00:15:25.586 INFO:teuthology.orchestra.run.smithi084.stdout:685.out 2023-09-10T00:15:25.586 INFO:teuthology.orchestra.run.smithi084.stdout:686 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:686.out 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:687 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:687.out 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:688 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:688.out 2023-09-10T00:15:25.587 INFO:teuthology.orchestra.run.smithi084.stdout:689 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:689.out 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:690 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:690.out 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:691 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:691.out 2023-09-10T00:15:25.588 INFO:teuthology.orchestra.run.smithi084.stdout:692 2023-09-10T00:15:25.589 INFO:teuthology.orchestra.run.smithi084.stdout:692.out 2023-09-10T00:15:25.589 INFO:teuthology.orchestra.run.smithi084.stdout:693 2023-09-10T00:15:25.589 INFO:teuthology.orchestra.run.smithi084.stdout:693.out 2023-09-10T00:15:25.589 INFO:teuthology.orchestra.run.smithi084.stdout:694 2023-09-10T00:15:25.589 INFO:teuthology.orchestra.run.smithi084.stdout:694.out 2023-09-10T00:15:25.590 INFO:teuthology.orchestra.run.smithi084.stdout:695 2023-09-10T00:15:25.590 INFO:teuthology.orchestra.run.smithi084.stdout:695.out 2023-09-10T00:15:25.590 INFO:teuthology.orchestra.run.smithi084.stdout:696 2023-09-10T00:15:25.590 INFO:teuthology.orchestra.run.smithi084.stdout:696.out 2023-09-10T00:15:25.590 INFO:teuthology.orchestra.run.smithi084.stdout:697 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:697.out 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:698 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:698.out 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:699 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:699.out 2023-09-10T00:15:25.591 INFO:teuthology.orchestra.run.smithi084.stdout:700 2023-09-10T00:15:25.592 INFO:teuthology.orchestra.run.smithi084.stdout:700.out 2023-09-10T00:15:25.592 INFO:teuthology.orchestra.run.smithi084.stdout:701 2023-09-10T00:15:25.592 INFO:teuthology.orchestra.run.smithi084.stdout:701.out 2023-09-10T00:15:25.592 INFO:teuthology.orchestra.run.smithi084.stdout:702 2023-09-10T00:15:25.592 INFO:teuthology.orchestra.run.smithi084.stdout:702.out 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:703 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:703.out 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:704 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:704.out 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:705 2023-09-10T00:15:25.593 INFO:teuthology.orchestra.run.smithi084.stdout:705.out 2023-09-10T00:15:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:706 2023-09-10T00:15:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:706.out 2023-09-10T00:15:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:707 2023-09-10T00:15:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:707.out 2023-09-10T00:15:25.594 INFO:teuthology.orchestra.run.smithi084.stdout:708 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:708.out 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:709 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:709.out 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:710 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:710.out 2023-09-10T00:15:25.595 INFO:teuthology.orchestra.run.smithi084.stdout:711 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:711.out 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:712 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:712.out 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:713 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:713.out 2023-09-10T00:15:25.596 INFO:teuthology.orchestra.run.smithi084.stdout:714 2023-09-10T00:15:25.597 INFO:teuthology.orchestra.run.smithi084.stdout:714.out 2023-09-10T00:15:25.597 INFO:teuthology.orchestra.run.smithi084.stdout:715 2023-09-10T00:15:25.597 INFO:teuthology.orchestra.run.smithi084.stdout:715.out 2023-09-10T00:15:25.597 INFO:teuthology.orchestra.run.smithi084.stdout:716 2023-09-10T00:15:25.597 INFO:teuthology.orchestra.run.smithi084.stdout:716.out 2023-09-10T00:15:25.598 INFO:teuthology.orchestra.run.smithi084.stdout:717 2023-09-10T00:15:25.598 INFO:teuthology.orchestra.run.smithi084.stdout:717.out 2023-09-10T00:15:25.598 INFO:teuthology.orchestra.run.smithi084.stdout:718 2023-09-10T00:15:25.598 INFO:teuthology.orchestra.run.smithi084.stdout:718.out 2023-09-10T00:15:25.598 INFO:teuthology.orchestra.run.smithi084.stdout:719 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:719.out 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:720 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:720.out 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:721 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:721.out 2023-09-10T00:15:25.599 INFO:teuthology.orchestra.run.smithi084.stdout:722 2023-09-10T00:15:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:722.out 2023-09-10T00:15:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:723 2023-09-10T00:15:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:723.out 2023-09-10T00:15:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:724 2023-09-10T00:15:25.600 INFO:teuthology.orchestra.run.smithi084.stdout:724.out 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:725 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:725.out 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:726 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:726.out 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:727 2023-09-10T00:15:25.601 INFO:teuthology.orchestra.run.smithi084.stdout:727.out 2023-09-10T00:15:25.602 INFO:teuthology.orchestra.run.smithi084.stdout:728 2023-09-10T00:15:25.602 INFO:teuthology.orchestra.run.smithi084.stdout:728.out 2023-09-10T00:15:25.602 INFO:teuthology.orchestra.run.smithi084.stdout:729 2023-09-10T00:15:25.602 INFO:teuthology.orchestra.run.smithi084.stdout:729.out 2023-09-10T00:15:25.602 INFO:teuthology.orchestra.run.smithi084.stdout:730 2023-09-10T00:15:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:730.out 2023-09-10T00:15:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:731 2023-09-10T00:15:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:731.out 2023-09-10T00:15:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:group.list 2023-09-10T00:15:25.603 INFO:teuthology.orchestra.run.smithi084.stdout:Makefile 2023-09-10T00:15:25.604 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-09-10T00:15:25.843 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:25.849 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:25.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:27.979 INFO:teuthology.orchestra.run.smithi084.stdout:generic/001 2s 2023-09-10T00:15:27.985 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/001 2023-09-10T00:15:27.985 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:15:27.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:27.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[49683]: fuse finished with error 0 and tester_r 0 2023-09-10T00:15:27.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:15:27.998 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-09-10T00:15:28.169 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:28.173 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:28.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:28.536 INFO:teuthology.orchestra.run.smithi084.stdout:generic/002 0s 2023-09-10T00:15:28.541 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/002 2023-09-10T00:15:28.542 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:15:28.544 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:28.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:15:28.552 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-09-10T00:15:28.784 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:28.789 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:28.789 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:28.892 INFO:teuthology.orchestra.run.smithi084.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:15:28.896 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/003 2023-09-10T00:15:28.896 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/003 2023-09-10T00:15:28.896 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:15:28.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:28.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:15:28.906 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-09-10T00:15:29.088 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:29.092 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:29.093 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:29.198 INFO:teuthology.orchestra.run.smithi084.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-09-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/004 2023-09-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/004 2023-09-10T00:15:29.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:15:29.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:29.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:15:29.212 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-09-10T00:15:29.392 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:29.396 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:29.396 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:29.856 INFO:teuthology.orchestra.run.smithi084.stdout:generic/005 0s 2023-09-10T00:15:29.861 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/005 2023-09-10T00:15:29.861 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:15:29.863 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:29.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:15:29.872 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-09-10T00:15:30.088 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:15:30.092 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:15:30.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:15:39.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:15:39.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:16:09.757 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:16:09.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:16:11.450 INFO:teuthology.orchestra.run.smithi084.stdout:generic/006 41s 2023-09-10T00:16:11.543 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/006 2023-09-10T00:16:11.543 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:16:11.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:16:11.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:16:11.560 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-09-10T00:16:11.790 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:16:11.794 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:16:11.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:16:39.887 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:16:39.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:17:10.193 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:17:10.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:17:18.522 INFO:teuthology.orchestra.run.smithi084.stdout:generic/007 67s 2023-09-10T00:17:18.528 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/007 2023-09-10T00:17:18.528 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:17:18.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:18.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:17:18.541 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-09-10T00:17:18.893 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:17:18.897 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:17:18.897 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:19.869 INFO:teuthology.orchestra.run.smithi084.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-10T00:17:19.874 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/008 2023-09-10T00:17:19.874 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/008 2023-09-10T00:17:19.874 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:17:19.877 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:19.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:17:19.888 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-09-10T00:17:20.089 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:17:20.094 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:17:20.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:21.317 INFO:teuthology.orchestra.run.smithi084.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-10T00:17:21.320 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/009 2023-09-10T00:17:21.320 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/009 2023-09-10T00:17:21.320 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:17:21.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:21.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:17:21.335 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-09-10T00:17:21.553 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:17:21.558 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:17:21.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:21.751 INFO:teuthology.orchestra.run.smithi084.stdout:generic/010 [not run] /tmp/tmp.4PMIK897QPxfstests-dev/src/dbtest not built 2023-09-10T00:17:21.756 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/010 2023-09-10T00:17:21.756 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/010 2023-09-10T00:17:21.756 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:17:21.759 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:21.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:17:21.769 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-09-10T00:17:21.976 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:17:21.981 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:17:21.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:17:40.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:17:40.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:18:04.996 INFO:teuthology.orchestra.run.smithi084.stdout:generic/011 43s 2023-09-10T00:18:05.075 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/011 2023-09-10T00:18:05.075 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:18:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:18:05.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:18:05.088 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-09-10T00:18:05.356 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:18:05.360 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:18:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:18:06.388 INFO:teuthology.orchestra.run.smithi084.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:18:06.392 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/012 2023-09-10T00:18:06.392 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/012 2023-09-10T00:18:06.392 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:18:06.394 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:18:06.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:18:06.403 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-09-10T00:18:06.620 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:18:06.623 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:18:06.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:18:10.294 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:18:10.297 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:18:41.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:18:41.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:19:11.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:19:11.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:19:42.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:19:42.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:19:59.213 INFO:teuthology.orchestra.run.smithi084.stdout:generic/013 113s 2023-09-10T00:19:59.285 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/013 2023-09-10T00:19:59.285 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:19:59.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:19:59.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:19:59.300 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-09-10T00:19:59.580 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:19:59.588 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:19:59.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:20:12.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:20:12.711 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:20:12.738 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T00:20:12.736+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 88028) UID: 0 2023-09-10T00:20:12.738 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T00:20:12.736+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 88028) UID: 0 2023-09-10T00:23:39.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:23:39.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:24:09.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:24:09.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:24:40.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:24:40.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:25:04.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/014 305s 2023-09-10T00:25:04.956 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/014 2023-09-10T00:25:04.957 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:04.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:04.998 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-09-10T00:25:05.396 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:05.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:05.551 INFO:teuthology.orchestra.run.smithi084.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:25:05.554 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/015 2023-09-10T00:25:05.555 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/015 2023-09-10T00:25:05.555 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:05.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:05.568 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-09-10T00:25:05.789 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:05.794 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:05.794 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:07.193 INFO:teuthology.orchestra.run.smithi084.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:25:07.197 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/016 2023-09-10T00:25:07.197 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/016 2023-09-10T00:25:07.198 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:07.200 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:07.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:07.210 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-09-10T00:25:07.762 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:07.772 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:07.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:07.916 INFO:teuthology.orchestra.run.smithi084.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:25:07.920 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/017 2023-09-10T00:25:07.920 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/017 2023-09-10T00:25:07.920 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:07.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:07.935 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-09-10T00:25:08.170 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:08.174 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:08.175 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:08.324 INFO:teuthology.orchestra.run.smithi084.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:25:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/018 2023-09-10T00:25:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/018 2023-09-10T00:25:08.332 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:08.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:08.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:08.350 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-09-10T00:25:08.629 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:08.634 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:08.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:08.778 INFO:teuthology.orchestra.run.smithi084.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:25:08.782 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/019 2023-09-10T00:25:08.782 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/019 2023-09-10T00:25:08.782 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:08.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:08.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:08.796 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-09-10T00:25:09.048 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:09.054 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:09.054 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:10.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:25:10.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:25:19.639 INFO:teuthology.orchestra.run.smithi084.stdout:generic/020 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/020.out.bad) 2023-09-10T00:25:19.644 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/020.out 2023-09-10 00:14:15.728892815 +0000 2023-09-10T00:25:19.644 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/020.out.bad 2023-09-10 00:25:19.640215213 +0000 2023-09-10T00:25:19.644 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -47,9 +47,13 @@ 2023-09-10T00:25:19.645 INFO:teuthology.orchestra.run.smithi084.stdout: user.snrub="fish2\012" 2023-09-10T00:25:19.645 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:19.645 INFO:teuthology.orchestra.run.smithi084.stdout: *** really long value 2023-09-10T00:25:19.645 INFO:teuthology.orchestra.run.smithi084.stdout: -0000000 00 2023-09-10T00:25:19.645 INFO:teuthology.orchestra.run.smithi084.stdout: -* 2023-09-10T00:25:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: -ATTRSIZE 2023-09-10T00:25:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: +attr_set: No space left on device 2023-09-10T00:25:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: +Could not set "long_attr" for 2023-09-10T00:25:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: +attr_get: No data available 2023-09-10T00:25:19.646 INFO:teuthology.orchestra.run.smithi084.stdout: +Could not get "long_attr" for 2023-09-10T00:25:19.647 INFO:teuthology.orchestra.run.smithi084.stdout: +0000000 2023-09-10T00:25:19.647 INFO:teuthology.orchestra.run.smithi084.stdout: +attr_remove: No data available 2023-09-10T00:25:19.647 INFO:teuthology.orchestra.run.smithi084.stdout: +Could not remove "long_attr" for 2023-09-10T00:25:19.647 INFO:teuthology.orchestra.run.smithi084.stdout: *** set/get/remove really long names (expect failure) 2023-09-10T00:25:19.647 INFO:teuthology.orchestra.run.smithi084.stdout: attr_set: Invalid argument 2023-09-10T00:25:19.648 INFO:teuthology.orchestra.run.smithi084.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-09-10T00:25:19.648 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/020 2023-09-10T00:25:19.649 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/020 2023-09-10T00:25:19.649 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T00:25:19.650 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:19.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T00:25:19.661 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T00:25:19.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T00:25:19.662 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-09-10T00:25:20.208 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:20.218 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:20.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:21.596 INFO:teuthology.orchestra.run.smithi084.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:25:21.601 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/021 2023-09-10T00:25:21.602 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/021 2023-09-10T00:25:21.602 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:21.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:21.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:21.616 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-09-10T00:25:22.135 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:22.141 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:22.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:23.469 INFO:teuthology.orchestra.run.smithi084.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:25:23.473 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/022 2023-09-10T00:25:23.474 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/022 2023-09-10T00:25:23.474 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:25:23.479 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:23.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:25:23.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-09-10T00:25:24.051 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:25:24.056 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:25:24.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:25:40.269 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:25:40.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:26:10.331 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:26:10.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:26:40.217 INFO:teuthology.orchestra.run.smithi084.stdout:generic/023 76s 2023-09-10T00:26:40.224 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/023 2023-09-10T00:26:40.224 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:40.227 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:40.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:40.239 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-09-10T00:26:40.405 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:26:40.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:26:40.792 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:40.796 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:40.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:40.921 INFO:teuthology.orchestra.run.smithi084.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-09-10T00:26:40.924 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/024 2023-09-10T00:26:40.951 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/024 2023-09-10T00:26:40.951 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:40.952 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:40.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:40.953 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-09-10T00:26:41.424 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:41.428 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:41.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:41.563 INFO:teuthology.orchestra.run.smithi084.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-09-10T00:26:41.566 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/025 2023-09-10T00:26:41.567 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/025 2023-09-10T00:26:41.567 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:41.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:41.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:41.577 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-09-10T00:26:42.064 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:42.069 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:42.224 INFO:teuthology.orchestra.run.smithi084.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T00:26:42.228 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/026 2023-09-10T00:26:42.228 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/026 2023-09-10T00:26:42.229 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:42.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:42.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:42.238 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-09-10T00:26:42.413 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:42.417 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:42.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:42.514 INFO:teuthology.orchestra.run.smithi084.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:42.518 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/027 2023-09-10T00:26:42.518 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/027 2023-09-10T00:26:42.518 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:42.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:42.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:42.528 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-09-10T00:26:42.700 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:42.704 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:42.705 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:47.849 INFO:teuthology.orchestra.run.smithi084.stdout:generic/028 5s 2023-09-10T00:26:47.855 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/028 2023-09-10T00:26:47.855 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:47.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:47.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:47.867 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-09-10T00:26:48.060 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:48.065 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:48.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.171 INFO:teuthology.orchestra.run.smithi084.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:48.175 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/029 2023-09-10T00:26:48.175 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/029 2023-09-10T00:26:48.175 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:48.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:48.186 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-09-10T00:26:48.379 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:48.383 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:48.383 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.488 INFO:teuthology.orchestra.run.smithi084.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:48.492 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/030 2023-09-10T00:26:48.492 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/030 2023-09-10T00:26:48.493 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:48.494 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:48.503 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-09-10T00:26:48.704 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:48.708 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:48.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.811 INFO:teuthology.orchestra.run.smithi084.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:48.815 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/031 2023-09-10T00:26:48.815 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/031 2023-09-10T00:26:48.815 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:48.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:48.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:48.825 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-09-10T00:26:48.997 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:49.001 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:49.001 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.104 INFO:teuthology.orchestra.run.smithi084.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:49.109 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/032 2023-09-10T00:26:49.109 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/032 2023-09-10T00:26:49.109 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:49.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:49.120 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-09-10T00:26:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:49.318 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:49.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.415 INFO:teuthology.orchestra.run.smithi084.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:49.419 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/033 2023-09-10T00:26:49.419 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/033 2023-09-10T00:26:49.419 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:49.421 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:49.430 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-09-10T00:26:49.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:49.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:49.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.736 INFO:teuthology.orchestra.run.smithi084.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:26:49.739 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/034 2023-09-10T00:26:49.740 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/034 2023-09-10T00:26:49.740 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:49.742 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:49.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:49.751 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-09-10T00:26:49.914 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:49.919 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:49.919 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:50.089 INFO:teuthology.orchestra.run.smithi084.stdout:generic/035 1s 2023-09-10T00:26:50.094 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/035 2023-09-10T00:26:50.094 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:26:50.096 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:26:50.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:26:50.105 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-09-10T00:26:50.617 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:26:50.621 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:26:50.622 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:00.950 INFO:teuthology.orchestra.run.smithi084.stdout:generic/036 10s 2023-09-10T00:27:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/036 2023-09-10T00:27:00.956 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:00.959 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:00.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:00.968 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-09-10T00:27:01.461 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:01.466 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:01.466 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:01.568 INFO:teuthology.orchestra.run.smithi084.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:01.572 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/037 2023-09-10T00:27:01.572 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/037 2023-09-10T00:27:01.572 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:01.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:01.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:01.582 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-09-10T00:27:01.770 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:01.774 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:01.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:01.940 INFO:teuthology.orchestra.run.smithi084.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:01.944 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/038 2023-09-10T00:27:01.944 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/038 2023-09-10T00:27:01.944 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:01.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:01.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:01.955 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-09-10T00:27:02.125 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:02.129 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:02.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.239 INFO:teuthology.orchestra.run.smithi084.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:02.243 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/039 2023-09-10T00:27:02.243 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/039 2023-09-10T00:27:02.243 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:02.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:02.253 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-09-10T00:27:02.425 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:02.429 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:02.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.552 INFO:teuthology.orchestra.run.smithi084.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:02.556 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/040 2023-09-10T00:27:02.556 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/040 2023-09-10T00:27:02.556 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:02.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:02.567 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-09-10T00:27:02.747 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:02.751 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:02.751 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.864 INFO:teuthology.orchestra.run.smithi084.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:02.867 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/041 2023-09-10T00:27:02.868 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/041 2023-09-10T00:27:02.868 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:02.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:02.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:02.878 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-09-10T00:27:03.049 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:03.053 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:03.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.151 INFO:teuthology.orchestra.run.smithi084.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:03.154 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/042 2023-09-10T00:27:03.155 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/042 2023-09-10T00:27:03.155 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:03.157 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:03.165 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-09-10T00:27:03.329 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:03.333 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:03.333 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.431 INFO:teuthology.orchestra.run.smithi084.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:03.435 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/043 2023-09-10T00:27:03.435 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/043 2023-09-10T00:27:03.435 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:03.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:03.445 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-09-10T00:27:03.630 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:03.634 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:03.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.733 INFO:teuthology.orchestra.run.smithi084.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:03.737 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/044 2023-09-10T00:27:03.737 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/044 2023-09-10T00:27:03.738 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:03.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:03.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:03.749 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-09-10T00:27:03.913 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:03.917 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:03.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.015 INFO:teuthology.orchestra.run.smithi084.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:04.019 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/045 2023-09-10T00:27:04.019 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/045 2023-09-10T00:27:04.019 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:04.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:04.030 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-09-10T00:27:04.203 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:04.207 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.303 INFO:teuthology.orchestra.run.smithi084.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:04.307 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/046 2023-09-10T00:27:04.307 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/046 2023-09-10T00:27:04.307 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:04.317 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-09-10T00:27:04.519 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:04.523 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.625 INFO:teuthology.orchestra.run.smithi084.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:04.628 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/047 2023-09-10T00:27:04.628 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/047 2023-09-10T00:27:04.629 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:04.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-09-10T00:27:04.813 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:04.817 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.917 INFO:teuthology.orchestra.run.smithi084.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:04.921 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/048 2023-09-10T00:27:04.921 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/048 2023-09-10T00:27:04.921 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:04.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:04.932 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-09-10T00:27:05.106 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:05.110 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.210 INFO:teuthology.orchestra.run.smithi084.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:05.213 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/049 2023-09-10T00:27:05.213 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/049 2023-09-10T00:27:05.214 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:05.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-09-10T00:27:05.397 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:05.401 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.558 INFO:teuthology.orchestra.run.smithi084.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:05.561 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/050 2023-09-10T00:27:05.562 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/050 2023-09-10T00:27:05.562 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:05.572 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-09-10T00:27:05.745 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:05.749 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:05.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.847 INFO:teuthology.orchestra.run.smithi084.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:05.850 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/051 2023-09-10T00:27:05.851 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/051 2023-09-10T00:27:05.851 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:05.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:05.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:05.862 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-09-10T00:27:06.033 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:06.038 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:06.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.137 INFO:teuthology.orchestra.run.smithi084.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:06.140 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/052 2023-09-10T00:27:06.140 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/052 2023-09-10T00:27:06.141 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:06.143 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:06.152 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-09-10T00:27:06.334 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:06.337 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:06.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.437 INFO:teuthology.orchestra.run.smithi084.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:06.441 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/053 2023-09-10T00:27:06.441 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/053 2023-09-10T00:27:06.441 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:06.443 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:06.452 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-09-10T00:27:06.625 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:06.629 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:06.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.730 INFO:teuthology.orchestra.run.smithi084.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:06.734 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/054 2023-09-10T00:27:06.734 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/054 2023-09-10T00:27:06.734 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:06.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:06.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:06.745 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-09-10T00:27:06.912 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:06.917 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:06.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.020 INFO:teuthology.orchestra.run.smithi084.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:07.022 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/055 2023-09-10T00:27:07.022 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/055 2023-09-10T00:27:07.022 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:07.024 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:07.034 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-09-10T00:27:07.213 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:07.218 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:07.218 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.332 INFO:teuthology.orchestra.run.smithi084.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:07.335 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/056 2023-09-10T00:27:07.335 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/056 2023-09-10T00:27:07.336 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:07.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:07.346 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-09-10T00:27:07.526 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:07.530 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:07.530 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.648 INFO:teuthology.orchestra.run.smithi084.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:07.651 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/057 2023-09-10T00:27:07.652 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/057 2023-09-10T00:27:07.652 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:07.654 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:07.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:07.662 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-09-10T00:27:07.853 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:07.857 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:07.858 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:08.763 INFO:teuthology.orchestra.run.smithi084.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:27:08.767 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/058 2023-09-10T00:27:08.767 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/058 2023-09-10T00:27:08.768 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:08.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:08.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:08.780 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-09-10T00:27:09.281 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:09.285 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:09.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:09.404 INFO:teuthology.orchestra.run.smithi084.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:09.408 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/059 2023-09-10T00:27:09.408 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/059 2023-09-10T00:27:09.408 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:09.410 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:09.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:09.419 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-09-10T00:27:09.601 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:09.605 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:09.605 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:10.519 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:27:10.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:27:10.637 INFO:teuthology.orchestra.run.smithi084.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:27:10.641 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/060 2023-09-10T00:27:10.642 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/060 2023-09-10T00:27:10.642 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:10.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:10.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:10.654 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-09-10T00:27:11.165 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:11.169 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:11.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:12.058 INFO:teuthology.orchestra.run.smithi084.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:27:12.062 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/061 2023-09-10T00:27:12.062 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/061 2023-09-10T00:27:12.062 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:12.064 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:12.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:12.074 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-09-10T00:27:12.574 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:12.579 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:12.579 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:12.685 INFO:teuthology.orchestra.run.smithi084.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:12.688 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/062 2023-09-10T00:27:12.689 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/062 2023-09-10T00:27:12.689 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:12.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:12.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:12.699 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-09-10T00:27:12.882 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:12.886 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:12.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:14.061 INFO:teuthology.orchestra.run.smithi084.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T00:27:14.065 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/063 2023-09-10T00:27:14.066 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/063 2023-09-10T00:27:14.066 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:14.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:14.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:14.080 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-09-10T00:27:14.634 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:14.639 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:14.639 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:14.801 INFO:teuthology.orchestra.run.smithi084.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:14.805 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/064 2023-09-10T00:27:14.805 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/064 2023-09-10T00:27:14.806 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:14.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:14.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:14.819 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-09-10T00:27:15.025 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:15.030 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:15.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.165 INFO:teuthology.orchestra.run.smithi084.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:15.169 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/065 2023-09-10T00:27:15.169 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/065 2023-09-10T00:27:15.169 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:15.171 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:15.180 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-09-10T00:27:15.357 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:15.361 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:15.361 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.484 INFO:teuthology.orchestra.run.smithi084.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:15.489 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/066 2023-09-10T00:27:15.490 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/066 2023-09-10T00:27:15.490 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:15.491 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:15.501 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-09-10T00:27:15.669 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:15.673 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:15.673 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.801 INFO:teuthology.orchestra.run.smithi084.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:15.805 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/067 2023-09-10T00:27:15.806 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/067 2023-09-10T00:27:15.806 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:15.808 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:15.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:15.817 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-09-10T00:27:16.005 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:16.009 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:16.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:16.131 INFO:teuthology.orchestra.run.smithi084.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:16.134 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/068 2023-09-10T00:27:16.134 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/068 2023-09-10T00:27:16.135 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:16.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:16.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:16.145 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-09-10T00:27:16.309 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:16.313 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:16.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:16.414 INFO:teuthology.orchestra.run.smithi084.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:27:16.418 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/069 2023-09-10T00:27:16.418 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/069 2023-09-10T00:27:16.418 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:27:16.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:16.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:27:16.430 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-09-10T00:27:16.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:27:16.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:27:16.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:27:40.641 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:27:40.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:28:10.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:28:10.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:28:41.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:28:41.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:29:07.332 INFO:teuthology.orchestra.run.smithi084.stdout:generic/070 111s 2023-09-10T00:29:07.404 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/070 2023-09-10T00:29:07.404 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:29:07.406 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:07.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:29:07.681 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-09-10T00:29:08.023 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:29:08.031 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:29:08.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:08.170 INFO:teuthology.orchestra.run.smithi084.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:29:08.174 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/071 2023-09-10T00:29:08.174 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/071 2023-09-10T00:29:08.174 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:29:08.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:08.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:29:08.189 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-09-10T00:29:08.442 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:29:08.447 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:29:08.447 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:09.744 INFO:teuthology.orchestra.run.smithi084.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-10T00:29:09.749 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/072 2023-09-10T00:29:09.749 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/072 2023-09-10T00:29:09.749 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:29:09.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:09.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:29:09.777 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-09-10T00:29:10.037 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:29:10.042 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:29:10.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:10.206 INFO:teuthology.orchestra.run.smithi084.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T00:29:10.210 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/073 2023-09-10T00:29:10.210 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/073 2023-09-10T00:29:10.210 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T00:29:10.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:10.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T00:29:10.231 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-09-10T00:29:10.496 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T00:29:10.500 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T00:29:10.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T00:29:11.206 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:29:11.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:29:41.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:29:41.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:30:11.423 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:30:11.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:30:41.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:30:41.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:31:11.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:31:11.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:31:41.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:31:41.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:32:12.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:32:12.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:32:42.313 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:32:42.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:33:12.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:33:12.507 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:33:42.607 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:33:42.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:34:12.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:34:12.754 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:34:42.844 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:34:42.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:35:13.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:35:13.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:35:43.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:35:43.518 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:35:43.578 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:35:43.580+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44497) UID: 0 2023-09-10T00:35:43.578 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:35:43.580+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44497) UID: 0 2023-09-10T00:35:43.579 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:35:43.580+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44497) UID: 0 2023-09-10T00:35:43.579 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:35:43.580+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44497) UID: 0 2023-09-10T00:40:33.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:40:33.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:40:33.106 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:40:33.104+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117105) UID: 0 2023-09-10T00:40:33.107 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:40:33.104+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117105) UID: 0 2023-09-10T00:40:33.107 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:40:33.104+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117105) UID: 0 2023-09-10T00:40:33.107 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:40:33.104+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117105) UID: 0 2023-09-10T00:40:33.112 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:40:33.110+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44522) UID: 0 2023-09-10T00:40:33.113 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:40:33.110+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44522) UID: 0 2023-09-10T00:40:33.113 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:40:33.110+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44522) UID: 0 2023-09-10T00:40:33.113 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:40:33.110+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44522) UID: 0 2023-09-10T00:50:21.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:50:21.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:50:21.890 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:50:21.888+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118161) UID: 0 2023-09-10T00:50:21.891 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:50:21.888+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118161) UID: 0 2023-09-10T00:50:21.891 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:50:21.888+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118161) UID: 0 2023-09-10T00:50:21.892 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:50:21.888+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118161) UID: 0 2023-09-10T00:50:22.011 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:50:22.011+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44569) UID: 0 2023-09-10T00:50:22.012 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:50:22.011+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44569) UID: 0 2023-09-10T00:50:22.012 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:50:22.011+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44569) UID: 0 2023-09-10T00:50:22.016 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:50:22.011+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44569) UID: 0 2023-09-10T00:57:01.048 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:57:01.051 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T00:57:01.072 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T00:57:01.066+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118923) UID: 0 2023-09-10T00:57:01.072 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T00:57:01.066+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118923) UID: 0 2023-09-10T00:57:01.073 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T00:57:01.066+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118923) UID: 0 2023-09-10T00:57:01.073 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T00:57:01.066+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118923) UID: 0 2023-09-10T00:57:02.077 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T00:57:02.074+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-09-10T00:57:02.077 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T00:57:02.074+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-09-10T00:57:02.078 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T00:57:02.074+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-09-10T00:57:02.078 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T00:57:02.074+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44629) UID: 0 2023-09-10T01:03:07.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:03:07.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:03:07.838 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T01:03:07.833+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120439) UID: 0 2023-09-10T01:03:07.839 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T01:03:07.833+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120439) UID: 0 2023-09-10T01:03:07.839 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T01:03:07.833+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120439) UID: 0 2023-09-10T01:03:07.840 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T01:03:07.833+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120439) UID: 0 2023-09-10T01:03:08.056 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T01:03:08.053+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45143) UID: 0 2023-09-10T01:03:08.056 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T01:03:08.053+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45143) UID: 0 2023-09-10T01:03:08.057 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T01:03:08.053+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45143) UID: 0 2023-09-10T01:03:08.057 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T01:03:08.053+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45143) UID: 0 2023-09-10T01:03:11.833 INFO:teuthology.orchestra.run.smithi084.stdout:generic/074 2041s 2023-09-10T01:03:12.005 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/074 2023-09-10T01:03:12.005 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:03:12.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:03:12.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:03:12.026 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-09-10T01:03:13.438 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:03:13.443 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:03:13.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:24.577 INFO:teuthology.orchestra.run.smithi084.stdout:generic/075 71s 2023-09-10T01:04:24.588 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/075 2023-09-10T01:04:24.588 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:24.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:24.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:24.601 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-09-10T01:04:25.156 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:25.162 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:25.162 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:25.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:25.274 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/076 2023-09-10T01:04:25.275 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/076 2023-09-10T01:04:25.275 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:25.277 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:25.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:25.286 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-09-10T01:04:25.473 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:25.477 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:25.478 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:30.335 INFO:teuthology.orchestra.run.smithi084.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:30.340 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/077 2023-09-10T01:04:30.340 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/077 2023-09-10T01:04:30.341 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:30.343 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:30.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:30.356 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-09-10T01:04:30.553 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:30.557 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:30.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:30.698 INFO:teuthology.orchestra.run.smithi084.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-09-10T01:04:30.702 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/078 2023-09-10T01:04:30.702 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/078 2023-09-10T01:04:30.702 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:30.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:30.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:30.713 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-09-10T01:04:31.276 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:31.279 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:31.280 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:31.506 INFO:teuthology.orchestra.run.smithi084.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-09-10T01:04:31.511 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/079 2023-09-10T01:04:31.511 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/079 2023-09-10T01:04:31.512 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:31.514 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:31.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:31.524 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-09-10T01:04:31.757 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:31.761 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:31.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.002 INFO:teuthology.orchestra.run.smithi084.stdout:generic/080 2s 2023-09-10T01:04:34.007 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/080 2023-09-10T01:04:34.007 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:34.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:34.020 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-09-10T01:04:34.205 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:34.209 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:34.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.314 INFO:teuthology.orchestra.run.smithi084.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:34.317 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/081 2023-09-10T01:04:34.318 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/081 2023-09-10T01:04:34.318 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:34.320 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:34.328 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-09-10T01:04:34.508 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:34.512 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:34.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.619 INFO:teuthology.orchestra.run.smithi084.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:34.623 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/082 2023-09-10T01:04:34.623 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/082 2023-09-10T01:04:34.623 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:34.625 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:34.633 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-09-10T01:04:34.808 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:34.813 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:34.814 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.913 INFO:teuthology.orchestra.run.smithi084.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:34.917 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/083 2023-09-10T01:04:34.918 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/083 2023-09-10T01:04:34.918 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:34.919 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:34.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:34.928 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-09-10T01:04:35.113 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:35.117 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:35.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:35.218 INFO:teuthology.orchestra.run.smithi084.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:35.222 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/084 2023-09-10T01:04:35.222 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/084 2023-09-10T01:04:35.222 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:35.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:35.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:35.233 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-09-10T01:04:35.417 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:35.421 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:35.422 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:35.675 INFO:teuthology.orchestra.run.smithi084.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:04:35.680 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/085 2023-09-10T01:04:35.681 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/085 2023-09-10T01:04:35.681 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:35.684 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:35.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:35.696 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-09-10T01:04:35.872 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:35.876 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:35.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:42.192 INFO:teuthology.orchestra.run.smithi084.stdout:generic/086 6s 2023-09-10T01:04:42.618 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/086 2023-09-10T01:04:42.618 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:42.623 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:42.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:42.712 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-09-10T01:04:47.342 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:47.347 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:47.347 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:48.101 INFO:teuthology.orchestra.run.smithi084.stdout:generic/087 1s 2023-09-10T01:04:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/087 2023-09-10T01:04:48.107 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:48.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:48.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:48.119 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-09-10T01:04:48.672 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:48.676 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:48.676 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:48.854 INFO:teuthology.orchestra.run.smithi084.stdout:generic/088 0s 2023-09-10T01:04:48.860 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/088 2023-09-10T01:04:48.860 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:04:48.862 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:04:48.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:04:48.870 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-09-10T01:04:49.408 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:04:49.412 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:04:49.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:13:24.288 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:13:24.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:13:24.598 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T01:13:24.600+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126978) UID: 0 2023-09-10T01:13:24.598 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T01:13:24.600+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126978) UID: 0 2023-09-10T01:21:29.751 INFO:teuthology.orchestra.run.smithi084.stdout:generic/089 1000s 2023-09-10T01:21:29.988 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/089 2023-09-10T01:21:29.988 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:21:29.994 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:21:30.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:21:30.025 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-09-10T01:21:32.219 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:21:32.225 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:21:32.225 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:21:32.845 INFO:teuthology.orchestra.run.smithi084.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:21:32.851 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/090 2023-09-10T01:21:32.852 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/090 2023-09-10T01:21:32.852 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:21:32.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:21:32.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:21:32.871 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-09-10T01:21:33.093 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:21:33.098 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:21:33.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:22:53.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:22:53.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:22:53.881 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T01:22:53.878+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129866) UID: 0 2023-09-10T01:22:53.881 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T01:22:53.878+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 129866) UID: 0 2023-09-10T01:26:07.824 INFO:teuthology.orchestra.run.smithi084.stdout:generic/091 274s 2023-09-10T01:26:07.838 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/091 2023-09-10T01:26:07.839 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:07.841 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:08.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:08.046 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-09-10T01:26:08.511 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:08.515 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:08.516 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:08.704 INFO:teuthology.orchestra.run.smithi084.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T01:26:08.707 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/092 2023-09-10T01:26:08.708 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/092 2023-09-10T01:26:08.708 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:08.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:08.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:08.718 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-09-10T01:26:09.287 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:09.291 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:09.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:10.273 INFO:teuthology.orchestra.run.smithi084.stdout:generic/093 1s 2023-09-10T01:26:10.278 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/093 2023-09-10T01:26:10.279 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:10.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:10.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:10.290 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-09-10T01:26:10.884 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:10.888 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:10.888 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.032 INFO:teuthology.orchestra.run.smithi084.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:11.035 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/094 2023-09-10T01:26:11.036 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/094 2023-09-10T01:26:11.036 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:11.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:11.047 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-09-10T01:26:11.227 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:11.231 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:11.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.334 INFO:teuthology.orchestra.run.smithi084.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/095 2023-09-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/095 2023-09-10T01:26:11.338 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:11.340 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:11.349 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-09-10T01:26:11.524 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:11.528 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:11.528 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.628 INFO:teuthology.orchestra.run.smithi084.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:11.632 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/096 2023-09-10T01:26:11.632 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/096 2023-09-10T01:26:11.632 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:11.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:11.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:11.643 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-09-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:11.823 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:11.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi084.stdout:generic/097 1s 2023-09-10T01:26:12.711 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/097 2023-09-10T01:26:12.711 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:12.715 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:12.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:12.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-09-10T01:26:12.900 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:12.904 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:12.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:13.125 INFO:teuthology.orchestra.run.smithi084.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/098 2023-09-10T01:26:13.129 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/098 2023-09-10T01:26:13.130 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:13.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:13.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:13.141 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-09-10T01:26:13.344 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:13.513 INFO:teuthology.orchestra.run.smithi084.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/099 2023-09-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/099 2023-09-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:13.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:13.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:13.528 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-09-10T01:26:13.711 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:13.715 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:13.715 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:45.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/100 32s 2023-09-10T01:26:46.013 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/100 2023-09-10T01:26:46.013 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:46.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:46.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:46.036 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-09-10T01:26:46.557 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:46.589 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:46.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:47.672 INFO:teuthology.orchestra.run.smithi084.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:47.676 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/101 2023-09-10T01:26:47.677 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/101 2023-09-10T01:26:47.677 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:47.680 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:47.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:47.690 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-09-10T01:26:47.879 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:47.883 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:47.884 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:48.176 INFO:teuthology.orchestra.run.smithi084.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:48.179 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/102 2023-09-10T01:26:48.180 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/102 2023-09-10T01:26:48.180 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:48.182 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:48.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:48.193 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-09-10T01:26:48.388 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:48.392 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:48.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:48.651 INFO:teuthology.orchestra.run.smithi084.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:48.655 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/103 2023-09-10T01:26:48.655 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/103 2023-09-10T01:26:48.655 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:48.657 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:48.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:48.667 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-09-10T01:26:48.835 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:48.839 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:48.840 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.106 INFO:teuthology.orchestra.run.smithi084.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:49.110 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/104 2023-09-10T01:26:49.110 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/104 2023-09-10T01:26:49.110 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:49.112 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:49.122 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-09-10T01:26:49.320 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:49.325 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:49.325 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.438 INFO:teuthology.orchestra.run.smithi084.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:49.441 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/105 2023-09-10T01:26:49.442 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/105 2023-09-10T01:26:49.442 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:49.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:49.452 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-09-10T01:26:49.615 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:49.619 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:49.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.749 INFO:teuthology.orchestra.run.smithi084.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:49.753 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/106 2023-09-10T01:26:49.753 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/106 2023-09-10T01:26:49.753 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:49.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:49.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:49.764 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-09-10T01:26:49.943 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:49.947 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:49.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:50.154 INFO:teuthology.orchestra.run.smithi084.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:50.157 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/107 2023-09-10T01:26:50.157 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/107 2023-09-10T01:26:50.158 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:50.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:50.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:50.168 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-09-10T01:26:50.368 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:50.372 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:50.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.170 INFO:teuthology.orchestra.run.smithi084.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:53.175 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/108 2023-09-10T01:26:53.175 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/108 2023-09-10T01:26:53.175 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:53.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:53.190 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-09-10T01:26:53.384 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:53.388 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:53.388 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.490 INFO:teuthology.orchestra.run.smithi084.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:26:53.494 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/109 2023-09-10T01:26:53.494 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/109 2023-09-10T01:26:53.494 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:53.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:53.505 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-09-10T01:26:53.688 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:53.692 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.863 INFO:teuthology.orchestra.run.smithi084.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:26:53.867 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/110 2023-09-10T01:26:53.867 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/110 2023-09-10T01:26:53.869 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:53.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:53.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:53.877 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-09-10T01:26:54.428 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:54.432 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:54.433 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:54.584 INFO:teuthology.orchestra.run.smithi084.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:26:54.588 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/111 2023-09-10T01:26:54.588 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/111 2023-09-10T01:26:54.588 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:26:54.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:26:54.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:26:54.599 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-09-10T01:26:55.159 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:26:55.163 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:26:55.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:27:28.348 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:27:28.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:27:58.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:27:58.406 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:28:27.328 INFO:teuthology.orchestra.run.smithi084.stdout:generic/112 92s 2023-09-10T01:28:27.335 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/112 2023-09-10T01:28:27.335 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:28:27.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:28:27.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:28:27.351 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-09-10T01:28:27.911 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:28:27.915 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:28:27.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:28:28.786 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:28:28.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:28:58.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:28:58.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:29:10.517 INFO:teuthology.orchestra.run.smithi084.stdout:generic/113 43s 2023-09-10T01:29:10.522 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/113 2023-09-10T01:29:10.522 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:10.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:10.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:10.690 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-09-10T01:29:11.140 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:11.144 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:11.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:11.406 INFO:teuthology.orchestra.run.smithi084.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-09-10T01:29:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/114 2023-09-10T01:29:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/114 2023-09-10T01:29:11.410 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:11.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:11.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:11.423 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-09-10T01:29:11.600 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:11.604 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:11.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:11.752 INFO:teuthology.orchestra.run.smithi084.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:11.756 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/115 2023-09-10T01:29:11.756 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/115 2023-09-10T01:29:11.756 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:11.758 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:11.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:11.767 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-09-10T01:29:12.294 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:12.299 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:12.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:12.444 INFO:teuthology.orchestra.run.smithi084.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:12.447 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/116 2023-09-10T01:29:12.447 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/116 2023-09-10T01:29:12.448 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:12.450 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:12.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:12.458 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-09-10T01:29:12.995 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:12.999 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:13.102 INFO:teuthology.orchestra.run.smithi084.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:29:13.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/117 2023-09-10T01:29:13.106 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/117 2023-09-10T01:29:13.106 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:13.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:13.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:13.116 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-09-10T01:29:13.298 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:13.302 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:13.303 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:13.449 INFO:teuthology.orchestra.run.smithi084.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:13.453 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/118 2023-09-10T01:29:13.453 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/118 2023-09-10T01:29:13.453 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:13.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:13.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:13.463 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-09-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:14.133 INFO:teuthology.orchestra.run.smithi084.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:14.137 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/119 2023-09-10T01:29:14.137 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/119 2023-09-10T01:29:14.138 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:14.139 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:14.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:14.148 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-09-10T01:29:14.699 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:14.704 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:14.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:14.803 INFO:teuthology.orchestra.run.smithi084.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:29:14.806 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/120 2023-09-10T01:29:14.807 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/120 2023-09-10T01:29:14.807 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:14.809 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:14.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:14.817 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-09-10T01:29:14.987 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:14.992 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:14.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:15.147 INFO:teuthology.orchestra.run.smithi084.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:15.150 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/121 2023-09-10T01:29:15.151 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/121 2023-09-10T01:29:15.151 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:15.153 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:15.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:15.161 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-09-10T01:29:15.699 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:15.703 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:15.703 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:15.851 INFO:teuthology.orchestra.run.smithi084.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T01:29:15.855 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/122 2023-09-10T01:29:15.855 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/122 2023-09-10T01:29:15.855 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:15.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:15.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:15.866 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-09-10T01:29:16.411 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:16.415 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:16.415 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:16.869 INFO:teuthology.orchestra.run.smithi084.stdout:generic/123 0s 2023-09-10T01:29:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/123 2023-09-10T01:29:16.874 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:16.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:16.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:16.885 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-09-10T01:29:17.396 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:17.400 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:17.400 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:17.508 INFO:teuthology.orchestra.run.smithi084.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T01:29:17.511 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/124 2023-09-10T01:29:17.511 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/124 2023-09-10T01:29:17.512 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:29:17.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:17.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:29:17.522 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-09-10T01:29:17.714 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:29:17.718 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:29:17.719 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:29:28.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:29:28.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:29:59.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:29:59.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:30:19.279 INFO:teuthology.orchestra.run.smithi084.stdout:generic/125 62s 2023-09-10T01:30:19.287 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/125 2023-09-10T01:30:19.288 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T01:30:19.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:30:19.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T01:30:19.311 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-09-10T01:30:19.856 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:30:19.860 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:30:19.860 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:30:20.387 INFO:teuthology.orchestra.run.smithi084.stdout:generic/126 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/126.out.bad) 2023-09-10T01:30:20.389 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/126.out 2023-09-10 00:14:15.736892689 +0000 2023-09-10T01:30:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/126.out.bad 2023-09-10 01:30:20.386765495 +0000 2023-09-10T01:30:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,7 +1,7 @@ 2023-09-10T01:30:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 126 2023-09-10T01:30:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-09-10T01:30:20.390 INFO:teuthology.orchestra.run.smithi084.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-09-10T01:30:20.391 INFO:teuthology.orchestra.run.smithi084.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-09-10T01:30:20.391 INFO:teuthology.orchestra.run.smithi084.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-09-10T01:30:20.391 INFO:teuthology.orchestra.run.smithi084.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-09-10T01:30:20.391 INFO:teuthology.orchestra.run.smithi084.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-09-10T01:30:20.391 INFO:teuthology.orchestra.run.smithi084.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-09-10T01:30:20.392 INFO:teuthology.orchestra.run.smithi084.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-09-10T01:30:20.392 INFO:teuthology.orchestra.run.smithi084.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-09-10T01:30:20.392 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/126 2023-09-10T01:30:20.392 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/126 2023-09-10T01:30:20.393 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T01:30:20.394 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:30:20.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T01:30:20.402 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T01:30:20.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T01:30:20.403 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-09-10T01:30:20.922 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T01:30:20.927 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T01:30:20.927 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T01:30:29.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:30:29.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:30:59.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:30:59.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:31:29.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:31:29.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:31:59.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:31:59.737 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:32:29.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:32:29.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:32:59.962 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:32:59.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:33:30.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:33:30.053 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:34:00.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:34:00.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:34:30.281 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:34:30.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:35:00.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:35:00.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:35:30.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:35:30.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:36:00.794 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:36:00.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:36:30.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:36:30.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:37:00.987 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:37:00.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:37:31.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:37:31.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:38:01.448 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:38:01.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:38:31.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:38:31.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:39:01.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:39:01.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:39:32.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:39:32.026 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:40:02.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:40:02.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:40:32.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:40:32.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:41:02.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:41:02.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:41:32.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:41:32.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:42:02.592 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:42:02.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:42:32.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:42:32.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:43:02.793 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:43:02.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:43:32.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:43:32.977 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:44:03.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:44:03.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:44:33.127 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:44:33.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:45:03.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:45:03.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:45:33.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:45:33.355 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:46:03.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:46:03.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:46:33.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:46:33.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:47:03.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:47:03.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:47:33.694 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:47:33.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:48:03.789 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:48:03.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:48:33.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:48:33.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:49:04.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:49:04.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:49:34.177 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:49:34.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:50:04.315 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:50:04.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:50:34.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:50:34.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:51:04.631 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:51:04.635 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:51:34.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:51:34.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:52:04.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:52:04.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:52:35.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:52:35.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:53:05.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:53:05.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:53:35.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:53:35.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:54:05.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:54:05.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:54:35.645 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:54:35.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:55:05.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:55:05.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:55:36.052 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:55:36.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:56:06.125 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:56:06.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:56:36.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:56:36.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:57:06.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:57:06.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:57:36.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:57:36.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:58:06.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:58:06.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:58:36.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:58:36.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:59:06.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:59:06.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:59:36.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T01:59:36.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:00:07.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:00:07.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:00:07.192 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T02:00:07.191+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45485) UID: 0 2023-09-10T02:00:07.192 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T02:00:07.191+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45485) UID: 0 2023-09-10T02:00:07.192 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T02:00:07.191+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45485) UID: 0 2023-09-10T02:00:07.193 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T02:00:07.191+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45485) UID: 0 2023-09-10T02:02:12.750 INFO:teuthology.orchestra.run.smithi084.stdout:generic/127 1912s 2023-09-10T02:02:12.757 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/127 2023-09-10T02:02:12.757 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:12.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:13.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:13.117 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-09-10T02:02:13.380 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:13.386 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:13.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:13.505 INFO:teuthology.orchestra.run.smithi084.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:02:13.509 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/128 2023-09-10T02:02:13.510 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/128 2023-09-10T02:02:13.510 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:13.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:13.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:13.529 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-09-10T02:02:13.742 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:13.746 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:13.746 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:13.858 INFO:teuthology.orchestra.run.smithi084.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:02:13.862 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/129 2023-09-10T02:02:13.862 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/129 2023-09-10T02:02:13.862 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:13.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:13.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:13.873 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-09-10T02:02:14.066 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:14.071 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:14.071 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:14.173 INFO:teuthology.orchestra.run.smithi084.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:02:14.177 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/130 2023-09-10T02:02:14.177 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/130 2023-09-10T02:02:14.177 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:14.179 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:14.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:14.188 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-09-10T02:02:14.365 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:14.369 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:14.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:15.663 INFO:teuthology.orchestra.run.smithi084.stdout:generic/131 1s 2023-09-10T02:02:15.668 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/131 2023-09-10T02:02:15.669 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:15.671 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:15.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:15.681 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-09-10T02:02:16.229 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:16.233 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:16.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:16.332 INFO:teuthology.orchestra.run.smithi084.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:02:16.336 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/132 2023-09-10T02:02:16.336 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/132 2023-09-10T02:02:16.336 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:02:16.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:16.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:02:16.347 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-09-10T02:02:16.517 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:02:16.521 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:02:16.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:02:55.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:02:55.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:03:25.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:03:25.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:03:55.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:03:55.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:04:25.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:04:25.623 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:04:55.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:04:55.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:05:25.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:05:25.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:05:55.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:05:55.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:06:25.977 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:06:25.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:06:56.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:06:56.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:07:26.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:07:26.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:07:56.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:07:56.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:08:26.587 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:08:26.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:08:56.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:08:56.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:09:26.801 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:09:26.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:09:57.003 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:09:57.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:10:27.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:10:27.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:10:57.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:10:57.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:11:27.312 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:11:27.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:11:38.108 INFO:teuthology.orchestra.run.smithi084.stdout:generic/133 562s 2023-09-10T02:11:38.115 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/133 2023-09-10T02:11:38.115 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:38.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:38.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:38.262 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-09-10T02:11:38.853 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:38.857 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:38.858 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:39.050 INFO:teuthology.orchestra.run.smithi084.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:39.054 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/134 2023-09-10T02:11:39.054 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/134 2023-09-10T02:11:39.054 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:39.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:39.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:39.065 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-09-10T02:11:39.592 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:39.596 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:39.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:39.776 INFO:teuthology.orchestra.run.smithi084.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:39.780 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/135 2023-09-10T02:11:39.780 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/135 2023-09-10T02:11:39.780 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:39.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:39.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:39.791 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-09-10T02:11:39.981 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:39.984 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:39.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:40.135 INFO:teuthology.orchestra.run.smithi084.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:40.138 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/136 2023-09-10T02:11:40.138 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/136 2023-09-10T02:11:40.139 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:40.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:40.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:40.149 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-09-10T02:11:40.686 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:40.690 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:40.691 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:40.866 INFO:teuthology.orchestra.run.smithi084.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:40.869 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/137 2023-09-10T02:11:40.870 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/137 2023-09-10T02:11:40.870 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:40.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:40.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:40.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-09-10T02:11:41.425 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:41.429 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:41.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:41.584 INFO:teuthology.orchestra.run.smithi084.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:41.588 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/138 2023-09-10T02:11:41.588 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/138 2023-09-10T02:11:41.588 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:41.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:41.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:41.599 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-09-10T02:11:42.124 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:42.128 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:42.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:42.275 INFO:teuthology.orchestra.run.smithi084.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:42.279 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/139 2023-09-10T02:11:42.279 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/139 2023-09-10T02:11:42.279 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:42.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:42.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:42.290 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-09-10T02:11:42.816 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:42.820 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:42.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:42.969 INFO:teuthology.orchestra.run.smithi084.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:42.972 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/140 2023-09-10T02:11:42.973 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/140 2023-09-10T02:11:42.973 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:42.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:42.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:42.983 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-09-10T02:11:43.513 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:43.517 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:43.517 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:43.615 INFO:teuthology.orchestra.run.smithi084.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:43.619 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/141 2023-09-10T02:11:43.619 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/141 2023-09-10T02:11:43.619 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:43.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:43.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:43.630 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-09-10T02:11:43.808 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:43.812 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:43.812 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:43.963 INFO:teuthology.orchestra.run.smithi084.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:43.967 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/142 2023-09-10T02:11:43.967 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/142 2023-09-10T02:11:43.967 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:43.969 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:43.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:43.978 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-09-10T02:11:44.509 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:44.513 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:44.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:44.659 INFO:teuthology.orchestra.run.smithi084.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:44.662 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/143 2023-09-10T02:11:44.663 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/143 2023-09-10T02:11:44.663 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:44.665 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:44.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:44.673 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-09-10T02:11:45.229 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:45.233 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:45.234 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:45.383 INFO:teuthology.orchestra.run.smithi084.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:45.386 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/144 2023-09-10T02:11:45.386 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/144 2023-09-10T02:11:45.387 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:45.389 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:45.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:45.397 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-09-10T02:11:45.936 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:45.941 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:45.941 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:46.137 INFO:teuthology.orchestra.run.smithi084.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:46.140 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/145 2023-09-10T02:11:46.141 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/145 2023-09-10T02:11:46.141 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:46.143 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:46.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:46.151 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-09-10T02:11:46.722 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:46.727 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:46.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:46.890 INFO:teuthology.orchestra.run.smithi084.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:46.893 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/146 2023-09-10T02:11:46.893 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/146 2023-09-10T02:11:46.893 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:46.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:46.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:46.904 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-09-10T02:11:47.448 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:47.452 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:47.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:47.662 INFO:teuthology.orchestra.run.smithi084.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:47.666 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/147 2023-09-10T02:11:47.666 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/147 2023-09-10T02:11:47.666 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:47.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:47.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:47.677 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-09-10T02:11:48.182 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:48.186 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:48.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:48.416 INFO:teuthology.orchestra.run.smithi084.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:48.420 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/148 2023-09-10T02:11:48.420 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/148 2023-09-10T02:11:48.420 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:48.422 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:48.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:48.431 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-09-10T02:11:48.952 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:48.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:48.957 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:49.110 INFO:teuthology.orchestra.run.smithi084.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:49.113 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/149 2023-09-10T02:11:49.114 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/149 2023-09-10T02:11:49.114 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:49.116 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:49.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:49.124 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-09-10T02:11:49.648 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:49.652 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:49.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:49.806 INFO:teuthology.orchestra.run.smithi084.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:49.809 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/150 2023-09-10T02:11:49.810 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/150 2023-09-10T02:11:49.810 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:49.812 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:49.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:49.820 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-09-10T02:11:50.376 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:50.380 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:50.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:50.530 INFO:teuthology.orchestra.run.smithi084.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:50.534 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/151 2023-09-10T02:11:50.534 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/151 2023-09-10T02:11:50.534 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:50.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:50.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:50.544 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-09-10T02:11:51.084 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:51.089 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:51.089 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:51.241 INFO:teuthology.orchestra.run.smithi084.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:51.244 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/152 2023-09-10T02:11:51.245 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/152 2023-09-10T02:11:51.245 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:51.247 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:51.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:51.255 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-09-10T02:11:51.806 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:51.810 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:51.811 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:51.961 INFO:teuthology.orchestra.run.smithi084.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:51.964 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/153 2023-09-10T02:11:51.964 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/153 2023-09-10T02:11:51.965 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:51.966 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:51.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:51.975 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-09-10T02:11:52.509 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:52.513 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:52.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:52.661 INFO:teuthology.orchestra.run.smithi084.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:52.664 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/154 2023-09-10T02:11:52.664 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/154 2023-09-10T02:11:52.665 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:52.667 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:52.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:52.675 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-09-10T02:11:53.192 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:53.196 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:53.196 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:53.348 INFO:teuthology.orchestra.run.smithi084.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:53.352 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/155 2023-09-10T02:11:53.352 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/155 2023-09-10T02:11:53.352 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:53.354 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:53.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:53.362 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-09-10T02:11:53.904 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:53.908 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:53.908 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:54.055 INFO:teuthology.orchestra.run.smithi084.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:54.058 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/156 2023-09-10T02:11:54.058 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/156 2023-09-10T02:11:54.058 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:54.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:54.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:54.069 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-09-10T02:11:54.620 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:54.624 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:54.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:54.780 INFO:teuthology.orchestra.run.smithi084.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:54.784 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/157 2023-09-10T02:11:54.784 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/157 2023-09-10T02:11:54.785 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:54.786 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:54.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:54.794 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-09-10T02:11:55.325 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:55.329 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:55.329 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:55.483 INFO:teuthology.orchestra.run.smithi084.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:11:55.486 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/158 2023-09-10T02:11:55.487 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/158 2023-09-10T02:11:55.487 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:55.489 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:55.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:55.497 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-09-10T02:11:56.029 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:56.033 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:56.034 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.194 INFO:teuthology.orchestra.run.smithi084.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-09-10T02:11:56.198 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/159 2023-09-10T02:11:56.198 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/159 2023-09-10T02:11:56.199 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:56.200 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:56.209 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-09-10T02:11:56.405 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:56.409 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:56.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.567 INFO:teuthology.orchestra.run.smithi084.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-09-10T02:11:56.571 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/160 2023-09-10T02:11:56.571 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/160 2023-09-10T02:11:56.572 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:56.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:56.582 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-09-10T02:11:56.753 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:56.757 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:56.758 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.864 INFO:teuthology.orchestra.run.smithi084.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:56.868 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/161 2023-09-10T02:11:56.868 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/161 2023-09-10T02:11:56.869 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:56.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:56.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:56.879 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-09-10T02:11:57.064 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:57.068 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:57.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.167 INFO:teuthology.orchestra.run.smithi084.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:57.170 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/162 2023-09-10T02:11:57.171 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/162 2023-09-10T02:11:57.171 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:57.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:57.181 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-09-10T02:11:57.360 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:57.364 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:57.364 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.366 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:11:57.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:11:57.474 INFO:teuthology.orchestra.run.smithi084.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:57.478 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/163 2023-09-10T02:11:57.478 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/163 2023-09-10T02:11:57.478 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:57.480 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:57.488 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-09-10T02:11:57.682 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:57.686 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:57.687 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.790 INFO:teuthology.orchestra.run.smithi084.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/164 2023-09-10T02:11:57.793 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/164 2023-09-10T02:11:57.794 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:57.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:57.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:57.803 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-09-10T02:11:58.002 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:58.007 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:58.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:58.114 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/165 2023-09-10T02:11:58.115 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/165 2023-09-10T02:11:58.115 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:58.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:58.125 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-09-10T02:11:58.320 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:58.324 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:58.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.424 INFO:teuthology.orchestra.run.smithi084.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:58.428 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/166 2023-09-10T02:11:58.428 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/166 2023-09-10T02:11:58.428 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:58.430 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:58.438 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-09-10T02:11:58.620 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:58.625 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:58.625 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.726 INFO:teuthology.orchestra.run.smithi084.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:58.729 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/167 2023-09-10T02:11:58.730 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/167 2023-09-10T02:11:58.730 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:58.732 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:58.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:58.740 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-09-10T02:11:58.934 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:58.938 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:58.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.043 INFO:teuthology.orchestra.run.smithi084.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:59.047 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/168 2023-09-10T02:11:59.047 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/168 2023-09-10T02:11:59.048 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:59.050 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:59.059 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-09-10T02:11:59.257 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:59.261 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:59.436 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.438 INFO:teuthology.orchestra.run.smithi084.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:59.438 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/169 2023-09-10T02:11:59.439 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/169 2023-09-10T02:11:59.439 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:59.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:59.440 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-09-10T02:11:59.629 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:59.633 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:59.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.733 INFO:teuthology.orchestra.run.smithi084.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:11:59.737 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/170 2023-09-10T02:11:59.737 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/170 2023-09-10T02:11:59.737 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:11:59.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:11:59.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:11:59.748 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-09-10T02:11:59.932 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:11:59.936 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:11:59.936 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.064 INFO:teuthology.orchestra.run.smithi084.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:00.067 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/171 2023-09-10T02:12:00.067 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/171 2023-09-10T02:12:00.068 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:00.070 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:00.078 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-09-10T02:12:00.269 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:00.273 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:00.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.378 INFO:teuthology.orchestra.run.smithi084.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:00.381 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/172 2023-09-10T02:12:00.382 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/172 2023-09-10T02:12:00.382 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:00.384 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:00.392 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-09-10T02:12:00.568 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:00.572 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:00.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.677 INFO:teuthology.orchestra.run.smithi084.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:00.681 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/173 2023-09-10T02:12:00.681 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/173 2023-09-10T02:12:00.681 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:00.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:00.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:00.691 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-09-10T02:12:00.873 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:00.877 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:00.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.026 INFO:teuthology.orchestra.run.smithi084.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:01.030 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/174 2023-09-10T02:12:01.030 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/174 2023-09-10T02:12:01.030 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:01.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:01.041 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-09-10T02:12:01.220 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:01.224 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:01.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.326 INFO:teuthology.orchestra.run.smithi084.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:01.329 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/175 2023-09-10T02:12:01.330 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/175 2023-09-10T02:12:01.330 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:01.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:01.340 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-09-10T02:12:01.513 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:01.517 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:01.517 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.618 INFO:teuthology.orchestra.run.smithi084.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:01.622 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/176 2023-09-10T02:12:01.622 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/176 2023-09-10T02:12:01.622 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:01.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:01.632 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-09-10T02:12:01.819 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:01.824 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:01.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.947 INFO:teuthology.orchestra.run.smithi084.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:01.950 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/177 2023-09-10T02:12:01.951 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/177 2023-09-10T02:12:01.951 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:01.953 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:01.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:01.961 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-09-10T02:12:02.136 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:02.141 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:02.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:02.302 INFO:teuthology.orchestra.run.smithi084.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:12:02.305 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/178 2023-09-10T02:12:02.306 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/178 2023-09-10T02:12:02.306 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:02.308 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:02.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:02.316 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-09-10T02:12:02.856 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:02.861 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:02.861 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:03.015 INFO:teuthology.orchestra.run.smithi084.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:12:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/179 2023-09-10T02:12:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/179 2023-09-10T02:12:03.019 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:03.021 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:03.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:03.030 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-09-10T02:12:03.560 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:03.564 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:03.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:03.712 INFO:teuthology.orchestra.run.smithi084.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:12:03.715 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/180 2023-09-10T02:12:03.715 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/180 2023-09-10T02:12:03.716 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:03.718 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:03.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:03.726 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-09-10T02:12:04.264 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:04.268 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:04.418 INFO:teuthology.orchestra.run.smithi084.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:12:04.421 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/181 2023-09-10T02:12:04.422 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/181 2023-09-10T02:12:04.422 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:04.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:04.432 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-09-10T02:12:04.948 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:04.952 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:05.103 INFO:teuthology.orchestra.run.smithi084.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:12:05.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/182 2023-09-10T02:12:05.107 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/182 2023-09-10T02:12:05.107 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:05.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:05.117 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-09-10T02:12:05.665 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:05.669 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:05.769 INFO:teuthology.orchestra.run.smithi084.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:05.772 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/183 2023-09-10T02:12:05.773 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/183 2023-09-10T02:12:05.773 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:05.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:05.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:05.783 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-09-10T02:12:05.952 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:05.956 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.102 INFO:teuthology.orchestra.run.smithi084.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/184.out.bad) 2023-09-10T02:12:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/184.out 2023-09-10 00:14:15.740892624 +0000 2023-09-10T02:12:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/184.out.bad 2023-09-10 02:12:06.101072553 +0000 2023-09-10T02:12:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1 +1,2 @@ 2023-09-10T02:12:06.104 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 184 2023-09-10T02:12:06.105 INFO:teuthology.orchestra.run.smithi084.stdout: +/tmp/tmp.4PMIK897QPxfstests-dev/tests/generic/184: line 23: /tmp/tmp.8YBtWphbTqtest/null: Permission denied 2023-09-10T02:12:06.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/184 2023-09-10T02:12:06.106 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/184 2023-09-10T02:12:06.107 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:12:06.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:12:06.117 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:12:06.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:12:06.117 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-09-10T02:12:06.288 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:06.292 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:06.292 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.392 INFO:teuthology.orchestra.run.smithi084.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:06.395 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/185 2023-09-10T02:12:06.395 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/185 2023-09-10T02:12:06.396 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:06.397 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:06.406 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-09-10T02:12:06.582 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:06.586 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.688 INFO:teuthology.orchestra.run.smithi084.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:06.692 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/186 2023-09-10T02:12:06.692 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/186 2023-09-10T02:12:06.692 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:06.694 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:06.703 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-09-10T02:12:06.880 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:06.884 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:06.885 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:06.988 INFO:teuthology.orchestra.run.smithi084.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:06.992 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/187 2023-09-10T02:12:06.993 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/187 2023-09-10T02:12:06.993 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:06.995 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:07.003 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-09-10T02:12:07.184 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:07.188 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:07.188 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.287 INFO:teuthology.orchestra.run.smithi084.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/188 2023-09-10T02:12:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/188 2023-09-10T02:12:07.291 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:07.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:07.302 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-09-10T02:12:07.484 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:07.488 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:07.488 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.586 INFO:teuthology.orchestra.run.smithi084.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:07.589 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/189 2023-09-10T02:12:07.590 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/189 2023-09-10T02:12:07.590 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:07.592 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:07.601 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-09-10T02:12:07.778 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:07.782 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:07.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:07.884 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/190 2023-09-10T02:12:07.884 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/190 2023-09-10T02:12:07.884 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:07.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:07.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:07.895 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-09-10T02:12:08.085 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:08.088 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:08.088 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:08.192 INFO:teuthology.orchestra.run.smithi084.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:08.196 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/191 2023-09-10T02:12:08.196 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/191 2023-09-10T02:12:08.196 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:08.198 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:08.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:08.206 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-09-10T02:12:08.405 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:08.409 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:08.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:08.518 INFO:teuthology.orchestra.run.smithi084.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-09-10T02:12:08.522 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/192 2023-09-10T02:12:08.522 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/192 2023-09-10T02:12:08.522 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:08.524 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:08.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:08.533 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-09-10T02:12:08.739 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:08.743 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:08.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:09.743 INFO:teuthology.orchestra.run.smithi084.stdout:generic/193 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/193.out.bad) 2023-09-10T02:12:09.744 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/193.out 2023-09-10 00:14:15.740892624 +0000 2023-09-10T02:12:09.745 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/193.out.bad 2023-09-10 02:12:09.741015669 +0000 2023-09-10T02:12:09.745 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -24,7 +24,6 @@ 2023-09-10T02:12:09.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:09.745 INFO:teuthology.orchestra.run.smithi084.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-09-10T02:12:09.745 INFO:teuthology.orchestra.run.smithi084.stdout: user: chmod a+r on root owned file (should fail) 2023-09-10T02:12:09.746 INFO:teuthology.orchestra.run.smithi084.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-09-10T02:12:09.746 INFO:teuthology.orchestra.run.smithi084.stdout: check that the sgid bit is cleared 2023-09-10T02:12:09.746 INFO:teuthology.orchestra.run.smithi084.stdout: -rw-rw-rw- 2023-09-10T02:12:09.746 INFO:teuthology.orchestra.run.smithi084.stdout: check that suid bit is not cleared 2023-09-10T02:12:09.747 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/193 2023-09-10T02:12:09.747 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/193 2023-09-10T02:12:09.747 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:12:09.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:09.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:12:09.758 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:12:09.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:12:09.760 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-09-10T02:12:10.297 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:10.301 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:10.301 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:10.407 INFO:teuthology.orchestra.run.smithi084.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:10.410 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/194 2023-09-10T02:12:10.410 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/194 2023-09-10T02:12:10.411 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:10.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:10.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:10.421 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-09-10T02:12:10.616 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:10.620 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:10.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:10.727 INFO:teuthology.orchestra.run.smithi084.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:10.731 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/195 2023-09-10T02:12:10.731 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/195 2023-09-10T02:12:10.731 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:10.733 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:10.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:10.741 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-09-10T02:12:10.929 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:10.933 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:10.933 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:11.044 INFO:teuthology.orchestra.run.smithi084.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:11.048 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/196 2023-09-10T02:12:11.048 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/196 2023-09-10T02:12:11.049 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:11.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:11.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:11.059 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-09-10T02:12:11.246 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:11.250 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:11.250 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:11.356 INFO:teuthology.orchestra.run.smithi084.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/197 2023-09-10T02:12:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/197 2023-09-10T02:12:11.360 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:11.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:11.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:11.371 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-09-10T02:12:11.556 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:11.560 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:11.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:12.578 INFO:teuthology.orchestra.run.smithi084.stdout:generic/198 1s 2023-09-10T02:12:12.586 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/198 2023-09-10T02:12:12.586 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:12.590 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:12.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:12.602 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-09-10T02:12:13.165 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:13.169 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:13.169 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:13.275 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/199 2023-09-10T02:12:13.275 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/199 2023-09-10T02:12:13.275 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:13.277 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:13.286 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-09-10T02:12:13.492 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:13.496 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:13.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.596 INFO:teuthology.orchestra.run.smithi084.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:13.600 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/200 2023-09-10T02:12:13.600 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/200 2023-09-10T02:12:13.600 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:13.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:13.610 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-09-10T02:12:13.780 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:13.784 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:13.785 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:13.890 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/201 2023-09-10T02:12:13.890 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/201 2023-09-10T02:12:13.890 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:13.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:13.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:13.900 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-09-10T02:12:14.065 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:14.069 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:14.069 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:14.168 INFO:teuthology.orchestra.run.smithi084.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:14.172 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/202 2023-09-10T02:12:14.172 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/202 2023-09-10T02:12:14.172 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:14.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:14.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:14.182 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-09-10T02:12:14.372 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:14.376 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:14.376 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:14.481 INFO:teuthology.orchestra.run.smithi084.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:14.484 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/203 2023-09-10T02:12:14.485 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/203 2023-09-10T02:12:14.485 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:14.487 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:14.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:14.495 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-09-10T02:12:14.688 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:14.692 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:14.692 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:16.888 INFO:teuthology.orchestra.run.smithi084.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/204 2023-09-10T02:12:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/204 2023-09-10T02:12:16.895 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:16.899 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:16.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:16.912 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-09-10T02:12:17.140 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:17.144 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:17.145 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:17.317 INFO:teuthology.orchestra.run.smithi084.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:17.321 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/205 2023-09-10T02:12:17.322 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/205 2023-09-10T02:12:17.322 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:17.324 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:17.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:17.334 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-09-10T02:12:17.571 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:17.576 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:17.576 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:17.693 INFO:teuthology.orchestra.run.smithi084.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:12:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/206 2023-09-10T02:12:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/206 2023-09-10T02:12:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:17.699 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:17.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:17.708 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-09-10T02:12:17.901 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:17.906 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:17.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:27.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:12:27.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:12:43.227 INFO:teuthology.orchestra.run.smithi084.stdout:generic/207 26s 2023-09-10T02:12:43.233 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/207 2023-09-10T02:12:43.234 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:12:43.237 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:43.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:12:43.249 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-09-10T02:12:43.808 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:12:43.812 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:12:43.813 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:12:57.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:12:57.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:13:27.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:13:27.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:13:57.713 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:13:57.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:14:27.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:14:27.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:14:57.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:14:57.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:15:27.955 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:15:27.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:15:58.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:15:58.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:16:04.217 INFO:teuthology.orchestra.run.smithi084.stdout:generic/208 201s 2023-09-10T02:16:04.224 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/208 2023-09-10T02:16:04.224 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:04.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:04.239 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-09-10T02:16:04.824 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:04.829 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:26.867 INFO:teuthology.orchestra.run.smithi084.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/209.out.bad) 2023-09-10T02:16:26.962 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/209.out 2023-09-10 00:14:15.740892624 +0000 2023-09-10T02:16:26.962 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/209.out.bad 2023-09-10 02:16:26.808580961 +0000 2023-09-10T02:16:26.962 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,2 +1,2 @@ 2023-09-10T02:16:26.962 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 209 2023-09-10T02:16:26.963 INFO:teuthology.orchestra.run.smithi084.stdout: -test ran for 30 seconds without error 2023-09-10T02:16:26.963 INFO:teuthology.orchestra.run.smithi084.stdout: +reader found old byte at pos 4096 2023-09-10T02:16:26.963 INFO:teuthology.orchestra.run.smithi084.stdout: \ No newline at end of file 2023-09-10T02:16:26.972 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/209 2023-09-10T02:16:26.973 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/209 2023-09-10T02:16:26.973 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:16:27.075 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:27.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:16:27.101 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:16:27.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:16:27.101 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-09-10T02:16:27.370 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:27.375 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:27.375 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:27.763 INFO:teuthology.orchestra.run.smithi084.stdout:generic/210 0s 2023-09-10T02:16:27.771 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/210 2023-09-10T02:16:27.771 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:27.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:27.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:27.787 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-09-10T02:16:28.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:16:28.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:16:28.353 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:28.357 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:28.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:generic/211 0s 2023-09-10T02:16:28.707 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/211 2023-09-10T02:16:28.707 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:28.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:28.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:28.719 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-09-10T02:16:28.916 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:28.920 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:28.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:29.194 INFO:teuthology.orchestra.run.smithi084.stdout:generic/212 1s 2023-09-10T02:16:29.199 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/212 2023-09-10T02:16:29.199 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:29.202 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:29.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:29.211 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-09-10T02:16:29.412 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:29.416 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:29.416 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:29.878 INFO:teuthology.orchestra.run.smithi084.stdout:generic/213 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/213.out.bad) 2023-09-10T02:16:29.881 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/213.out 2023-09-10 00:14:15.740892624 +0000 2023-09-10T02:16:29.881 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/213.out.bad 2023-09-10 02:16:29.864524237 +0000 2023-09-10T02:16:29.881 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,4 +1,3 @@ 2023-09-10T02:16:29.881 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 213 2023-09-10T02:16:29.881 INFO:teuthology.orchestra.run.smithi084.stdout: We should get: fallocate: No space left on device 2023-09-10T02:16:29.882 INFO:teuthology.orchestra.run.smithi084.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-09-10T02:16:29.882 INFO:teuthology.orchestra.run.smithi084.stdout: -fallocate: No space left on device 2023-09-10T02:16:29.883 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/213 2023-09-10T02:16:29.883 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/213 2023-09-10T02:16:29.884 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:16:29.886 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:29.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:16:29.894 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:16:29.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:16:29.896 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-09-10T02:16:30.437 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:30.441 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:30.441 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:31.010 INFO:teuthology.orchestra.run.smithi084.stdout:generic/214 0s 2023-09-10T02:16:31.016 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/214 2023-09-10T02:16:31.016 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:31.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:31.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:31.041 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-09-10T02:16:31.663 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:31.668 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:31.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:34.740 INFO:teuthology.orchestra.run.smithi084.stdout:generic/215 3s 2023-09-10T02:16:34.749 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/215 2023-09-10T02:16:34.749 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:34.752 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:34.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:34.763 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-09-10T02:16:35.035 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:35.041 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:35.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:35.257 INFO:teuthology.orchestra.run.smithi084.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/216 2023-09-10T02:16:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/216 2023-09-10T02:16:35.261 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:35.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:35.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:35.275 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-09-10T02:16:35.573 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:35.578 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:35.578 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:35.765 INFO:teuthology.orchestra.run.smithi084.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:35.853 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/217 2023-09-10T02:16:35.853 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/217 2023-09-10T02:16:35.854 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:35.854 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:35.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:35.855 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-09-10T02:16:36.125 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:36.129 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:36.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:36.265 INFO:teuthology.orchestra.run.smithi084.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:36.269 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/218 2023-09-10T02:16:36.269 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/218 2023-09-10T02:16:36.269 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:36.272 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:36.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:36.291 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-09-10T02:16:36.559 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:36.563 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:36.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:36.698 INFO:teuthology.orchestra.run.smithi084.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:36.702 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/219 2023-09-10T02:16:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/219 2023-09-10T02:16:36.703 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:36.705 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:36.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:36.714 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-09-10T02:16:36.974 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:36.979 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:36.979 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:37.120 INFO:teuthology.orchestra.run.smithi084.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:37.123 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/220 2023-09-10T02:16:37.123 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/220 2023-09-10T02:16:37.127 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:37.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:37.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:37.141 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-09-10T02:16:37.405 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:37.411 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:37.411 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:38.614 INFO:teuthology.orchestra.run.smithi084.stdout:generic/221 1s 2023-09-10T02:16:38.624 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/221 2023-09-10T02:16:38.624 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:38.628 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:38.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:38.638 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-09-10T02:16:38.865 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:38.870 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:38.870 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.006 INFO:teuthology.orchestra.run.smithi084.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:39.008 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/222 2023-09-10T02:16:39.008 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/222 2023-09-10T02:16:39.008 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:39.011 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:39.020 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-09-10T02:16:39.249 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:39.254 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:39.254 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.439 INFO:teuthology.orchestra.run.smithi084.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:39.443 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/223 2023-09-10T02:16:39.443 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/223 2023-09-10T02:16:39.444 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:39.446 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:39.456 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-09-10T02:16:39.749 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:39.754 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:39.754 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.933 INFO:teuthology.orchestra.run.smithi084.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:39.943 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/224 2023-09-10T02:16:39.943 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/224 2023-09-10T02:16:39.943 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:39.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:39.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:39.968 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-09-10T02:16:40.261 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:40.266 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:40.266 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:40.402 INFO:teuthology.orchestra.run.smithi084.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:40.406 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/225 2023-09-10T02:16:40.406 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/225 2023-09-10T02:16:40.407 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:40.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:40.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:40.419 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-09-10T02:16:40.705 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:40.709 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:40.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:40.860 INFO:teuthology.orchestra.run.smithi084.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:40.864 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/226 2023-09-10T02:16:40.864 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/226 2023-09-10T02:16:40.865 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:40.867 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:40.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:40.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-09-10T02:16:41.151 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:41.161 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:41.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:41.324 INFO:teuthology.orchestra.run.smithi084.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:41.328 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/227 2023-09-10T02:16:41.328 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/227 2023-09-10T02:16:41.328 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:41.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:41.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:41.345 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-09-10T02:16:41.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:41.616 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:41.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:41.920 INFO:teuthology.orchestra.run.smithi084.stdout:generic/228 0s 2023-09-10T02:16:41.926 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/228 2023-09-10T02:16:41.926 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:41.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:41.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:41.943 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-09-10T02:16:42.554 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:42.559 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:42.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:42.731 INFO:teuthology.orchestra.run.smithi084.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:42.737 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/229 2023-09-10T02:16:42.737 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/229 2023-09-10T02:16:42.738 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:42.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:42.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:42.752 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-09-10T02:16:43.023 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:43.027 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:43.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:43.153 INFO:teuthology.orchestra.run.smithi084.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:43.158 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/230 2023-09-10T02:16:43.158 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/230 2023-09-10T02:16:43.158 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:43.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:43.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:43.172 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-09-10T02:16:43.454 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:43.464 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:43.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:43.635 INFO:teuthology.orchestra.run.smithi084.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:43.639 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/231 2023-09-10T02:16:43.639 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/231 2023-09-10T02:16:43.639 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:43.644 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:43.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:43.655 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-09-10T02:16:43.911 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:43.915 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:43.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:44.074 INFO:teuthology.orchestra.run.smithi084.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:44.079 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/232 2023-09-10T02:16:44.079 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/232 2023-09-10T02:16:44.079 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:44.081 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:44.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:44.093 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-09-10T02:16:44.372 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:44.377 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:44.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:44.505 INFO:teuthology.orchestra.run.smithi084.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:44.509 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/233 2023-09-10T02:16:44.509 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/233 2023-09-10T02:16:44.509 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:44.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:44.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:44.523 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-09-10T02:16:44.815 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:44.819 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:44.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:44.978 INFO:teuthology.orchestra.run.smithi084.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:44.983 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/234 2023-09-10T02:16:44.983 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/234 2023-09-10T02:16:44.983 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:44.985 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:45.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:45.004 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-09-10T02:16:45.290 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:45.295 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:45.296 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:45.453 INFO:teuthology.orchestra.run.smithi084.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:45.458 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/235 2023-09-10T02:16:45.458 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/235 2023-09-10T02:16:45.459 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:45.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:45.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:45.484 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-09-10T02:16:45.776 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:45.781 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:45.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:47.068 INFO:teuthology.orchestra.run.smithi084.stdout:generic/236 2s 2023-09-10T02:16:47.074 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/236 2023-09-10T02:16:47.074 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:47.076 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:47.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:47.087 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-09-10T02:16:47.731 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:47.735 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:47.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:47.950 INFO:teuthology.orchestra.run.smithi084.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T02:16:47.954 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/237 2023-09-10T02:16:47.954 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/237 2023-09-10T02:16:47.955 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:47.963 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:47.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:47.975 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-09-10T02:16:48.272 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:48.283 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:48.283 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:48.434 INFO:teuthology.orchestra.run.smithi084.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:16:48.439 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/238 2023-09-10T02:16:48.439 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/238 2023-09-10T02:16:48.439 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:16:48.442 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:48.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:16:48.460 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-09-10T02:16:48.759 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:16:48.763 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:16:48.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:16:58.205 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:16:58.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:17:28.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:17:28.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:17:58.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:17:58.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:18:28.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:18:28.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:18:29.016 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T02:18:29.017+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45606) UID: 0 2023-09-10T02:18:29.017 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T02:18:29.017+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45606) UID: 0 2023-09-10T02:18:29.017 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T02:18:29.017+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45606) UID: 0 2023-09-10T02:18:29.019 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T02:18:29.017+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45606) UID: 0 2023-09-10T02:19:30.455 INFO:teuthology.orchestra.run.smithi084.stdout:generic/239 162s 2023-09-10T02:19:30.460 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/239 2023-09-10T02:19:30.460 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:19:30.463 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:19:30.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:19:30.636 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-09-10T02:19:31.133 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:19:31.137 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:19:31.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:19:35.378 INFO:teuthology.orchestra.run.smithi084.stdout:generic/240 4s 2023-09-10T02:19:35.459 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/240 2023-09-10T02:19:35.460 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:19:35.462 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:19:35.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:19:35.483 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-09-10T02:19:36.474 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:19:36.480 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:19:36.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:50.277 INFO:teuthology.orchestra.run.smithi084.stdout:generic/241 74s 2023-09-10T02:20:50.294 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/241 2023-09-10T02:20:50.295 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:50.301 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:50.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:50.320 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-09-10T02:20:50.905 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:50.910 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:50.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:51.103 INFO:teuthology.orchestra.run.smithi084.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:20:51.108 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/242 2023-09-10T02:20:51.108 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/242 2023-09-10T02:20:51.109 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:51.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:51.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:51.128 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-09-10T02:20:51.415 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:51.420 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:51.420 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:51.560 INFO:teuthology.orchestra.run.smithi084.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:20:51.565 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/243 2023-09-10T02:20:51.565 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/243 2023-09-10T02:20:51.565 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:51.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:51.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:51.586 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-09-10T02:20:51.842 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:51.852 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:51.852 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:51.993 INFO:teuthology.orchestra.run.smithi084.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T02:20:51.998 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/244 2023-09-10T02:20:51.998 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/244 2023-09-10T02:20:51.999 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:52.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:52.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:52.023 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-09-10T02:20:52.305 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:52.309 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:52.309 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:52.620 INFO:teuthology.orchestra.run.smithi084.stdout:generic/245 0s 2023-09-10T02:20:52.627 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/245 2023-09-10T02:20:52.627 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:52.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:52.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:52.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-09-10T02:20:53.234 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:53.240 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:53.240 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:53.474 INFO:teuthology.orchestra.run.smithi084.stdout:generic/246 0s 2023-09-10T02:20:53.482 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/246 2023-09-10T02:20:53.482 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:20:53.484 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:20:53.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:20:53.495 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-09-10T02:20:54.100 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:20:54.106 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:20:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:56.068 INFO:teuthology.orchestra.run.smithi084.stdout:generic/247 62s 2023-09-10T02:21:56.074 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/247 2023-09-10T02:21:56.075 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:21:56.077 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:56.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:21:56.089 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-09-10T02:21:56.333 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:21:56.337 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:21:56.338 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:56.581 INFO:teuthology.orchestra.run.smithi084.stdout:generic/248 0s 2023-09-10T02:21:56.585 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/248 2023-09-10T02:21:56.585 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:21:56.588 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:56.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:21:56.597 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-09-10T02:21:56.850 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:21:56.855 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:21:56.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:59.058 INFO:teuthology.orchestra.run.smithi084.stdout:generic/249 3s 2023-09-10T02:21:59.064 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/249 2023-09-10T02:21:59.064 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:21:59.068 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:59.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:21:59.086 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-09-10T02:21:59.690 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:21:59.695 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:21:59.695 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:59.933 INFO:teuthology.orchestra.run.smithi084.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:21:59.938 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/250 2023-09-10T02:21:59.938 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/250 2023-09-10T02:21:59.938 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:21:59.945 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:21:59.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:21:59.955 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-09-10T02:22:00.224 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:00.228 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:00.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:00.373 INFO:teuthology.orchestra.run.smithi084.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:00.377 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/251 2023-09-10T02:22:00.377 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/251 2023-09-10T02:22:00.377 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:00.379 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:00.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:00.392 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-09-10T02:22:00.660 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:00.666 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:00.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:00.820 INFO:teuthology.orchestra.run.smithi084.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/252 2023-09-10T02:22:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/252 2023-09-10T02:22:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:00.828 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:00.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:00.842 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-09-10T02:22:01.109 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:01.113 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:01.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:01.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:01.274 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/253 2023-09-10T02:22:01.275 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/253 2023-09-10T02:22:01.275 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:01.277 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:01.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:01.293 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-09-10T02:22:01.558 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:01.563 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:01.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:01.698 INFO:teuthology.orchestra.run.smithi084.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:01.702 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/254 2023-09-10T02:22:01.702 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/254 2023-09-10T02:22:01.702 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:01.705 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:01.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:01.716 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-09-10T02:22:01.955 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:01.960 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:01.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:03.216 INFO:teuthology.orchestra.run.smithi084.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T02:22:03.221 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/255 2023-09-10T02:22:03.221 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/255 2023-09-10T02:22:03.221 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:03.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:03.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:03.244 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-09-10T02:22:03.815 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:03.819 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:03.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:05.049 INFO:teuthology.orchestra.run.smithi084.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:05.053 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/256 2023-09-10T02:22:05.053 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/256 2023-09-10T02:22:05.053 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:05.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:05.066 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-09-10T02:22:05.322 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:05.327 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:07.029 INFO:teuthology.orchestra.run.smithi084.stdout:generic/257 2s 2023-09-10T02:22:07.035 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/257 2023-09-10T02:22:07.036 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:07.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:07.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:07.049 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-09-10T02:22:07.603 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:07.607 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:07.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:07.810 INFO:teuthology.orchestra.run.smithi084.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/258.out.bad) 2023-09-10T02:22:07.813 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/258.out 2023-09-10 00:14:15.744892561 +0000 2023-09-10T02:22:07.813 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/258.out.bad 2023-09-10 02:22:07.810144304 +0000 2023-09-10T02:22:07.813 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,5 +1,6 @@ 2023-09-10T02:22:07.814 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 258 2023-09-10T02:22:07.814 INFO:teuthology.orchestra.run.smithi084.stdout: Creating file with timestamp of Jan 1, 1960 2023-09-10T02:22:07.814 INFO:teuthology.orchestra.run.smithi084.stdout: Testing for negative seconds since epoch 2023-09-10T02:22:07.814 INFO:teuthology.orchestra.run.smithi084.stdout: -Remounting to flush cache 2023-09-10T02:22:07.814 INFO:teuthology.orchestra.run.smithi084.stdout: -Testing for negative seconds since epoch 2023-09-10T02:22:07.815 INFO:teuthology.orchestra.run.smithi084.stdout: +Timestamp wrapped: 3979351756 2023-09-10T02:22:07.815 INFO:teuthology.orchestra.run.smithi084.stdout: +Timestamp wrapped 2023-09-10T02:22:07.815 INFO:teuthology.orchestra.run.smithi084.stdout: +(see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/258.full for details) 2023-09-10T02:22:07.816 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/258 2023-09-10T02:22:07.816 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/258 2023-09-10T02:22:07.816 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:22:07.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:07.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:22:07.827 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:22:07.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:22:07.828 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-09-10T02:22:08.135 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:08.139 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:08.140 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:08.314 INFO:teuthology.orchestra.run.smithi084.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:08.318 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/259 2023-09-10T02:22:08.318 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/259 2023-09-10T02:22:08.319 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:08.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:08.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:08.331 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-09-10T02:22:08.562 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:08.566 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:08.566 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:08.732 INFO:teuthology.orchestra.run.smithi084.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:08.736 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/260 2023-09-10T02:22:08.737 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/260 2023-09-10T02:22:08.737 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:08.740 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:08.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:08.757 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-09-10T02:22:09.022 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:09.027 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:09.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:09.217 INFO:teuthology.orchestra.run.smithi084.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:09.221 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/261 2023-09-10T02:22:09.221 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/261 2023-09-10T02:22:09.221 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:09.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:09.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:09.242 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-09-10T02:22:09.453 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:09.459 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:09.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:09.597 INFO:teuthology.orchestra.run.smithi084.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:22:09.601 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/262 2023-09-10T02:22:09.602 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/262 2023-09-10T02:22:09.602 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:22:09.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:09.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:22:09.618 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-09-10T02:22:09.854 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:22:09.859 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:22:09.859 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:22:44.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:22:44.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:22:44.622 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T02:22:44.617+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 218481) UID: 0 2023-09-10T02:22:44.623 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T02:22:44.617+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 218481) UID: 0 2023-09-10T02:22:44.623 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T02:22:44.617+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 218481) UID: 0 2023-09-10T02:22:44.624 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T02:22:44.617+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 218481) UID: 0 2023-09-10T02:23:33.460 INFO:teuthology.orchestra.run.smithi084.stdout:generic/263 84s 2023-09-10T02:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/263 2023-09-10T02:23:33.465 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:33.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:33.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:33.728 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-09-10T02:23:34.062 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:34.066 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:34.066 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:34.226 INFO:teuthology.orchestra.run.smithi084.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:34.230 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/264 2023-09-10T02:23:34.230 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/264 2023-09-10T02:23:34.231 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:34.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:34.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:34.242 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-09-10T02:23:34.415 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:34.419 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:34.419 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:34.715 INFO:teuthology.orchestra.run.smithi084.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:34.721 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/265 2023-09-10T02:23:34.721 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/265 2023-09-10T02:23:34.721 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:34.725 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:34.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:34.736 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-09-10T02:23:34.914 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:34.918 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:34.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.083 INFO:teuthology.orchestra.run.smithi084.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:35.087 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/266 2023-09-10T02:23:35.087 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/266 2023-09-10T02:23:35.087 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:35.089 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:35.097 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-09-10T02:23:35.286 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:35.290 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:35.290 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.448 INFO:teuthology.orchestra.run.smithi084.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:35.452 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/267 2023-09-10T02:23:35.452 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/267 2023-09-10T02:23:35.452 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:35.455 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:35.464 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-09-10T02:23:35.637 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.816 INFO:teuthology.orchestra.run.smithi084.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:35.820 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/268 2023-09-10T02:23:35.820 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/268 2023-09-10T02:23:35.820 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:35.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:35.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:35.830 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-09-10T02:23:36.026 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:36.030 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:36.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.132 INFO:teuthology.orchestra.run.smithi084.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:36.136 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/269 2023-09-10T02:23:36.136 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/269 2023-09-10T02:23:36.136 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:36.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:36.146 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-09-10T02:23:36.327 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:36.331 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:36.331 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.435 INFO:teuthology.orchestra.run.smithi084.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T02:23:36.438 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/270 2023-09-10T02:23:36.438 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/270 2023-09-10T02:23:36.439 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:36.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:36.448 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-09-10T02:23:36.625 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:36.629 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:36.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.792 INFO:teuthology.orchestra.run.smithi084.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:36.796 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/271 2023-09-10T02:23:36.796 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/271 2023-09-10T02:23:36.796 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:36.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:36.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:36.808 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-09-10T02:23:36.981 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:36.985 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:36.986 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.103 INFO:teuthology.orchestra.run.smithi084.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:37.107 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/272 2023-09-10T02:23:37.107 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/272 2023-09-10T02:23:37.107 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:37.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:37.117 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-09-10T02:23:37.290 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:37.294 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:37.294 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.399 INFO:teuthology.orchestra.run.smithi084.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:37.402 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/273 2023-09-10T02:23:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/273 2023-09-10T02:23:37.403 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:37.404 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:37.413 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-09-10T02:23:37.582 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:37.586 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:37.587 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.703 INFO:teuthology.orchestra.run.smithi084.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:37.707 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/274 2023-09-10T02:23:37.707 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/274 2023-09-10T02:23:37.707 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:37.710 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:37.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:37.718 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-09-10T02:23:37.885 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:37.889 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:37.889 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.013 INFO:teuthology.orchestra.run.smithi084.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:38.017 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/275 2023-09-10T02:23:38.017 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/275 2023-09-10T02:23:38.017 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:38.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:38.027 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-09-10T02:23:38.202 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:38.206 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:38.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.403 INFO:teuthology.orchestra.run.smithi084.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:38.409 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/276 2023-09-10T02:23:38.409 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/276 2023-09-10T02:23:38.409 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:38.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:38.422 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-09-10T02:23:38.635 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:38.639 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:38.640 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.775 INFO:teuthology.orchestra.run.smithi084.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:38.781 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/277 2023-09-10T02:23:38.782 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/277 2023-09-10T02:23:38.782 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:38.783 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:38.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:38.792 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-09-10T02:23:38.974 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:38.978 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:38.978 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.119 INFO:teuthology.orchestra.run.smithi084.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:39.123 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/278 2023-09-10T02:23:39.123 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/278 2023-09-10T02:23:39.123 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:39.125 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:39.133 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-09-10T02:23:39.314 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:39.318 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:39.318 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.536 INFO:teuthology.orchestra.run.smithi084.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:39.540 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/279 2023-09-10T02:23:39.540 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/279 2023-09-10T02:23:39.541 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:39.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:39.553 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-09-10T02:23:39.742 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:39.746 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:39.747 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:39.922 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/280 2023-09-10T02:23:39.923 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/280 2023-09-10T02:23:39.923 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:39.925 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:39.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:39.934 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-09-10T02:23:40.119 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:40.123 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:40.123 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.273 INFO:teuthology.orchestra.run.smithi084.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:40.276 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/281 2023-09-10T02:23:40.277 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/281 2023-09-10T02:23:40.277 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:40.278 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:40.287 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-09-10T02:23:40.470 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:40.475 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:40.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.596 INFO:teuthology.orchestra.run.smithi084.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:40.599 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/282 2023-09-10T02:23:40.599 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/282 2023-09-10T02:23:40.600 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:40.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:40.610 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-09-10T02:23:40.778 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:40.782 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.940 INFO:teuthology.orchestra.run.smithi084.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:40.943 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/283 2023-09-10T02:23:40.943 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/283 2023-09-10T02:23:40.943 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:40.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:40.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:40.954 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-09-10T02:23:41.134 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:41.138 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:41.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:41.243 INFO:teuthology.orchestra.run.smithi084.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:23:41.247 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/284 2023-09-10T02:23:41.247 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/284 2023-09-10T02:23:41.247 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:41.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:41.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:41.257 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-09-10T02:23:41.434 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:41.438 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:43.924 INFO:teuthology.orchestra.run.smithi084.stdout:generic/285 2s 2023-09-10T02:23:43.929 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/285 2023-09-10T02:23:43.929 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:23:43.932 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:23:43.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:23:43.940 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-09-10T02:23:44.539 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:23:44.543 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:23:44.543 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:23.059 INFO:teuthology.orchestra.run.smithi084.stdout:generic/286 39s 2023-09-10T02:24:23.065 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/286 2023-09-10T02:24:23.065 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:23.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:23.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:23.299 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-09-10T02:24:23.670 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:23.674 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:23.675 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:23.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:23.921 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/287 2023-09-10T02:24:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/287 2023-09-10T02:24:23.922 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:23.924 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:23.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:23.932 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-09-10T02:24:24.220 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:24.225 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:24.225 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.360 INFO:teuthology.orchestra.run.smithi084.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:24.364 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/288 2023-09-10T02:24:24.364 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/288 2023-09-10T02:24:24.365 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:24.367 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:24.376 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-09-10T02:24:24.554 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:24.558 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:24.559 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.658 INFO:teuthology.orchestra.run.smithi084.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:24.662 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/289 2023-09-10T02:24:24.662 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/289 2023-09-10T02:24:24.663 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:24.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:24.674 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-09-10T02:24:24.846 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:24.850 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:24.851 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.955 INFO:teuthology.orchestra.run.smithi084.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:24.959 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/290 2023-09-10T02:24:24.959 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/290 2023-09-10T02:24:24.959 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:24.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:24.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:24.969 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-09-10T02:24:25.138 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:25.142 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:25.142 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.249 INFO:teuthology.orchestra.run.smithi084.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:25.252 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/291 2023-09-10T02:24:25.253 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/291 2023-09-10T02:24:25.253 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:25.255 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:25.264 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-09-10T02:24:25.430 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:25.434 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:25.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.542 INFO:teuthology.orchestra.run.smithi084.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/292 2023-09-10T02:24:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/292 2023-09-10T02:24:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:25.548 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:25.557 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-09-10T02:24:25.734 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:25.738 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:25.739 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.839 INFO:teuthology.orchestra.run.smithi084.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:25.842 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/293 2023-09-10T02:24:25.843 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/293 2023-09-10T02:24:25.843 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:25.845 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:25.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:25.853 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-09-10T02:24:26.038 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:26.042 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:26.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.145 INFO:teuthology.orchestra.run.smithi084.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:26.148 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/294 2023-09-10T02:24:26.149 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/294 2023-09-10T02:24:26.149 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:26.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:26.160 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-09-10T02:24:26.331 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:26.335 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:26.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.437 INFO:teuthology.orchestra.run.smithi084.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:26.440 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/295 2023-09-10T02:24:26.441 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/295 2023-09-10T02:24:26.441 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:26.443 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:26.452 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-09-10T02:24:26.622 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:26.626 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:26.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.731 INFO:teuthology.orchestra.run.smithi084.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:26.734 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/296 2023-09-10T02:24:26.735 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/296 2023-09-10T02:24:26.735 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:26.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:26.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:26.746 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-09-10T02:24:26.943 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:26.947 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:26.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.064 INFO:teuthology.orchestra.run.smithi084.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:27.068 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/297 2023-09-10T02:24:27.068 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/297 2023-09-10T02:24:27.069 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:27.070 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:27.079 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-09-10T02:24:27.255 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:27.258 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:27.259 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.367 INFO:teuthology.orchestra.run.smithi084.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:27.370 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/298 2023-09-10T02:24:27.371 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/298 2023-09-10T02:24:27.371 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:27.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:27.381 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-09-10T02:24:27.566 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:27.570 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:27.571 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.687 INFO:teuthology.orchestra.run.smithi084.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:27.691 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/299 2023-09-10T02:24:27.691 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/299 2023-09-10T02:24:27.691 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:27.693 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:27.701 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-09-10T02:24:27.890 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:27.894 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:27.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:27.996 INFO:teuthology.orchestra.run.smithi084.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:27.999 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/300 2023-09-10T02:24:28.000 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/300 2023-09-10T02:24:28.000 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:28.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:28.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:28.010 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-09-10T02:24:28.190 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:28.194 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:28.194 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:28.296 INFO:teuthology.orchestra.run.smithi084.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:28.300 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/301 2023-09-10T02:24:28.300 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/301 2023-09-10T02:24:28.301 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:28.302 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:28.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:28.312 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-09-10T02:24:28.490 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:28.494 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:28.494 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:28.626 INFO:teuthology.orchestra.run.smithi084.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:28.629 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/302 2023-09-10T02:24:28.630 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/302 2023-09-10T02:24:28.630 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:28.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:28.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:28.640 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-09-10T02:24:28.822 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:28.826 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:28.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:29.002 INFO:teuthology.orchestra.run.smithi084.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:24:29.006 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/303 2023-09-10T02:24:29.006 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/303 2023-09-10T02:24:29.006 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:29.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:29.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:29.016 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-09-10T02:24:29.559 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:29.563 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:29.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:29.720 INFO:teuthology.orchestra.run.smithi084.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:24:29.724 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/304 2023-09-10T02:24:29.724 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/304 2023-09-10T02:24:29.724 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:29.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:29.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:29.735 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-09-10T02:24:30.287 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:30.291 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:30.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:30.405 INFO:teuthology.orchestra.run.smithi084.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:30.409 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/305 2023-09-10T02:24:30.409 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/305 2023-09-10T02:24:30.409 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:30.411 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:30.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:30.420 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-09-10T02:24:30.590 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:30.594 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:30.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:30.702 INFO:teuthology.orchestra.run.smithi084.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:30.705 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/306 2023-09-10T02:24:30.705 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/306 2023-09-10T02:24:30.705 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:30.709 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:30.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:30.715 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-09-10T02:24:30.886 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:30.891 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:30.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:31.004 INFO:teuthology.orchestra.run.smithi084.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:24:31.008 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/307 2023-09-10T02:24:31.008 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/307 2023-09-10T02:24:31.008 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:31.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:31.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:31.018 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-09-10T02:24:31.206 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:31.210 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:31.211 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:31.349 INFO:teuthology.orchestra.run.smithi084.stdout:generic/308 0s 2023-09-10T02:24:31.354 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/308 2023-09-10T02:24:31.354 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:31.357 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:31.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:31.366 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-09-10T02:24:31.546 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:31.550 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:31.551 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:32.765 INFO:teuthology.orchestra.run.smithi084.stdout:generic/309 1s 2023-09-10T02:24:32.769 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/309 2023-09-10T02:24:32.770 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:24:32.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:24:32.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:24:32.781 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-09-10T02:24:33.347 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:24:33.351 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:24:33.351 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:57.031 INFO:teuthology.orchestra.run.smithi084.stdout:generic/310 84s 2023-09-10T02:25:57.037 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/310 2023-09-10T02:25:57.037 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:25:57.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:57.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:25:57.095 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-09-10T02:25:57.326 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:25:57.332 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:25:57.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:57.884 INFO:teuthology.orchestra.run.smithi084.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:25:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/311 2023-09-10T02:25:57.888 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/311 2023-09-10T02:25:57.889 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:25:57.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:57.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:25:57.900 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-09-10T02:25:58.087 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:25:58.091 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:25:58.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:58.226 INFO:teuthology.orchestra.run.smithi084.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:25:58.229 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/312 2023-09-10T02:25:58.229 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/312 2023-09-10T02:25:58.229 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:25:58.231 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:25:58.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:25:58.240 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-09-10T02:25:58.543 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:25:58.547 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:25:58.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:02.777 INFO:teuthology.orchestra.run.smithi084.stdout:generic/313 4s 2023-09-10T02:26:02.785 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/313 2023-09-10T02:26:02.785 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:02.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:02.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:02.800 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-09-10T02:26:03.022 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:03.027 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:03.027 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:03.610 INFO:teuthology.orchestra.run.smithi084.stdout:generic/314 0s 2023-09-10T02:26:03.616 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/314 2023-09-10T02:26:03.616 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:03.619 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:03.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:03.630 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-09-10T02:26:03.852 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:03.857 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:03.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:09.562 INFO:teuthology.orchestra.run.smithi084.stdout:generic/315 6s 2023-09-10T02:26:09.569 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/315 2023-09-10T02:26:09.569 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:09.573 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:09.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:09.586 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-09-10T02:26:10.115 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:10.119 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:10.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:10.722 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:26:10.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:26:11.078 INFO:teuthology.orchestra.run.smithi084.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T02:26:11.082 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/316 2023-09-10T02:26:11.082 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/316 2023-09-10T02:26:11.082 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:11.084 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:11.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:11.094 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-09-10T02:26:11.647 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:11.651 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:11.651 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:11.831 INFO:teuthology.orchestra.run.smithi084.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:26:11.834 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/317 2023-09-10T02:26:11.834 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/317 2023-09-10T02:26:11.835 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:11.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:11.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:11.846 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-09-10T02:26:12.018 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:12.022 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:12.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.125 INFO:teuthology.orchestra.run.smithi084.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:26:12.126 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/318 2023-09-10T02:26:12.127 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/318 2023-09-10T02:26:12.127 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:12.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:12.137 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-09-10T02:26:12.326 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:12.330 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:12.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.466 INFO:teuthology.orchestra.run.smithi084.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T02:26:12.470 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/319 2023-09-10T02:26:12.470 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/319 2023-09-10T02:26:12.470 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:12.472 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:12.480 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-09-10T02:26:12.657 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:12.661 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:12.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.759 INFO:teuthology.orchestra.run.smithi084.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:26:12.763 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/320 2023-09-10T02:26:12.763 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/320 2023-09-10T02:26:12.763 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:12.766 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:12.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:12.774 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-09-10T02:26:12.950 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:12.954 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:12.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:13.073 INFO:teuthology.orchestra.run.smithi084.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:26:13.076 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/321 2023-09-10T02:26:13.077 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/321 2023-09-10T02:26:13.077 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:13.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:13.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:13.088 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-09-10T02:26:13.270 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:13.274 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:13.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:13.388 INFO:teuthology.orchestra.run.smithi084.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:26:13.392 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/322 2023-09-10T02:26:13.392 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/322 2023-09-10T02:26:13.392 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:26:13.395 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:13.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:26:13.404 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-09-10T02:26:13.579 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:26:13.583 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:26:13.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:26:41.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:26:41.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:27:11.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:27:11.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:27:41.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:27:41.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:28:11.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:28:11.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:28:11.271 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T02:28:11.271+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45792) UID: 0 2023-09-10T02:28:11.272 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T02:28:11.271+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45792) UID: 0 2023-09-10T02:28:11.272 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T02:28:11.271+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45792) UID: 0 2023-09-10T02:28:11.272 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T02:28:11.271+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45792) UID: 0 2023-09-10T02:28:14.601 INFO:teuthology.orchestra.run.smithi084.stdout:generic/323 121s 2023-09-10T02:28:14.608 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/323 2023-09-10T02:28:14.609 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:14.612 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:14.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:14.624 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-09-10T02:28:15.131 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:15.135 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:15.136 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.244 INFO:teuthology.orchestra.run.smithi084.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:15.247 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/324 2023-09-10T02:28:15.248 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/324 2023-09-10T02:28:15.248 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:15.250 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:15.258 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-09-10T02:28:15.426 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:15.429 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:15.430 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.544 INFO:teuthology.orchestra.run.smithi084.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:15.548 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/325 2023-09-10T02:28:15.548 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/325 2023-09-10T02:28:15.548 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:15.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:15.559 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-09-10T02:28:15.750 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:15.754 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:15.754 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.860 INFO:teuthology.orchestra.run.smithi084.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:15.863 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/326 2023-09-10T02:28:15.864 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/326 2023-09-10T02:28:15.864 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:15.866 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:15.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:15.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-09-10T02:28:16.042 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:16.046 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:16.046 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.148 INFO:teuthology.orchestra.run.smithi084.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:16.152 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/327 2023-09-10T02:28:16.152 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/327 2023-09-10T02:28:16.152 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:16.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:16.163 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-09-10T02:28:16.330 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:16.334 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:16.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.436 INFO:teuthology.orchestra.run.smithi084.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:16.439 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/328 2023-09-10T02:28:16.440 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/328 2023-09-10T02:28:16.440 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:16.442 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:16.450 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-09-10T02:28:16.631 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:16.635 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:16.636 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.748 INFO:teuthology.orchestra.run.smithi084.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/329 2023-09-10T02:28:16.752 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/329 2023-09-10T02:28:16.753 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:16.754 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:16.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:16.763 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-09-10T02:28:16.949 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:16.954 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:16.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.055 INFO:teuthology.orchestra.run.smithi084.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:17.058 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/330 2023-09-10T02:28:17.058 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/330 2023-09-10T02:28:17.059 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:17.060 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:17.069 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-09-10T02:28:17.237 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:17.242 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:17.242 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.357 INFO:teuthology.orchestra.run.smithi084.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:17.361 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/331 2023-09-10T02:28:17.361 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/331 2023-09-10T02:28:17.361 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:17.363 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:17.371 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-09-10T02:28:17.569 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:17.574 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:17.574 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.685 INFO:teuthology.orchestra.run.smithi084.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:17.688 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/332 2023-09-10T02:28:17.688 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/332 2023-09-10T02:28:17.688 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:17.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:17.700 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-09-10T02:28:17.874 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:17.878 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:17.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.977 INFO:teuthology.orchestra.run.smithi084.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:17.981 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/333 2023-09-10T02:28:17.981 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/333 2023-09-10T02:28:17.981 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:17.983 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:17.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:17.992 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-09-10T02:28:18.158 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:18.162 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:18.163 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.263 INFO:teuthology.orchestra.run.smithi084.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:18.266 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/334 2023-09-10T02:28:18.267 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/334 2023-09-10T02:28:18.267 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:18.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:18.277 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-09-10T02:28:18.456 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:18.460 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:18.460 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.601 INFO:teuthology.orchestra.run.smithi084.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/335 2023-09-10T02:28:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/335 2023-09-10T02:28:18.606 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:18.609 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:18.618 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-09-10T02:28:18.787 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:18.791 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:18.791 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.917 INFO:teuthology.orchestra.run.smithi084.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:18.920 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/336 2023-09-10T02:28:18.920 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/336 2023-09-10T02:28:18.921 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:18.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:18.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:18.931 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-09-10T02:28:19.098 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:19.103 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:19.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.206 INFO:teuthology.orchestra.run.smithi084.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:19.209 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/337 2023-09-10T02:28:19.209 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/337 2023-09-10T02:28:19.210 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:19.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:19.220 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-09-10T02:28:19.402 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:19.406 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:19.406 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.520 INFO:teuthology.orchestra.run.smithi084.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:19.524 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/338 2023-09-10T02:28:19.524 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/338 2023-09-10T02:28:19.524 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:19.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:19.534 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-09-10T02:28:19.709 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:19.713 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:19.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.814 INFO:teuthology.orchestra.run.smithi084.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:19.818 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/339 2023-09-10T02:28:19.818 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/339 2023-09-10T02:28:19.819 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:19.820 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:19.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:19.829 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-09-10T02:28:20.012 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:20.016 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:20.016 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.116 INFO:teuthology.orchestra.run.smithi084.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:20.119 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/340 2023-09-10T02:28:20.119 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/340 2023-09-10T02:28:20.120 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:20.122 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:20.130 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-09-10T02:28:20.298 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:20.301 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:20.302 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.475 INFO:teuthology.orchestra.run.smithi084.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:20.479 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/341 2023-09-10T02:28:20.480 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/341 2023-09-10T02:28:20.480 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:20.482 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:20.491 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-09-10T02:28:20.670 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:20.674 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:20.674 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.809 INFO:teuthology.orchestra.run.smithi084.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:20.812 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/342 2023-09-10T02:28:20.813 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/342 2023-09-10T02:28:20.813 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:20.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:20.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:20.824 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-09-10T02:28:21.035 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:21.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:21.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.161 INFO:teuthology.orchestra.run.smithi084.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:21.165 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/343 2023-09-10T02:28:21.165 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/343 2023-09-10T02:28:21.165 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:21.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:21.177 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-09-10T02:28:21.364 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:21.368 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:21.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.470 INFO:teuthology.orchestra.run.smithi084.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:21.473 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/344 2023-09-10T02:28:21.474 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/344 2023-09-10T02:28:21.474 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:21.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:21.485 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-09-10T02:28:21.659 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:21.663 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:21.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.764 INFO:teuthology.orchestra.run.smithi084.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/345 2023-09-10T02:28:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/345 2023-09-10T02:28:21.768 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:21.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:21.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:21.779 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-09-10T02:28:21.956 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:21.960 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:21.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.060 INFO:teuthology.orchestra.run.smithi084.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:22.064 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/346 2023-09-10T02:28:22.064 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/346 2023-09-10T02:28:22.064 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:22.066 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:22.075 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-09-10T02:28:22.263 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:22.267 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:22.267 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.442 INFO:teuthology.orchestra.run.smithi084.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:22.445 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/347 2023-09-10T02:28:22.445 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/347 2023-09-10T02:28:22.445 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:22.447 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:22.457 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-09-10T02:28:22.631 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:22.635 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:22.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.749 INFO:teuthology.orchestra.run.smithi084.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:22.753 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/348 2023-09-10T02:28:22.753 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/348 2023-09-10T02:28:22.753 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:22.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:22.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:22.764 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-09-10T02:28:22.946 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:22.950 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:22.951 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:24.026 INFO:teuthology.orchestra.run.smithi084.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-10T02:28:24.031 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/349 2023-09-10T02:28:24.032 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/349 2023-09-10T02:28:24.032 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:24.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:24.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:24.047 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-09-10T02:28:24.285 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:24.291 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:24.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:26.324 INFO:teuthology.orchestra.run.smithi084.stdout:generic/350 2s 2023-09-10T02:28:26.331 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/350 2023-09-10T02:28:26.332 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:26.335 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:26.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:26.345 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-09-10T02:28:26.578 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:26.583 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:26.583 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:27.661 INFO:teuthology.orchestra.run.smithi084.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-10T02:28:27.666 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/351 2023-09-10T02:28:27.666 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/351 2023-09-10T02:28:27.666 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:27.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:27.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:27.683 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-09-10T02:28:28.219 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:28.223 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:28.223 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.328 INFO:teuthology.orchestra.run.smithi084.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:28.331 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/352 2023-09-10T02:28:28.332 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/352 2023-09-10T02:28:28.332 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:28.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:28.343 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-09-10T02:28:28.514 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:28.519 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:28.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.623 INFO:teuthology.orchestra.run.smithi084.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:28.627 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/353 2023-09-10T02:28:28.627 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/353 2023-09-10T02:28:28.627 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:28.629 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:28.638 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-09-10T02:28:28.826 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:28.830 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:28.830 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.928 INFO:teuthology.orchestra.run.smithi084.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:28.932 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/354 2023-09-10T02:28:28.932 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/354 2023-09-10T02:28:28.932 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:28.934 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:28.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:28.943 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-09-10T02:28:29.110 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:29.114 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:29.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:29.568 INFO:teuthology.orchestra.run.smithi084.stdout:generic/355 0s 2023-09-10T02:28:29.573 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/355 2023-09-10T02:28:29.573 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:29.575 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:29.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:29.585 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-09-10T02:28:30.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:30.108 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:30.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.209 INFO:teuthology.orchestra.run.smithi084.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:30.212 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/356 2023-09-10T02:28:30.212 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/356 2023-09-10T02:28:30.213 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:30.215 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:30.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-09-10T02:28:30.420 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:30.425 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:30.425 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.530 INFO:teuthology.orchestra.run.smithi084.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:30.534 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/357 2023-09-10T02:28:30.534 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/357 2023-09-10T02:28:30.534 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:30.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:30.545 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-09-10T02:28:30.741 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:30.745 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:30.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.847 INFO:teuthology.orchestra.run.smithi084.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/358 2023-09-10T02:28:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/358 2023-09-10T02:28:30.851 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:30.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:30.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:30.921 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-09-10T02:28:31.110 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:31.115 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:31.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:31.218 INFO:teuthology.orchestra.run.smithi084.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:31.222 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/359 2023-09-10T02:28:31.225 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/359 2023-09-10T02:28:31.225 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:31.225 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:31.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:31.233 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-09-10T02:28:31.414 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:31.418 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:31.418 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:31.703 INFO:teuthology.orchestra.run.smithi084.stdout:generic/360 0s 2023-09-10T02:28:31.708 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/360 2023-09-10T02:28:31.709 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:31.711 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:31.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:31.721 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-09-10T02:28:31.907 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:31.911 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:31.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.066 INFO:teuthology.orchestra.run.smithi084.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:32.070 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/361 2023-09-10T02:28:32.070 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/361 2023-09-10T02:28:32.070 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:32.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:32.082 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-09-10T02:28:32.266 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:32.270 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:32.271 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.415 INFO:teuthology.orchestra.run.smithi084.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:32.419 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/362 2023-09-10T02:28:32.420 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/362 2023-09-10T02:28:32.420 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:32.422 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:32.430 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-09-10T02:28:32.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:32.606 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:32.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.707 INFO:teuthology.orchestra.run.smithi084.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:32.710 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/363 2023-09-10T02:28:32.710 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/363 2023-09-10T02:28:32.711 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:32.712 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:32.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:32.722 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-09-10T02:28:32.914 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:32.919 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:32.919 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.024 INFO:teuthology.orchestra.run.smithi084.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:33.027 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/364 2023-09-10T02:28:33.027 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/364 2023-09-10T02:28:33.028 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:33.030 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:33.039 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-09-10T02:28:33.202 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:33.206 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:33.206 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.307 INFO:teuthology.orchestra.run.smithi084.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:33.311 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/365 2023-09-10T02:28:33.311 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/365 2023-09-10T02:28:33.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:33.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:33.322 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-09-10T02:28:33.482 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:33.486 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:33.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.590 INFO:teuthology.orchestra.run.smithi084.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:33.593 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/366 2023-09-10T02:28:33.593 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/366 2023-09-10T02:28:33.594 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:33.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:33.604 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-09-10T02:28:33.794 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:33.798 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:33.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.903 INFO:teuthology.orchestra.run.smithi084.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:33.906 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/367 2023-09-10T02:28:33.906 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/367 2023-09-10T02:28:33.907 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:33.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:33.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:33.917 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-09-10T02:28:34.099 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:34.103 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:34.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.202 INFO:teuthology.orchestra.run.smithi084.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:34.206 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/368 2023-09-10T02:28:34.206 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/368 2023-09-10T02:28:34.207 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:34.208 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:34.217 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-09-10T02:28:34.422 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:34.426 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:34.426 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.529 INFO:teuthology.orchestra.run.smithi084.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:34.533 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/369 2023-09-10T02:28:34.533 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/369 2023-09-10T02:28:34.533 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:34.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:34.544 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-09-10T02:28:34.710 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:34.714 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:34.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.813 INFO:teuthology.orchestra.run.smithi084.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:34.817 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/370 2023-09-10T02:28:34.817 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/370 2023-09-10T02:28:34.817 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:34.819 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:34.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:34.828 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-09-10T02:28:34.998 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:35.002 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:35.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.105 INFO:teuthology.orchestra.run.smithi084.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:35.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/371 2023-09-10T02:28:35.106 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/371 2023-09-10T02:28:35.107 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:35.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:35.117 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-09-10T02:28:35.306 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:35.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:35.310 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.411 INFO:teuthology.orchestra.run.smithi084.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:35.414 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/372 2023-09-10T02:28:35.415 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/372 2023-09-10T02:28:35.415 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:35.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:35.425 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-09-10T02:28:35.602 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:35.606 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:35.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.708 INFO:teuthology.orchestra.run.smithi084.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:35.712 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/373 2023-09-10T02:28:35.712 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/373 2023-09-10T02:28:35.712 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:35.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:35.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:35.723 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-09-10T02:28:35.911 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:35.915 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:35.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.020 INFO:teuthology.orchestra.run.smithi084.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:36.024 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/374 2023-09-10T02:28:36.024 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/374 2023-09-10T02:28:36.024 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:36.026 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:36.035 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-09-10T02:28:36.206 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:36.210 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:36.210 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.338 INFO:teuthology.orchestra.run.smithi084.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T02:28:36.341 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/375 2023-09-10T02:28:36.341 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/375 2023-09-10T02:28:36.342 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:36.344 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:36.353 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-09-10T02:28:36.556 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:36.561 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:36.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.681 INFO:teuthology.orchestra.run.smithi084.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/376 2023-09-10T02:28:36.685 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/376 2023-09-10T02:28:36.686 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:36.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:36.696 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-09-10T02:28:36.880 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:36.884 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:36.884 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:36.986 INFO:teuthology.orchestra.run.smithi084.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:36.990 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/377 2023-09-10T02:28:36.991 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/377 2023-09-10T02:28:36.991 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:36.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:37.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:37.002 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-09-10T02:28:37.178 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:37.183 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:37.183 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:37.404 INFO:teuthology.orchestra.run.smithi084.stdout:generic/378 0s 2023-09-10T02:28:37.409 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/378 2023-09-10T02:28:37.410 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:37.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:37.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:37.421 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-09-10T02:28:37.942 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:37.946 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:37.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.052 INFO:teuthology.orchestra.run.smithi084.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:38.055 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/379 2023-09-10T02:28:38.055 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/379 2023-09-10T02:28:38.055 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:38.057 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:38.066 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-09-10T02:28:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:38.251 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:38.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.352 INFO:teuthology.orchestra.run.smithi084.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:38.356 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/380 2023-09-10T02:28:38.356 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/380 2023-09-10T02:28:38.356 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:38.358 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:38.367 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-09-10T02:28:38.539 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:38.543 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:38.544 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.646 INFO:teuthology.orchestra.run.smithi084.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:38.649 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/381 2023-09-10T02:28:38.650 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/381 2023-09-10T02:28:38.650 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:38.652 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:38.660 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-09-10T02:28:38.850 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:38.854 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:38.854 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.963 INFO:teuthology.orchestra.run.smithi084.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:38.967 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/382 2023-09-10T02:28:38.967 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/382 2023-09-10T02:28:38.967 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:38.970 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:38.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:38.978 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-09-10T02:28:39.150 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:39.154 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:39.155 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.256 INFO:teuthology.orchestra.run.smithi084.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:39.260 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/383 2023-09-10T02:28:39.260 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/383 2023-09-10T02:28:39.260 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:39.262 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:39.271 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-09-10T02:28:39.460 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:39.464 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:39.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.579 INFO:teuthology.orchestra.run.smithi084.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T02:28:39.582 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/384 2023-09-10T02:28:39.582 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/384 2023-09-10T02:28:39.583 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:39.585 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:39.593 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-09-10T02:28:39.775 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:39.779 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:39.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.900 INFO:teuthology.orchestra.run.smithi084.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:39.903 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/385 2023-09-10T02:28:39.904 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/385 2023-09-10T02:28:39.904 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:39.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:39.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:39.915 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-09-10T02:28:40.099 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:40.103 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:40.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.206 INFO:teuthology.orchestra.run.smithi084.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T02:28:40.210 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/386 2023-09-10T02:28:40.210 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/386 2023-09-10T02:28:40.211 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:40.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:40.222 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-09-10T02:28:40.395 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:40.399 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:40.399 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.502 INFO:teuthology.orchestra.run.smithi084.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/387 2023-09-10T02:28:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/387 2023-09-10T02:28:40.506 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:40.508 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:40.517 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-09-10T02:28:40.686 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:40.690 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:40.690 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.792 INFO:teuthology.orchestra.run.smithi084.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:40.795 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/388 2023-09-10T02:28:40.795 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/388 2023-09-10T02:28:40.796 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:40.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:40.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:40.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-09-10T02:28:40.998 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:41.002 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:41.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:41.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-09-10T02:28:41.115 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/389 2023-09-10T02:28:41.116 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/389 2023-09-10T02:28:41.116 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:41.118 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:41.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:41.127 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-09-10T02:28:41.306 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:41.310 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:41.310 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:41.432 INFO:teuthology.orchestra.run.smithi084.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:28:41.435 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/390 2023-09-10T02:28:41.436 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/390 2023-09-10T02:28:41.436 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:28:41.437 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:28:41.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:28:41.446 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-09-10T02:28:41.610 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:28:41.614 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:28:41.614 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:23.513 INFO:teuthology.orchestra.run.smithi084.stdout:generic/391 42s 2023-09-10T02:29:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/391 2023-09-10T02:29:23.642 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:23.647 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:23.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:23.727 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-09-10T02:29:25.172 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:25.178 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:25.178 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:25.433 INFO:teuthology.orchestra.run.smithi084.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/392 2023-09-10T02:29:25.437 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/392 2023-09-10T02:29:25.438 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:25.441 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:25.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:25.454 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-09-10T02:29:25.688 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:25.694 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:25.695 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:25.847 INFO:teuthology.orchestra.run.smithi084.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:25.850 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/393 2023-09-10T02:29:25.851 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/393 2023-09-10T02:29:25.851 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:25.853 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:25.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:25.868 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-09-10T02:29:26.133 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:26.138 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:26.138 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:26.370 INFO:teuthology.orchestra.run.smithi084.stdout:generic/394 0s 2023-09-10T02:29:26.375 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/394 2023-09-10T02:29:26.375 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:26.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:26.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:26.387 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-09-10T02:29:26.932 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:26.938 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:26.938 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:27.108 INFO:teuthology.orchestra.run.smithi084.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:27.112 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/395 2023-09-10T02:29:27.113 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/395 2023-09-10T02:29:27.113 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:27.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:27.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:27.131 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-09-10T02:29:27.402 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:27.407 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:27.408 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:27.588 INFO:teuthology.orchestra.run.smithi084.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:27.592 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/396 2023-09-10T02:29:27.592 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/396 2023-09-10T02:29:27.592 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:27.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:27.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:27.614 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-09-10T02:29:27.867 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:27.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.095 INFO:teuthology.orchestra.run.smithi084.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:28.099 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/397 2023-09-10T02:29:28.099 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/397 2023-09-10T02:29:28.100 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:28.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:28.112 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-09-10T02:29:28.365 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:28.370 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:28.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.561 INFO:teuthology.orchestra.run.smithi084.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:28.565 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/398 2023-09-10T02:29:28.565 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/398 2023-09-10T02:29:28.566 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:28.568 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:28.582 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-09-10T02:29:28.756 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:28.760 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:28.760 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:28.889 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/399 2023-09-10T02:29:28.890 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/399 2023-09-10T02:29:28.890 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:28.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:28.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:28.900 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-09-10T02:29:29.078 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:29.083 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:29.083 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.185 INFO:teuthology.orchestra.run.smithi084.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T02:29:29.188 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/400 2023-09-10T02:29:29.189 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/400 2023-09-10T02:29:29.189 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:29.191 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:29.200 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-09-10T02:29:29.405 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:29.410 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:29.410 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.566 INFO:teuthology.orchestra.run.smithi084.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:29.569 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/401 2023-09-10T02:29:29.569 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/401 2023-09-10T02:29:29.570 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:29.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:29.581 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-09-10T02:29:29.768 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:29.772 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:29.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.886 INFO:teuthology.orchestra.run.smithi084.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:29.890 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/402 2023-09-10T02:29:29.890 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/402 2023-09-10T02:29:29.891 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:29.892 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:29.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:29.901 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-09-10T02:29:30.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:30.109 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:30.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:30.217 INFO:teuthology.orchestra.run.smithi084.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:30.221 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/403 2023-09-10T02:29:30.221 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/403 2023-09-10T02:29:30.221 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:30.224 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:30.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:30.233 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-09-10T02:29:30.414 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:30.418 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:30.418 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:31.369 INFO:teuthology.orchestra.run.smithi084.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-10T02:29:31.374 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/404 2023-09-10T02:29:31.374 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/404 2023-09-10T02:29:31.374 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:31.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:31.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:31.388 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-09-10T02:29:31.894 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:31.898 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:31.899 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:32.364 INFO:teuthology.orchestra.run.smithi084.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:32.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/405 2023-09-10T02:29:32.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/405 2023-09-10T02:29:32.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:32.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:32.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:32.384 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-09-10T02:29:32.599 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:32.603 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:32.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:32.705 INFO:teuthology.orchestra.run.smithi084.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:32.709 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/406 2023-09-10T02:29:32.709 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/406 2023-09-10T02:29:32.709 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:32.711 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:32.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:32.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-09-10T02:29:32.903 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:32.907 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:32.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:33.059 INFO:teuthology.orchestra.run.smithi084.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:29:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/407 2023-09-10T02:29:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/407 2023-09-10T02:29:33.063 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:33.065 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:33.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:33.074 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-09-10T02:29:33.587 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:33.591 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:33.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:33.747 INFO:teuthology.orchestra.run.smithi084.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:29:33.751 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/408 2023-09-10T02:29:33.751 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/408 2023-09-10T02:29:33.751 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:33.753 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:33.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:33.762 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-09-10T02:29:34.270 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:34.274 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:34.274 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:34.378 INFO:teuthology.orchestra.run.smithi084.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:34.381 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/409 2023-09-10T02:29:34.382 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/409 2023-09-10T02:29:34.382 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:34.384 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:34.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:34.392 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-09-10T02:29:34.586 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:34.591 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:34.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:34.700 INFO:teuthology.orchestra.run.smithi084.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:34.704 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/410 2023-09-10T02:29:34.704 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/410 2023-09-10T02:29:34.704 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:34.706 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:34.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:34.715 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-09-10T02:29:34.886 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:34.890 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:34.890 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.047 INFO:teuthology.orchestra.run.smithi084.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:35.052 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/411 2023-09-10T02:29:35.052 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/411 2023-09-10T02:29:35.052 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:35.054 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:35.062 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-09-10T02:29:35.274 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:35.278 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:35.279 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.432 INFO:teuthology.orchestra.run.smithi084.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:35.436 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/412 2023-09-10T02:29:35.436 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/412 2023-09-10T02:29:35.436 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:35.438 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:35.448 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-09-10T02:29:35.647 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:35.650 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:35.651 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.758 INFO:teuthology.orchestra.run.smithi084.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:35.762 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/413 2023-09-10T02:29:35.763 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/413 2023-09-10T02:29:35.763 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:35.765 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:35.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:35.774 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-09-10T02:29:35.966 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:35.971 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:35.971 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.074 INFO:teuthology.orchestra.run.smithi084.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:36.078 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/414 2023-09-10T02:29:36.078 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/414 2023-09-10T02:29:36.079 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:36.080 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:36.089 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-09-10T02:29:36.290 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:36.295 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:36.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.396 INFO:teuthology.orchestra.run.smithi084.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:36.400 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/415 2023-09-10T02:29:36.400 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/415 2023-09-10T02:29:36.400 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:36.403 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:36.411 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-09-10T02:29:36.590 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:36.594 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:36.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.697 INFO:teuthology.orchestra.run.smithi084.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/416 2023-09-10T02:29:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/416 2023-09-10T02:29:36.700 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:36.702 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:36.711 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-09-10T02:29:36.891 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:36.896 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:36.896 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:36.996 INFO:teuthology.orchestra.run.smithi084.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:36.999 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/417 2023-09-10T02:29:36.999 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/417 2023-09-10T02:29:37.000 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:37.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:37.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:37.010 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-09-10T02:29:37.174 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:37.178 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:37.178 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:37.360 INFO:teuthology.orchestra.run.smithi084.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-09-10T02:29:37.365 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/418 2023-09-10T02:29:37.366 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/418 2023-09-10T02:29:37.366 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:37.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:37.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:37.378 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-09-10T02:29:37.558 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:37.563 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:37.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:37.691 INFO:teuthology.orchestra.run.smithi084.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:37.695 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/419 2023-09-10T02:29:37.695 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/419 2023-09-10T02:29:37.696 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:37.698 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:37.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:37.706 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-09-10T02:29:37.894 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:37.898 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:37.898 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:38.875 INFO:teuthology.orchestra.run.smithi084.stdout:generic/420 1s 2023-09-10T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/420 2023-09-10T02:29:38.880 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:38.883 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:38.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:38.892 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-09-10T02:29:39.406 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:39.410 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:39.410 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:39.540 INFO:teuthology.orchestra.run.smithi084.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:39.544 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/421 2023-09-10T02:29:39.544 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/421 2023-09-10T02:29:39.544 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:39.546 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:39.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:39.555 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-09-10T02:29:39.730 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:39.735 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:39.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:39.841 INFO:teuthology.orchestra.run.smithi084.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:39.844 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/422 2023-09-10T02:29:39.845 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/422 2023-09-10T02:29:39.845 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:39.847 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:39.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:39.855 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-09-10T02:29:40.031 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:40.035 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:40.035 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:40.294 INFO:teuthology.orchestra.run.smithi084.stdout:generic/423 0s 2023-09-10T02:29:40.299 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/423 2023-09-10T02:29:40.299 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:40.302 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:40.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:40.311 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-09-10T02:29:40.822 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:40.826 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:40.826 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:40.971 INFO:teuthology.orchestra.run.smithi084.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-09-10T02:29:40.975 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/424 2023-09-10T02:29:40.975 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/424 2023-09-10T02:29:40.975 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:40.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:40.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:40.985 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-09-10T02:29:41.170 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:41.174 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:41.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:41.275 INFO:teuthology.orchestra.run.smithi084.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:29:41.279 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/425 2023-09-10T02:29:41.279 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/425 2023-09-10T02:29:41.279 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:29:41.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:29:41.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:29:41.289 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-09-10T02:29:41.458 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:29:41.462 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:29:41.462 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:38.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:30:38.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:30:50.412 INFO:teuthology.orchestra.run.smithi084.stdout:generic/426 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/426.out.bad) 2023-09-10T02:30:50.442 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/426.out 2023-09-10 00:14:15.756892369 +0000 2023-09-10T02:30:50.442 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/426.out.bad 2023-09-10 02:30:50.356404347 +0000 2023-09-10T02:30:50.442 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,5 +1,326 @@ 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 426 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/426-dir -d 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000703) opened an unlinked file! 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000704) opened an unlinked file! 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000705) opened an unlinked file! 2023-09-10T02:30:50.443 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000706) opened an unlinked file! 2023-09-10T02:30:50.444 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000707) opened an unlinked file! 2023-09-10T02:30:50.444 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000708) opened an unlinked file! 2023-09-10T02:30:50.444 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000709) opened an unlinked file! 2023-09-10T02:30:50.444 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000710) opened an unlinked file! 2023-09-10T02:30:50.444 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000711) opened an unlinked file! 2023-09-10T02:30:50.445 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000712) opened an unlinked file! 2023-09-10T02:30:50.445 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000713) opened an unlinked file! 2023-09-10T02:30:50.445 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000714) opened an unlinked file! 2023-09-10T02:30:50.445 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000715) opened an unlinked file! 2023-09-10T02:30:50.445 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000716) opened an unlinked file! 2023-09-10T02:30:50.446 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000717) opened an unlinked file! 2023-09-10T02:30:50.446 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000718) opened an unlinked file! 2023-09-10T02:30:50.446 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000719) opened an unlinked file! 2023-09-10T02:30:50.446 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000720) opened an unlinked file! 2023-09-10T02:30:50.446 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000721) opened an unlinked file! 2023-09-10T02:30:50.447 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000722) opened an unlinked file! 2023-09-10T02:30:50.449 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000723) opened an unlinked file! 2023-09-10T02:30:50.449 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000724) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000725) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000726) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000727) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000728) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000729) opened an unlinked file! 2023-09-10T02:30:50.450 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000730) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000731) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000732) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000733) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000734) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000735) opened an unlinked file! 2023-09-10T02:30:50.451 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000736) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000737) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000738) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000739) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000740) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000741) opened an unlinked file! 2023-09-10T02:30:50.452 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000742) opened an unlinked file! 2023-09-10T02:30:50.453 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000743) opened an unlinked file! 2023-09-10T02:30:50.453 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000744) opened an unlinked file! 2023-09-10T02:30:50.453 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000745) opened an unlinked file! 2023-09-10T02:30:50.453 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000746) opened an unlinked file! 2023-09-10T02:30:50.453 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000747) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000748) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000749) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000750) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000751) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000752) opened an unlinked file! 2023-09-10T02:30:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000753) opened an unlinked file! 2023-09-10T02:30:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000754) opened an unlinked file! 2023-09-10T02:30:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000755) opened an unlinked file! 2023-09-10T02:30:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000756) opened an unlinked file! 2023-09-10T02:30:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000757) opened an unlinked file! 2023-09-10T02:30:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000758) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000759) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000760) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000761) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000762) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000763) opened an unlinked file! 2023-09-10T02:30:50.456 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000764) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000765) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000766) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000767) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000768) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000769) opened an unlinked file! 2023-09-10T02:30:50.457 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000770) opened an unlinked file! 2023-09-10T02:30:50.458 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000771) opened an unlinked file! 2023-09-10T02:30:50.458 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000772) opened an unlinked file! 2023-09-10T02:30:50.458 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000773) opened an unlinked file! 2023-09-10T02:30:50.458 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000774) opened an unlinked file! 2023-09-10T02:30:50.458 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000775) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000776) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000777) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000778) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000779) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000780) opened an unlinked file! 2023-09-10T02:30:50.459 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000781) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000782) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000783) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000784) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000785) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000786) opened an unlinked file! 2023-09-10T02:30:50.460 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000787) opened an unlinked file! 2023-09-10T02:30:50.461 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000788) opened an unlinked file! 2023-09-10T02:30:50.461 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000789) opened an unlinked file! 2023-09-10T02:30:50.461 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000790) opened an unlinked file! 2023-09-10T02:30:50.461 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000791) opened an unlinked file! 2023-09-10T02:30:50.461 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000792) opened an unlinked file! 2023-09-10T02:30:50.462 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000793) opened an unlinked file! 2023-09-10T02:30:50.462 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000794) opened an unlinked file! 2023-09-10T02:30:50.462 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000795) opened an unlinked file! 2023-09-10T02:30:50.462 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000796) opened an unlinked file! 2023-09-10T02:30:50.462 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000797) opened an unlinked file! 2023-09-10T02:30:50.463 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000798) opened an unlinked file! 2023-09-10T02:30:50.463 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000799) opened an unlinked file! 2023-09-10T02:30:50.463 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000800) opened an unlinked file! 2023-09-10T02:30:50.463 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000801) opened an unlinked file! 2023-09-10T02:30:50.463 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000802) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000803) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000804) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000805) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000806) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000807) opened an unlinked file! 2023-09-10T02:30:50.464 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000808) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000809) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000810) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000811) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000812) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000813) opened an unlinked file! 2023-09-10T02:30:50.465 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000814) opened an unlinked file! 2023-09-10T02:30:50.466 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000815) opened an unlinked file! 2023-09-10T02:30:50.466 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000816) opened an unlinked file! 2023-09-10T02:30:50.466 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000817) opened an unlinked file! 2023-09-10T02:30:50.466 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000818) opened an unlinked file! 2023-09-10T02:30:50.466 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000819) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000820) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000821) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000822) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000823) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000824) opened an unlinked file! 2023-09-10T02:30:50.467 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000825) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000826) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000827) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000828) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000829) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000830) opened an unlinked file! 2023-09-10T02:30:50.468 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000831) opened an unlinked file! 2023-09-10T02:30:50.469 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000832) opened an unlinked file! 2023-09-10T02:30:50.469 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000833) opened an unlinked file! 2023-09-10T02:30:50.469 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000834) opened an unlinked file! 2023-09-10T02:30:50.469 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000835) opened an unlinked file! 2023-09-10T02:30:50.469 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000836) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000837) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000838) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000839) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000840) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000841) opened an unlinked file! 2023-09-10T02:30:50.470 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000842) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000843) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000844) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000845) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000846) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000847) opened an unlinked file! 2023-09-10T02:30:50.471 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000848) opened an unlinked file! 2023-09-10T02:30:50.472 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000849) opened an unlinked file! 2023-09-10T02:30:50.472 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000850) opened an unlinked file! 2023-09-10T02:30:50.472 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000851) opened an unlinked file! 2023-09-10T02:30:50.472 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000852) opened an unlinked file! 2023-09-10T02:30:50.472 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000853) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000854) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000855) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000856) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000857) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000858) opened an unlinked file! 2023-09-10T02:30:50.473 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000859) opened an unlinked file! 2023-09-10T02:30:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000860) opened an unlinked file! 2023-09-10T02:30:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000861) opened an unlinked file! 2023-09-10T02:30:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000862) opened an unlinked file! 2023-09-10T02:30:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000863) opened an unlinked file! 2023-09-10T02:30:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000864) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000865) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000866) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000867) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000868) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000869) opened an unlinked file! 2023-09-10T02:30:50.475 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000870) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000871) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000872) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000873) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000874) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000875) opened an unlinked file! 2023-09-10T02:30:50.476 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000876) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000877) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000878) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000879) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000880) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000881) opened an unlinked file! 2023-09-10T02:30:50.477 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000882) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000883) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000884) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000885) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000886) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000887) opened an unlinked file! 2023-09-10T02:30:50.478 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000888) opened an unlinked file! 2023-09-10T02:30:50.479 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000889) opened an unlinked file! 2023-09-10T02:30:50.479 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000890) opened an unlinked file! 2023-09-10T02:30:50.479 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000891) opened an unlinked file! 2023-09-10T02:30:50.479 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000892) opened an unlinked file! 2023-09-10T02:30:50.479 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000893) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000894) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000895) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000896) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000897) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000898) opened an unlinked file! 2023-09-10T02:30:50.480 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000899) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000900) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000901) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000902) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000903) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000904) opened an unlinked file! 2023-09-10T02:30:50.481 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000905) opened an unlinked file! 2023-09-10T02:30:50.482 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000906) opened an unlinked file! 2023-09-10T02:30:50.482 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000907) opened an unlinked file! 2023-09-10T02:30:50.482 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000908) opened an unlinked file! 2023-09-10T02:30:50.482 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000909) opened an unlinked file! 2023-09-10T02:30:50.482 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000910) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000911) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000912) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000913) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000914) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000915) opened an unlinked file! 2023-09-10T02:30:50.483 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000916) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000917) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000918) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000919) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000920) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000921) opened an unlinked file! 2023-09-10T02:30:50.484 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000922) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000923) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000924) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000925) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000926) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000927) opened an unlinked file! 2023-09-10T02:30:50.485 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000928) opened an unlinked file! 2023-09-10T02:30:50.486 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000929) opened an unlinked file! 2023-09-10T02:30:50.486 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000930) opened an unlinked file! 2023-09-10T02:30:50.486 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000931) opened an unlinked file! 2023-09-10T02:30:50.486 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000932) opened an unlinked file! 2023-09-10T02:30:50.486 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000933) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000934) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000935) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000936) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000937) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000938) opened an unlinked file! 2023-09-10T02:30:50.487 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000939) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000940) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000941) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000942) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000943) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000944) opened an unlinked file! 2023-09-10T02:30:50.488 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000945) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000946) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000947) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000948) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000949) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000950) opened an unlinked file! 2023-09-10T02:30:50.489 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000951) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000952) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000953) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000954) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000955) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000956) opened an unlinked file! 2023-09-10T02:30:50.490 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000957) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000958) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000959) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000960) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000961) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000962) opened an unlinked file! 2023-09-10T02:30:50.491 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000963) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000964) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000965) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000966) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000967) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000968) opened an unlinked file! 2023-09-10T02:30:50.492 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000969) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000970) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000971) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000972) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000973) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000974) opened an unlinked file! 2023-09-10T02:30:50.493 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000975) opened an unlinked file! 2023-09-10T02:30:50.494 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000976) opened an unlinked file! 2023-09-10T02:30:50.494 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000977) opened an unlinked file! 2023-09-10T02:30:50.494 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000978) opened an unlinked file! 2023-09-10T02:30:50.494 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000979) opened an unlinked file! 2023-09-10T02:30:50.494 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000980) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000981) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000982) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000983) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000984) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000985) opened an unlinked file! 2023-09-10T02:30:50.495 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000986) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000987) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000988) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000989) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000990) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000991) opened an unlinked file! 2023-09-10T02:30:50.496 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000992) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000993) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000994) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000995) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000996) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000997) opened an unlinked file! 2023-09-10T02:30:50.497 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000998) opened an unlinked file! 2023-09-10T02:30:50.498 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file000999) opened an unlinked file! 2023-09-10T02:30:50.498 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001000) opened an unlinked file! 2023-09-10T02:30:50.498 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001001) opened an unlinked file! 2023-09-10T02:30:50.498 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001002) opened an unlinked file! 2023-09-10T02:30:50.498 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001003) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001004) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001005) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001006) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001007) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001008) opened an unlinked file! 2023-09-10T02:30:50.499 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001009) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001010) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001011) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001012) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001013) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001014) opened an unlinked file! 2023-09-10T02:30:50.500 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001015) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001016) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001017) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001018) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001019) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001020) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001021) opened an unlinked file! 2023-09-10T02:30:50.501 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001022) opened an unlinked file! 2023-09-10T02:30:50.502 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/426-dir/file001023) opened an unlinked file! 2023-09-10T02:30:50.502 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/426-dir 2023-09-10T02:30:50.502 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/426-dir -l 2023-09-10T02:30:50.502 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/426-dir -u 2023-09-10T02:30:50.503 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/426 2023-09-10T02:30:50.503 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/426 2023-09-10T02:30:50.503 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:30:50.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:50.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:30:50.569 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:30:50.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:30:50.570 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-09-10T02:30:52.054 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:52.061 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:52.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:52.365 INFO:teuthology.orchestra.run.smithi084.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:30:52.370 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/427 2023-09-10T02:30:52.370 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/427 2023-09-10T02:30:52.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:52.373 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:52.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:52.384 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-09-10T02:30:52.598 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:52.603 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:52.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:52.773 INFO:teuthology.orchestra.run.smithi084.stdout:generic/428 0s 2023-09-10T02:30:52.793 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/428 2023-09-10T02:30:52.794 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:52.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:52.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:52.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-09-10T02:30:53.035 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:53.040 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:53.040 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:53.212 INFO:teuthology.orchestra.run.smithi084.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:30:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/429 2023-09-10T02:30:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/429 2023-09-10T02:30:53.216 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:53.219 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:53.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:53.229 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-09-10T02:30:53.434 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:53.438 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:53.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:53.748 INFO:teuthology.orchestra.run.smithi084.stdout:generic/430 0s 2023-09-10T02:30:53.753 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/430 2023-09-10T02:30:53.753 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:53.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:53.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:53.764 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-09-10T02:30:54.282 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:54.286 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:54.286 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:54.505 INFO:teuthology.orchestra.run.smithi084.stdout:generic/431 0s 2023-09-10T02:30:54.525 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/431 2023-09-10T02:30:54.525 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:54.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:54.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:54.538 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-09-10T02:30:55.074 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:55.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:55.308 INFO:teuthology.orchestra.run.smithi084.stdout:generic/432 0s 2023-09-10T02:30:55.312 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/432 2023-09-10T02:30:55.313 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:55.315 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:55.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:55.324 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-09-10T02:30:55.830 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:55.834 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:55.834 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:56.036 INFO:teuthology.orchestra.run.smithi084.stdout:generic/433 1s 2023-09-10T02:30:56.040 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/433 2023-09-10T02:30:56.041 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:56.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:56.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:56.051 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-09-10T02:30:56.570 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:56.574 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:56.575 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:56.773 INFO:teuthology.orchestra.run.smithi084.stdout:generic/434 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/434.out.bad) 2023-09-10T02:30:56.775 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/434.out 2023-09-10 00:14:15.756892369 +0000 2023-09-10T02:30:56.775 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/434.out.bad 2023-09-10 02:30:56.772284384 +0000 2023-09-10T02:30:56.775 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -9,6 +9,6 @@ 2023-09-10T02:30:56.775 INFO:teuthology.orchestra.run.smithi084.stdout: copy_range: Bad file descriptor 2023-09-10T02:30:56.775 INFO:teuthology.orchestra.run.smithi084.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-09-10T02:30:56.776 INFO:teuthology.orchestra.run.smithi084.stdout: Try to copy to a device 2023-09-10T02:30:56.776 INFO:teuthology.orchestra.run.smithi084.stdout: -copy_range: Invalid argument 2023-09-10T02:30:56.776 INFO:teuthology.orchestra.run.smithi084.stdout: +/tmp/tmp.8YBtWphbTqtest/test-434/dev1: Permission denied 2023-09-10T02:30:56.776 INFO:teuthology.orchestra.run.smithi084.stdout: Try to copy to a fifo 2023-09-10T02:30:56.776 INFO:teuthology.orchestra.run.smithi084.stdout: copy_range: Invalid argument 2023-09-10T02:30:56.777 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/434 2023-09-10T02:30:56.777 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/434 2023-09-10T02:30:56.777 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:30:56.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:56.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:30:56.789 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:30:56.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:30:56.789 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-09-10T02:30:57.310 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:57.314 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:57.315 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:57.439 INFO:teuthology.orchestra.run.smithi084.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:30:57.443 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/435 2023-09-10T02:30:57.443 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/435 2023-09-10T02:30:57.443 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:57.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:57.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:57.454 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-09-10T02:30:57.618 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:57.622 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:57.622 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:58.872 INFO:teuthology.orchestra.run.smithi084.stdout:generic/436 1s 2023-09-10T02:30:58.878 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/436 2023-09-10T02:30:58.878 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:30:58.881 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:30:59.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:30:59.051 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-09-10T02:30:59.470 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:30:59.474 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:30:59.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:31:00.315 INFO:teuthology.orchestra.run.smithi084.stdout:generic/437 1s 2023-09-10T02:31:00.322 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/437 2023-09-10T02:31:00.322 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:31:00.325 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:31:00.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:31:00.336 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-09-10T02:31:00.563 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:31:00.568 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:31:00.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:31:08.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:31:08.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:31:39.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:31:39.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:32:09.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:32:09.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:32:27.157 INFO:teuthology.orchestra.run.smithi084.stdout:generic/438 87s 2023-09-10T02:32:27.163 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/438 2023-09-10T02:32:27.164 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:27.166 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:27.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:27.175 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-09-10T02:32:27.363 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:27.367 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:27.367 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:27.474 INFO:teuthology.orchestra.run.smithi084.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:27.477 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/439 2023-09-10T02:32:27.477 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/439 2023-09-10T02:32:27.478 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:27.480 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:27.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:27.488 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-09-10T02:32:27.683 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:27.687 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:27.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:27.821 INFO:teuthology.orchestra.run.smithi084.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:27.825 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/440 2023-09-10T02:32:27.825 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/440 2023-09-10T02:32:27.825 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:27.827 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:27.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:27.836 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-09-10T02:32:28.031 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:28.035 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:28.036 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.222 INFO:teuthology.orchestra.run.smithi084.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:28.226 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/441 2023-09-10T02:32:28.227 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/441 2023-09-10T02:32:28.227 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:28.231 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:28.241 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-09-10T02:32:28.427 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:28.432 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:28.432 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.557 INFO:teuthology.orchestra.run.smithi084.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:28.561 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/442 2023-09-10T02:32:28.561 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/442 2023-09-10T02:32:28.561 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:28.563 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:28.572 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-09-10T02:32:28.752 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:28.756 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:28.756 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.915 INFO:teuthology.orchestra.run.smithi084.stdout:generic/443 0s 2023-09-10T02:32:28.921 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/443 2023-09-10T02:32:28.921 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:28.924 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:28.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:28.933 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-09-10T02:32:29.117 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:29.120 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:29.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:29.274 INFO:teuthology.orchestra.run.smithi084.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T02:32:29.278 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/444 2023-09-10T02:32:29.278 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/444 2023-09-10T02:32:29.278 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:29.280 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:29.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:29.288 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-09-10T02:32:29.471 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:29.475 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:29.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:31.578 INFO:teuthology.orchestra.run.smithi084.stdout:generic/445 2s 2023-09-10T02:32:31.585 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/445 2023-09-10T02:32:31.585 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:31.589 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:31.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:31.602 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-09-10T02:32:32.176 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:32.180 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:32.180 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:32.282 INFO:teuthology.orchestra.run.smithi084.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:32.286 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/446 2023-09-10T02:32:32.286 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/446 2023-09-10T02:32:32.287 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:32.288 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:32.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:32.297 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-09-10T02:32:32.470 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:32.474 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:32.475 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:32.623 INFO:teuthology.orchestra.run.smithi084.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:32.629 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/447 2023-09-10T02:32:32.629 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/447 2023-09-10T02:32:32.629 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:32.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:32.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:32.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-09-10T02:32:32.824 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:32.829 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:32.829 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:34.767 INFO:teuthology.orchestra.run.smithi084.stdout:generic/448 2s 2023-09-10T02:32:34.773 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/448 2023-09-10T02:32:34.774 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:34.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:34.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:34.788 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-09-10T02:32:35.358 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:35.362 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:35.362 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:35.479 INFO:teuthology.orchestra.run.smithi084.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:35.483 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/449 2023-09-10T02:32:35.484 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/449 2023-09-10T02:32:35.484 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:35.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:35.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:35.497 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-09-10T02:32:35.712 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:35.717 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:35.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:36.861 INFO:teuthology.orchestra.run.smithi084.stdout:generic/450 1s 2023-09-10T02:32:36.868 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/450 2023-09-10T02:32:36.869 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:36.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:36.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:36.884 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-09-10T02:32:37.443 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:37.447 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:37.447 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:37.936 INFO:teuthology.orchestra.run.smithi084.stdout:generic/451 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/451.out.bad) 2023-09-10T02:32:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/451.out 2023-09-10 00:14:15.760892306 +0000 2023-09-10T02:32:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/451.out.bad 2023-09-10 02:32:37.934407559 +0000 2023-09-10T02:32:37.938 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,2 +1,5 @@ 2023-09-10T02:32:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 451 2023-09-10T02:32:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: +get stale data from buffer read 2023-09-10T02:32:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-09-10T02:32:37.939 INFO:teuthology.orchestra.run.smithi084.stdout: +000a0000 2023-09-10T02:32:37.940 INFO:teuthology.orchestra.run.smithi084.stdout: Silence is golden 2023-09-10T02:32:37.940 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/451 2023-09-10T02:32:37.940 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/451 2023-09-10T02:32:37.941 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:32:37.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:37.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:32:37.951 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:32:37.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:32:37.952 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-09-10T02:32:38.437 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:38.444 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:38.444 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:38.591 INFO:teuthology.orchestra.run.smithi084.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:38.595 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/452 2023-09-10T02:32:38.595 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/452 2023-09-10T02:32:38.595 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:38.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:38.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:38.606 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-09-10T02:32:38.800 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:38.804 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:38.804 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:38.903 INFO:teuthology.orchestra.run.smithi084.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/453 2023-09-10T02:32:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/453 2023-09-10T02:32:38.907 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:38.909 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:38.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:38.917 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-09-10T02:32:39.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:39.108 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:39.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.207 INFO:teuthology.orchestra.run.smithi084.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:39.211 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/454 2023-09-10T02:32:39.211 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/454 2023-09-10T02:32:39.211 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:39.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:39.222 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-09-10T02:32:39.416 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:39.420 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:39.421 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:32:39.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:32:39.621 INFO:teuthology.orchestra.run.smithi084.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:39.624 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/455 2023-09-10T02:32:39.624 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/455 2023-09-10T02:32:39.625 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:39.626 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:39.635 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-09-10T02:32:39.834 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:39.838 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:39.838 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.954 INFO:teuthology.orchestra.run.smithi084.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:39.957 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/456 2023-09-10T02:32:39.958 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/456 2023-09-10T02:32:39.958 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:39.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:39.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:39.969 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-09-10T02:32:40.168 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:40.173 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:40.174 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:40.371 INFO:teuthology.orchestra.run.smithi084.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:40.374 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/457 2023-09-10T02:32:40.375 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/457 2023-09-10T02:32:40.375 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:40.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:40.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:40.386 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-09-10T02:32:40.563 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:40.567 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:40.567 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:40.671 INFO:teuthology.orchestra.run.smithi084.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:40.674 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/458 2023-09-10T02:32:40.675 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/458 2023-09-10T02:32:40.675 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:40.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:40.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:40.685 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-09-10T02:32:40.862 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:40.868 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:40.868 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.174 INFO:teuthology.orchestra.run.smithi084.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:41.179 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/459 2023-09-10T02:32:41.179 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/459 2023-09-10T02:32:41.180 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:41.184 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:41.195 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-09-10T02:32:41.436 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:41.440 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:41.440 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.604 INFO:teuthology.orchestra.run.smithi084.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:41.608 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/460 2023-09-10T02:32:41.608 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/460 2023-09-10T02:32:41.608 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:41.610 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:41.619 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-09-10T02:32:41.811 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:41.816 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:41.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:41.927 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/461 2023-09-10T02:32:41.927 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/461 2023-09-10T02:32:41.927 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:41.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:41.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:41.938 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-09-10T02:32:42.125 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:42.129 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:42.129 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:42.234 INFO:teuthology.orchestra.run.smithi084.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:42.238 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/462 2023-09-10T02:32:42.238 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/462 2023-09-10T02:32:42.238 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:42.240 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:42.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:42.249 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-09-10T02:32:42.419 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:42.423 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:42.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:42.909 INFO:teuthology.orchestra.run.smithi084.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T02:32:42.912 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/463 2023-09-10T02:32:42.913 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/463 2023-09-10T02:32:42.913 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:42.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:42.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:42.924 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-09-10T02:32:43.447 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:43.451 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:43.451 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:43.551 INFO:teuthology.orchestra.run.smithi084.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:32:43.554 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/464 2023-09-10T02:32:43.555 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/464 2023-09-10T02:32:43.555 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:32:43.557 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:32:43.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:32:43.565 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-09-10T02:32:43.771 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:32:43.776 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:32:43.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:09.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:33:09.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:33:10.162 INFO:teuthology.orchestra.run.smithi084.stdout:generic/465 27s 2023-09-10T02:33:10.313 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/465 2023-09-10T02:33:10.314 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:10.397 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:10.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:10.419 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-09-10T02:33:10.625 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:10.629 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:10.630 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:10.747 INFO:teuthology.orchestra.run.smithi084.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:10.752 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/466 2023-09-10T02:33:10.752 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/466 2023-09-10T02:33:10.752 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:10.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:10.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:10.764 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-09-10T02:33:10.990 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:10.994 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:21.695 INFO:teuthology.orchestra.run.smithi084.stdout:generic/467 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/467.out.bad) 2023-09-10T02:33:21.700 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/467.out 2023-09-10 00:14:15.760892306 +0000 2023-09-10T02:33:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/467.out.bad 2023-09-10 02:33:21.673604228 +0000 2023-09-10T02:33:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,5 +1,15 @@ 2023-09-10T02:33:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 467 2023-09-10T02:33:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-09-10T02:33:21.701 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000000) opened an unlinked file! 2023-09-10T02:33:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000001) opened an unlinked file! 2023-09-10T02:33:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000002) opened an unlinked file! 2023-09-10T02:33:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000003) opened an unlinked file! 2023-09-10T02:33:21.702 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000004) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000005) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000006) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000007) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000008) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: +open_by_handle(/tmp/tmp.8YBtWphbTqtest/467-dir/file000009) opened an unlinked file! 2023-09-10T02:33:21.703 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-09-10T02:33:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-09-10T02:33:21.704 INFO:teuthology.orchestra.run.smithi084.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-09-10T02:33:21.725 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/467 2023-09-10T02:33:21.726 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/467 2023-09-10T02:33:21.726 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:33:21.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:21.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:33:21.869 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:33:21.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:33:21.869 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-09-10T02:33:23.386 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:23.392 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:23.392 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:23.663 INFO:teuthology.orchestra.run.smithi084.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/468 2023-09-10T02:33:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/468 2023-09-10T02:33:23.669 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:23.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:23.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:23.683 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-09-10T02:33:23.908 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:23.913 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:23.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:26.107 INFO:teuthology.orchestra.run.smithi084.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-10T02:33:26.111 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/469 2023-09-10T02:33:26.112 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/469 2023-09-10T02:33:26.112 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:26.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:26.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:26.125 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-09-10T02:33:26.988 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:26.993 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:26.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.180 INFO:teuthology.orchestra.run.smithi084.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:27.183 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/470 2023-09-10T02:33:27.184 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/470 2023-09-10T02:33:27.184 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:27.186 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:27.196 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-09-10T02:33:27.383 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:27.387 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:27.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.491 INFO:teuthology.orchestra.run.smithi084.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:27.495 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/472 2023-09-10T02:33:27.495 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/472 2023-09-10T02:33:27.495 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:27.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:27.506 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-09-10T02:33:27.697 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:27.701 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:27.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.867 INFO:teuthology.orchestra.run.smithi084.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-09-10T02:33:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/473 2023-09-10T02:33:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/473 2023-09-10T02:33:27.871 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:27.873 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:27.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:27.882 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-09-10T02:33:28.065 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:28.067 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:28.067 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.183 INFO:teuthology.orchestra.run.smithi084.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:28.187 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/474 2023-09-10T02:33:28.187 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/474 2023-09-10T02:33:28.187 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:28.189 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:28.198 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-09-10T02:33:28.382 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:28.387 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:28.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.525 INFO:teuthology.orchestra.run.smithi084.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:28.528 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/475 2023-09-10T02:33:28.528 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/475 2023-09-10T02:33:28.529 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:28.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:28.539 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-09-10T02:33:28.723 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:28.727 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:28.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.831 INFO:teuthology.orchestra.run.smithi084.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:28.834 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/476 2023-09-10T02:33:28.834 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/476 2023-09-10T02:33:28.835 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:28.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:28.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:28.845 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-09-10T02:33:29.035 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:29.039 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:29.039 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:37.847 INFO:teuthology.orchestra.run.smithi084.stdout:generic/477 8s 2023-09-10T02:33:38.005 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/477 2023-09-10T02:33:38.022 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:38.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:38.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:38.074 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-09-10T02:33:39.539 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:39.545 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:39.545 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:39.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:33:39.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:33:50.200 INFO:teuthology.orchestra.run.smithi084.stdout:generic/478 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/478.out.bad) 2023-09-10T02:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/478.out 2023-09-10 00:14:15.760892306 +0000 2023-09-10T02:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/478.out.bad 2023-09-10 02:33:50.193082922 +0000 2023-09-10T02:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -10,7 +10,7 @@ 2023-09-10T02:33:50.203 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: get wrlck 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: -lock could be placed 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: +get wrlck 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.204 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -18,14 +18,14 @@ 2023-09-10T02:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: get wrlck 2023-09-10T02:33:50.205 INFO:teuthology.orchestra.run.smithi084.stdout: get wrlck 2023-09-10T02:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: -lock could be placed 2023-09-10T02:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: +get wrlck 2023-09-10T02:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: get wrlck 2023-09-10T02:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.206 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: get wrlck 2023-09-10T02:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: -lock could be placed 2023-09-10T02:33:50.207 INFO:teuthology.orchestra.run.smithi084.stdout: +get wrlck 2023-09-10T02:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -37,7 +37,7 @@ 2023-09-10T02:33:50.208 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: -lock could be placed 2023-09-10T02:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: +get rdlck 2023-09-10T02:33:50.209 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -46,7 +46,7 @@ 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: get rdlck 2023-09-10T02:33:50.210 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: -lock could be placed 2023-09-10T02:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: +get rdlck 2023-09-10T02:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.211 INFO:teuthology.orchestra.run.smithi084.stdout: lock could be placed 2023-09-10T02:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/478 2023-09-10T02:33:50.212 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/478 2023-09-10T02:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:33:50.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:50.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:33:50.221 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:33:50.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:33:50.222 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-09-10T02:33:50.469 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:50.474 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:50.474 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:50.726 INFO:teuthology.orchestra.run.smithi084.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:50.732 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/479 2023-09-10T02:33:50.732 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/479 2023-09-10T02:33:50.732 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:50.737 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:50.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:50.749 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-09-10T02:33:50.985 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:50.990 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:50.990 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:51.136 INFO:teuthology.orchestra.run.smithi084.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:51.141 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/480 2023-09-10T02:33:51.142 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/480 2023-09-10T02:33:51.142 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:51.144 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:51.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:51.156 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-09-10T02:33:51.376 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:51.381 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:51.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:51.580 INFO:teuthology.orchestra.run.smithi084.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:51.584 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/481 2023-09-10T02:33:51.584 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/481 2023-09-10T02:33:51.585 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:51.587 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:51.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:51.598 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-09-10T02:33:51.819 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:51.824 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:51.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.071 INFO:teuthology.orchestra.run.smithi084.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:52.075 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/482 2023-09-10T02:33:52.075 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/482 2023-09-10T02:33:52.075 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:52.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:52.087 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-09-10T02:33:52.271 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:52.275 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:52.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.398 INFO:teuthology.orchestra.run.smithi084.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:52.401 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/483 2023-09-10T02:33:52.401 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/483 2023-09-10T02:33:52.402 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:52.404 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:52.412 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-09-10T02:33:52.587 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:52.591 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:52.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.721 INFO:teuthology.orchestra.run.smithi084.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:52.726 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/484 2023-09-10T02:33:52.727 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/484 2023-09-10T02:33:52.727 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:52.729 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:52.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:52.738 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-09-10T02:33:52.928 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:52.932 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:52.933 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:53.956 INFO:teuthology.orchestra.run.smithi084.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-10T02:33:53.962 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/485 2023-09-10T02:33:53.962 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/485 2023-09-10T02:33:53.963 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:53.966 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:53.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:53.978 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-09-10T02:33:54.548 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:54.552 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:54.552 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:54.722 INFO:teuthology.orchestra.run.smithi084.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:54.726 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/486 2023-09-10T02:33:54.726 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/486 2023-09-10T02:33:54.726 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:54.728 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:54.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:54.737 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-09-10T02:33:54.919 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:54.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.038 INFO:teuthology.orchestra.run.smithi084.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:55.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/487 2023-09-10T02:33:55.042 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/487 2023-09-10T02:33:55.042 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:55.044 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:55.052 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-09-10T02:33:55.239 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:55.243 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:55.243 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.342 INFO:teuthology.orchestra.run.smithi084.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:55.345 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/488 2023-09-10T02:33:55.346 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/488 2023-09-10T02:33:55.346 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:55.348 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:55.356 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-09-10T02:33:55.543 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:55.547 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:55.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.662 INFO:teuthology.orchestra.run.smithi084.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:55.666 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/489 2023-09-10T02:33:55.666 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/489 2023-09-10T02:33:55.666 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:55.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:55.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:55.677 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-09-10T02:33:55.858 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:55.863 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:55.863 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:57.812 INFO:teuthology.orchestra.run.smithi084.stdout:generic/490 2s 2023-09-10T02:33:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/490 2023-09-10T02:33:57.819 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:57.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:57.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:57.834 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-09-10T02:33:58.426 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:58.430 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:58.430 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:58.572 INFO:teuthology.orchestra.run.smithi084.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:58.576 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/491 2023-09-10T02:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/491 2023-09-10T02:33:58.577 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:58.579 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:58.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:58.589 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-09-10T02:33:58.816 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:58.821 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:58.821 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:58.945 INFO:teuthology.orchestra.run.smithi084.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:58.949 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/492 2023-09-10T02:33:58.949 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/492 2023-09-10T02:33:58.950 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:58.952 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:58.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:58.962 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-09-10T02:33:59.162 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:59.167 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:59.167 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.279 INFO:teuthology.orchestra.run.smithi084.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:59.283 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/493 2023-09-10T02:33:59.283 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/493 2023-09-10T02:33:59.283 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:59.285 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:59.294 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-09-10T02:33:59.487 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:59.491 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:59.491 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.595 INFO:teuthology.orchestra.run.smithi084.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:59.599 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/494 2023-09-10T02:33:59.599 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/494 2023-09-10T02:33:59.599 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:59.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:59.609 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-09-10T02:33:59.780 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:33:59.784 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:33:59.784 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.889 INFO:teuthology.orchestra.run.smithi084.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:33:59.892 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/495 2023-09-10T02:33:59.892 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/495 2023-09-10T02:33:59.893 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:33:59.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:33:59.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:33:59.903 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-09-10T02:34:00.087 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:00.091 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:00.091 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.203 INFO:teuthology.orchestra.run.smithi084.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/496 2023-09-10T02:34:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/496 2023-09-10T02:34:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:00.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:00.218 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-09-10T02:34:00.411 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:00.415 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:00.415 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.519 INFO:teuthology.orchestra.run.smithi084.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:00.523 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/497 2023-09-10T02:34:00.523 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/497 2023-09-10T02:34:00.523 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:00.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:00.534 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-09-10T02:34:00.714 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:00.719 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:00.719 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.869 INFO:teuthology.orchestra.run.smithi084.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:00.873 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/498 2023-09-10T02:34:00.873 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/498 2023-09-10T02:34:00.873 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:00.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:00.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:00.885 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-09-10T02:34:01.078 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:01.082 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:01.082 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.181 INFO:teuthology.orchestra.run.smithi084.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:01.185 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/499 2023-09-10T02:34:01.185 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/499 2023-09-10T02:34:01.185 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:01.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:01.197 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-09-10T02:34:01.383 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:01.387 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:01.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.545 INFO:teuthology.orchestra.run.smithi084.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:01.548 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/500 2023-09-10T02:34:01.548 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/500 2023-09-10T02:34:01.548 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:01.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:01.559 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-09-10T02:34:01.738 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:01.742 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:01.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.866 INFO:teuthology.orchestra.run.smithi084.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:01.869 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/501 2023-09-10T02:34:01.869 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/501 2023-09-10T02:34:01.869 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:01.872 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:01.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:01.880 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-09-10T02:34:02.083 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:02.087 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:02.087 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.209 INFO:teuthology.orchestra.run.smithi084.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:02.213 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/502 2023-09-10T02:34:02.213 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/502 2023-09-10T02:34:02.213 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:02.215 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:02.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-09-10T02:34:02.420 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:02.424 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:02.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.529 INFO:teuthology.orchestra.run.smithi084.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:02.533 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/503 2023-09-10T02:34:02.533 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/503 2023-09-10T02:34:02.533 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:02.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:02.544 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-09-10T02:34:02.727 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:02.732 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:02.732 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.924 INFO:teuthology.orchestra.run.smithi084.stdout:generic/504 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/504.out.bad) 2023-09-10T02:34:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/504.out 2023-09-10 00:14:15.764892243 +0000 2023-09-10T02:34:02.926 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/504.out.bad 2023-09-10 02:34:02.916850963 +0000 2023-09-10T02:34:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,2 +1,3 @@ 2023-09-10T02:34:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 504 2023-09-10T02:34:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: +lock info not found 2023-09-10T02:34:02.927 INFO:teuthology.orchestra.run.smithi084.stdout: Silence is golden 2023-09-10T02:34:02.928 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/504 2023-09-10T02:34:02.928 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/504 2023-09-10T02:34:02.929 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T02:34:02.931 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:02.938 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T02:34:02.939 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T02:34:02.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T02:34:02.940 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-09-10T02:34:03.123 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:03.127 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:03.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:03.227 INFO:teuthology.orchestra.run.smithi084.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:03.231 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/505 2023-09-10T02:34:03.231 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/505 2023-09-10T02:34:03.231 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:03.233 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:03.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:03.242 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-09-10T02:34:03.443 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:03.448 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:03.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:03.551 INFO:teuthology.orchestra.run.smithi084.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:03.585 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/506 2023-09-10T02:34:03.585 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/506 2023-09-10T02:34:03.585 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:03.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:03.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:03.586 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-09-10T02:34:03.758 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:03.763 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:03.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.015 INFO:teuthology.orchestra.run.smithi084.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-09-10T02:34:04.020 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/507 2023-09-10T02:34:04.020 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/507 2023-09-10T02:34:04.021 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:04.024 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:04.034 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-09-10T02:34:04.223 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.331 INFO:teuthology.orchestra.run.smithi084.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-09-10T02:34:04.334 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/508 2023-09-10T02:34:04.334 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/508 2023-09-10T02:34:04.334 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:04.345 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-09-10T02:34:04.527 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:04.531 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.653 INFO:teuthology.orchestra.run.smithi084.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:04.657 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/509 2023-09-10T02:34:04.657 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/509 2023-09-10T02:34:04.657 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:04.668 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-09-10T02:34:04.866 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:04.871 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:04.994 INFO:teuthology.orchestra.run.smithi084.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/510 2023-09-10T02:34:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/510 2023-09-10T02:34:04.998 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:05.009 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-09-10T02:34:05.205 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:05.209 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.311 INFO:teuthology.orchestra.run.smithi084.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:05.314 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/511 2023-09-10T02:34:05.314 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/511 2023-09-10T02:34:05.315 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:05.325 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-09-10T02:34:05.501 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:05.503 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.617 INFO:teuthology.orchestra.run.smithi084.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/512 2023-09-10T02:34:05.621 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/512 2023-09-10T02:34:05.622 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:05.632 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-09-10T02:34:05.811 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:05.816 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:05.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.920 INFO:teuthology.orchestra.run.smithi084.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:05.923 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/513 2023-09-10T02:34:05.924 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/513 2023-09-10T02:34:05.924 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:05.926 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:05.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:05.935 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-09-10T02:34:06.123 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:06.127 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:06.128 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.232 INFO:teuthology.orchestra.run.smithi084.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:06.236 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/514 2023-09-10T02:34:06.236 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/514 2023-09-10T02:34:06.236 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:06.239 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:06.247 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-09-10T02:34:06.419 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:06.423 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:06.424 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.527 INFO:teuthology.orchestra.run.smithi084.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:06.530 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/515 2023-09-10T02:34:06.531 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/515 2023-09-10T02:34:06.531 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:06.533 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:06.541 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-09-10T02:34:06.724 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:06.728 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:06.729 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.885 INFO:teuthology.orchestra.run.smithi084.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-09-10T02:34:06.889 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/516 2023-09-10T02:34:06.889 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/516 2023-09-10T02:34:06.890 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:06.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:06.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:06.900 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-09-10T02:34:07.455 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:07.459 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:07.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:07.563 INFO:teuthology.orchestra.run.smithi084.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:07.567 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/517 2023-09-10T02:34:07.567 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/517 2023-09-10T02:34:07.567 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:07.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:07.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:07.578 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-09-10T02:34:07.754 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:07.758 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:07.759 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:07.873 INFO:teuthology.orchestra.run.smithi084.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/518 2023-09-10T02:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/518 2023-09-10T02:34:07.877 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:07.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:07.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:07.888 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-09-10T02:34:08.086 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:08.091 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:08.091 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:08.437 INFO:teuthology.orchestra.run.smithi084.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:08.442 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/519 2023-09-10T02:34:08.442 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/519 2023-09-10T02:34:08.443 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:08.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:08.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:08.456 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-09-10T02:34:08.651 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:08.655 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:08.655 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:08.770 INFO:teuthology.orchestra.run.smithi084.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T02:34:08.774 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/520 2023-09-10T02:34:08.775 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/520 2023-09-10T02:34:08.775 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T02:34:08.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:08.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T02:34:08.786 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-09-10T02:34:08.971 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T02:34:08.975 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T02:34:08.976 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T02:34:09.741 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:34:09.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:34:39.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:34:39.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:35:10.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:35:10.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:35:40.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:35:40.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:36:10.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:36:10.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:36:40.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:36:40.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:37:10.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:37:10.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:37:40.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:37:40.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:38:10.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:38:10.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:38:40.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:38:40.818 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:39:10.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:39:10.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:39:41.090 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:39:41.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:40:11.229 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:40:11.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:40:41.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:40:41.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:41:11.412 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:41:11.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:41:41.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:41:41.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:42:11.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:42:11.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:42:41.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:42:41.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:43:11.967 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:43:11.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:43:11.989 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T02:43:11.987+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 365659) UID: 0 2023-09-10T02:43:11.990 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T02:43:11.987+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 365659) UID: 0 2023-09-10T02:45:47.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:45:47.220 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:46:17.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:46:17.378 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:46:47.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:46:47.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:47:17.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:47:17.620 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:47:47.721 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:47:47.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:48:17.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:48:17.829 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:48:47.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:48:47.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:49:18.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:49:18.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:49:18.205 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T02:49:18.207+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45907) UID: 0 2023-09-10T02:49:18.205 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T02:49:18.207+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45907) UID: 0 2023-09-10T02:49:18.205 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T02:49:18.207+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45907) UID: 0 2023-09-10T02:49:18.206 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T02:49:18.207+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45907) UID: 0 2023-09-10T02:52:14.935 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:52:14.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:52:45.181 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:52:45.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:53:15.231 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:53:15.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:53:45.285 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:53:45.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:54:15.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:54:15.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:54:45.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:54:45.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:55:15.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:55:15.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:55:45.745 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:55:45.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:56:15.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:56:15.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:56:45.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:56:45.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:57:16.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:57:16.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:57:46.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:57:46.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:58:16.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:58:16.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:58:46.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:58:46.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:59:16.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:59:16.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:59:46.419 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T02:59:46.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:00:16.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:00:16.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:00:46.654 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:00:46.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:01:16.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:01:16.778 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:01:46.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:01:46.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:02:17.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:02:17.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:02:47.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:02:47.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:03:17.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:03:17.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:03:47.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:03:47.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:04:17.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:04:17.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:04:48.112 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:04:48.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:05:18.175 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:05:18.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:05:48.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:05:48.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:06:18.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:06:18.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:06:48.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:06:48.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:07:18.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:07:18.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:07:48.765 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:07:48.769 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:08:18.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:08:18.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:08:49.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:08:49.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:09:19.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:09:19.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:09:49.207 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:09:49.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:10:19.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:10:19.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:10:49.421 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:10:49.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:11:19.468 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:11:19.471 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:11:49.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:11:49.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:12:19.936 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:12:19.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:12:50.017 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:12:50.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:13:20.071 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:13:20.075 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:13:50.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:13:50.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:14:20.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:14:20.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:14:50.575 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:14:50.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:15:20.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:15:20.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:15:50.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:15:50.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:16:20.871 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:16:20.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:16:51.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:16:51.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:17:21.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:17:21.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:17:51.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:17:51.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:18:21.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:18:21.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:18:52.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:18:52.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:19:22.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:19:22.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:19:52.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:19:52.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:20:22.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:20:22.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:20:52.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:20:52.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:21:22.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:21:22.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:21:52.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:21:52.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:22:23.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:22:23.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:22:53.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:22:53.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:23:23.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:23:23.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:23:53.240 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:23:53.244 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:24:23.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:24:23.365 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:24:53.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:24:53.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:25:23.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:25:23.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:25:53.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:25:53.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:26:23.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:26:23.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:26:54.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:26:54.084 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:27:24.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:27:24.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:27:54.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:27:54.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:28:24.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:28:24.471 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:28:54.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:28:54.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:29:24.835 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:29:24.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:29:54.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:29:54.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:30:25.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:30:25.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:30:55.147 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:30:55.151 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:31:25.201 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:31:25.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:31:55.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:31:55.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:32:25.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:32:25.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:32:55.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:32:55.493 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:33:25.543 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:33:25.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:33:55.665 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:33:55.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:33:55.701 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T03:33:55.698+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46189) UID: 0 2023-09-10T03:33:55.701 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T03:33:55.698+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46189) UID: 0 2023-09-10T03:33:55.702 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T03:33:55.698+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46189) UID: 0 2023-09-10T03:33:55.702 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T03:33:55.698+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46189) UID: 0 2023-09-10T03:36:43.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:36:43.227 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:37:13.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:37:13.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:37:43.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:37:43.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:38:13.961 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:38:13.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:38:44.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:38:44.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:39:14.069 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:39:14.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:39:44.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:39:44.125 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:40:14.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:40:14.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:40:44.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:40:44.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:41:14.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:41:14.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:41:44.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:41:44.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:42:14.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:42:14.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:42:44.846 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:42:44.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:43:14.943 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:43:14.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:43:45.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:43:45.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:43:45.062 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T03:43:45.058+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46246) UID: 0 2023-09-10T03:43:45.063 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T03:43:45.058+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46246) UID: 0 2023-09-10T03:43:45.063 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T03:43:45.058+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46246) UID: 0 2023-09-10T03:43:45.064 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T03:43:45.058+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46246) UID: 0 2023-09-10T03:46:39.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:46:39.758 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:47:09.849 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:47:09.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:47:39.962 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:47:39.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:48:10.027 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:48:10.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:48:40.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:48:40.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:49:10.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:49:10.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:49:40.355 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:49:40.358 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:50:10.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:50:10.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:50:40.663 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:50:40.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:51:10.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:51:10.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:51:40.863 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:51:40.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:52:10.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:52:10.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:52:41.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:52:41.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:53:11.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:53:11.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:53:41.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:53:41.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:54:11.659 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:54:11.663 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:54:41.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:54:41.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:55:11.852 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:55:11.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:55:41.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:55:41.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:56:12.014 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:56:12.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:56:42.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:56:42.132 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:57:12.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:57:12.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:57:42.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:57:42.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:58:12.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:58:12.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:58:42.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:58:42.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:59:12.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:59:12.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:59:42.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T03:59:42.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:00:13.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:00:13.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:00:43.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:00:43.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:01:13.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:01:13.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:01:43.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:01:43.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:02:13.655 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:02:13.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:02:43.714 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:02:43.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:03:13.843 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:03:13.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:03:43.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:03:43.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:04:14.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:04:14.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:04:44.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:04:44.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:05:14.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:05:14.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:05:44.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:05:44.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:06:14.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:06:14.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:06:44.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:06:44.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:07:14.643 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:07:14.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:07:44.724 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:07:44.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:08:15.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:08:15.114 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:08:45.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:08:45.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:09:15.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:09:15.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:09:45.449 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:09:45.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:10:15.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:10:15.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:10:45.816 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:10:45.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:11:15.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:11:15.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:11:45.992 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:11:45.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:12:16.080 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:12:16.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:12:46.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:12:46.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:13:16.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:13:16.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:13:46.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:13:46.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:14:16.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:14:16.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:14:46.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:14:46.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:15:16.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:15:16.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:15:46.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:15:46.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:16:17.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:16:17.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:16:47.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:16:47.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:17:17.236 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:17:17.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:17:47.350 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:17:47.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:18:17.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:18:17.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:18:47.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:18:47.517 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:19:17.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:19:17.629 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:19:47.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:19:47.818 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:20:18.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:20:18.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:20:48.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:20:48.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:21:18.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:21:18.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:21:48.501 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:21:48.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:22:18.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:22:18.558 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:22:48.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:22:48.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:23:18.736 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:23:18.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:23:49.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:23:49.137 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:24:19.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:24:19.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:24:49.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:24:49.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:24:58.083 INFO:teuthology.orchestra.run.smithi084.stdout:generic/521 6650s 2023-09-10T04:24:58.091 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/521 2023-09-10T04:24:58.091 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T04:24:58.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T04:24:58.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T04:24:58.116 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-09-10T04:24:58.684 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T04:24:58.688 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T04:24:58.688 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T04:25:19.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:25:19.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:25:49.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:25:49.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:26:19.590 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:26:19.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:26:49.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:26:49.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:27:19.821 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:27:19.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:27:49.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:27:49.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:28:20.115 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:28:20.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:28:50.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:28:50.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:29:20.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:29:20.252 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:29:50.321 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:29:50.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:30:20.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:30:20.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:30:50.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:30:50.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:31:20.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:31:20.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:31:50.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:31:50.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:32:21.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:32:21.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:32:51.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:32:51.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:33:21.327 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:33:21.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:33:51.398 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:33:51.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:34:21.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:34:21.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:34:51.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:34:51.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:35:21.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:35:21.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:35:51.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:35:51.761 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:36:21.895 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:36:21.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:36:52.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:36:52.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:37:22.195 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:37:22.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:37:52.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:37:52.328 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:38:22.705 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:38:22.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:38:52.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:38:52.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:39:22.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:39:22.967 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:39:53.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:39:53.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:40:23.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:40:23.151 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:40:53.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:40:53.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:41:23.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:41:23.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:41:53.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:41:53.481 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:42:23.615 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:42:23.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:42:53.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:42:53.750 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:43:23.966 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:43:23.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:43:54.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:43:54.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:44:24.091 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:44:24.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:44:54.181 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:44:54.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:45:24.277 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:45:24.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:45:54.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:45:54.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:46:24.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:46:24.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:46:54.688 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:46:54.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:47:24.792 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:47:24.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:47:54.888 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:47:54.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:48:24.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:48:24.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:48:55.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:48:55.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:49:25.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:49:25.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:49:55.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:49:55.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:50:25.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:50:25.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:50:55.471 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:50:55.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:51:25.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:51:25.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:51:55.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:51:55.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:52:25.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:52:25.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:52:56.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:52:56.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:53:26.431 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:53:26.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:53:56.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:53:56.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:54:26.680 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:54:26.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:54:56.725 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:54:56.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:54:56.753 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T04:54:56.755+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366940) UID: 0 2023-09-10T04:54:56.754 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T04:54:56.755+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366940) UID: 0 2023-09-10T04:54:56.754 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T04:54:56.755+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366940) UID: 0 2023-09-10T04:54:56.755 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T04:54:56.755+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 366940) UID: 0 2023-09-10T04:58:03.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:58:03.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:58:33.973 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:58:33.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:59:04.135 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:59:04.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:59:34.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T04:59:34.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:00:04.343 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:00:04.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:00:34.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:00:34.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:01:04.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:01:04.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:01:34.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:01:34.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:02:05.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:02:05.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:02:35.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:02:35.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:03:05.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:03:05.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:03:35.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:03:35.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:04:05.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:04:05.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:04:35.562 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:04:35.565 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:05:05.735 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:05:05.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:05:35.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:05:35.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:06:05.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:06:05.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:06:36.078 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:06:36.081 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:07:06.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:07:06.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:07:36.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:07:36.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:07:36.301 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T05:07:36.297+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 367012) UID: 0 2023-09-10T05:07:36.302 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T05:07:36.297+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 367012) UID: 0 2023-09-10T05:10:21.748 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:10:21.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:10:51.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:10:51.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:11:22.160 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:11:22.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:11:52.275 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:11:52.279 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:12:22.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:12:22.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:12:52.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:12:52.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:13:22.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:13:22.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:13:22.695 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T05:13:22.695+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367039) UID: 0 2023-09-10T05:13:22.696 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T05:13:22.695+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367039) UID: 0 2023-09-10T05:13:22.696 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T05:13:22.695+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367039) UID: 0 2023-09-10T05:13:22.697 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T05:13:22.695+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367039) UID: 0 2023-09-10T05:16:12.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:16:12.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:16:42.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:16:42.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:17:12.557 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:17:12.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:17:42.646 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:17:42.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:18:12.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:18:12.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:18:42.856 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:18:42.858 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:19:12.968 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:19:12.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:19:43.273 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:19:43.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:20:13.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:20:13.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:20:13.470 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T05:20:13.468+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46862) UID: 0 2023-09-10T05:20:13.471 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T05:20:13.468+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46862) UID: 0 2023-09-10T05:20:13.471 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T05:20:13.468+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46862) UID: 0 2023-09-10T05:20:13.472 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T05:20:13.468+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46862) UID: 0 2023-09-10T05:22:54.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:22:54.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:23:24.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:23:24.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:23:54.171 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:23:54.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:24:24.227 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:24:24.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:24:54.382 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:24:54.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:25:24.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:25:24.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:25:54.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:25:54.561 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:26:24.623 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:26:24.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:26:54.683 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:26:54.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:27:24.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:27:24.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:27:55.173 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:27:55.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:28:25.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:28:25.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:28:55.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:28:55.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:29:25.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:29:25.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:29:55.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:29:55.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:30:25.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:30:25.876 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:30:55.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:30:55.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:31:26.006 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:31:26.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:31:56.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:31:56.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:32:26.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:32:26.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:32:56.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:32:56.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:33:26.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:33:26.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:33:56.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:33:56.491 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:33:56.509 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T05:33:56.505+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367156) UID: 0 2023-09-10T05:33:56.510 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T05:33:56.505+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367156) UID: 0 2023-09-10T05:33:56.510 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T05:33:56.505+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367156) UID: 0 2023-09-10T05:33:56.511 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T05:33:56.505+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 367156) UID: 0 2023-09-10T05:37:03.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:37:03.911 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:37:34.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:37:34.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:37:36.982 INFO:teuthology.orchestra.run.smithi084.stdout:generic/522 4358s 2023-09-10T05:37:37.048 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/522 2023-09-10T05:37:37.048 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:37.053 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:37.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:37.086 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-09-10T05:37:37.773 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:37.779 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:37.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:37.985 INFO:teuthology.orchestra.run.smithi084.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:37.990 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/523 2023-09-10T05:37:37.990 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/523 2023-09-10T05:37:37.990 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:37.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:38.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:38.004 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-09-10T05:37:38.237 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:38.242 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:38.243 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:38.364 INFO:teuthology.orchestra.run.smithi084.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:38.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/524 2023-09-10T05:37:38.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/524 2023-09-10T05:37:38.369 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:38.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:38.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:38.382 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-09-10T05:37:38.630 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:38.635 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:38.635 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:38.768 INFO:teuthology.orchestra.run.smithi084.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:38.772 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/525 2023-09-10T05:37:38.772 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/525 2023-09-10T05:37:38.772 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:38.775 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:38.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:38.784 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-09-10T05:37:39.011 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:39.016 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:39.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.184 INFO:teuthology.orchestra.run.smithi084.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:39.187 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/526 2023-09-10T05:37:39.187 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/526 2023-09-10T05:37:39.188 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:39.190 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:39.198 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-09-10T05:37:39.386 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:39.390 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:39.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.511 INFO:teuthology.orchestra.run.smithi084.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:39.515 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/527 2023-09-10T05:37:39.516 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/527 2023-09-10T05:37:39.516 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:39.518 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:39.526 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-09-10T05:37:39.718 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:39.722 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:39.723 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.859 INFO:teuthology.orchestra.run.smithi084.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-09-10T05:37:39.863 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/528 2023-09-10T05:37:39.863 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/528 2023-09-10T05:37:39.864 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:39.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:39.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:39.874 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-09-10T05:37:40.073 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:40.078 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:40.078 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.220 INFO:teuthology.orchestra.run.smithi084.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T05:37:40.224 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/529 2023-09-10T05:37:40.224 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/529 2023-09-10T05:37:40.224 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:40.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:40.235 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-09-10T05:37:40.408 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:40.412 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:40.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.512 INFO:teuthology.orchestra.run.smithi084.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:40.514 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/530 2023-09-10T05:37:40.514 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/530 2023-09-10T05:37:40.515 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:40.516 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:40.525 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-09-10T05:37:40.696 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:40.700 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:40.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.800 INFO:teuthology.orchestra.run.smithi084.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:40.804 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/531 2023-09-10T05:37:40.804 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/531 2023-09-10T05:37:40.804 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:40.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:40.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:40.816 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-09-10T05:37:41.012 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:41.016 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:41.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:41.179 INFO:teuthology.orchestra.run.smithi084.stdout:generic/532 0s 2023-09-10T05:37:41.184 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/532 2023-09-10T05:37:41.185 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:41.187 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:41.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:41.195 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-09-10T05:37:41.379 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:41.383 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:41.383 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:41.769 INFO:teuthology.orchestra.run.smithi084.stdout:generic/533 0s 2023-09-10T05:37:41.775 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/533 2023-09-10T05:37:41.775 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:41.777 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:41.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:41.785 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-09-10T05:37:41.977 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:41.981 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:41.981 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.143 INFO:teuthology.orchestra.run.smithi084.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:42.146 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/534 2023-09-10T05:37:42.147 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/534 2023-09-10T05:37:42.147 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:42.149 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:42.157 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-09-10T05:37:42.336 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:42.340 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:42.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.455 INFO:teuthology.orchestra.run.smithi084.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:42.458 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/535 2023-09-10T05:37:42.459 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/535 2023-09-10T05:37:42.459 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:42.461 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:42.470 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-09-10T05:37:42.649 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:42.654 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:42.654 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.756 INFO:teuthology.orchestra.run.smithi084.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:42.760 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/536 2023-09-10T05:37:42.760 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/536 2023-09-10T05:37:42.760 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:42.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:42.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:42.771 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-09-10T05:37:42.944 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:42.948 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:42.948 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:43.048 INFO:teuthology.orchestra.run.smithi084.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T05:37:43.052 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/537 2023-09-10T05:37:43.052 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/537 2023-09-10T05:37:43.052 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T05:37:43.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:37:43.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T05:37:43.063 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-09-10T05:37:43.237 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T05:37:43.241 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T05:37:43.241 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T05:38:04.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:38:04.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:38:34.200 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:38:34.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:39:04.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:39:04.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:39:34.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:39:34.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:40:04.451 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:40:04.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:40:34.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:40:34.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:41:04.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:41:04.784 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:41:34.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:41:34.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:42:04.931 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:42:04.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:42:35.253 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:42:35.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:43:05.341 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:43:05.344 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:43:35.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:43:35.467 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:43:35.488 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T05:43:35.484+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2023-09-10T05:43:35.488 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T05:43:35.484+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2023-09-10T05:43:35.488 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T05:43:35.484+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2023-09-10T05:43:35.489 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T05:43:35.484+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47002) UID: 0 2023-09-10T05:46:19.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:46:19.131 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:46:49.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:46:49.255 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:47:19.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:47:19.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:47:49.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:47:49.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:48:19.467 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:48:19.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:48:49.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:48:49.700 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:49:20.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:49:20.120 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:49:50.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:49:50.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:50:20.302 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:50:20.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:50:50.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:50:50.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:51:20.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:51:20.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:51:50.756 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:51:50.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:52:20.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:52:20.906 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:52:50.958 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:52:50.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:53:21.113 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:53:21.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:53:51.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:53:51.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:54:21.297 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:54:21.300 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:54:51.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:54:51.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:55:21.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:55:21.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:55:51.577 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:55:51.580 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:56:21.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:56:21.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:56:21.743 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T05:56:21.737+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375270) UID: 0 2023-09-10T05:56:21.744 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T05:56:21.737+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375270) UID: 0 2023-09-10T05:56:21.744 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T05:56:21.737+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375270) UID: 0 2023-09-10T05:56:21.745 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T05:56:21.737+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 375270) UID: 0 2023-09-10T05:59:25.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:59:25.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:59:55.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T05:59:55.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:00:25.800 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:00:25.803 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:00:55.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:00:55.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:01:25.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:01:25.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:01:55.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:01:55.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:02:26.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:02:26.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:02:56.141 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:02:56.144 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:03:26.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:03:26.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:03:56.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:03:56.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:04:26.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:04:26.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:04:56.469 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:04:56.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:05:26.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:05:26.552 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:05:56.603 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:05:56.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:06:26.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:06:26.696 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:06:56.789 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:06:56.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:07:26.853 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:07:26.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:07:56.946 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:07:56.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:08:27.059 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:08:27.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:08:57.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:08:57.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:09:27.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:09:27.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:09:57.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:09:57.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:10:27.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:10:27.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:10:58.024 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:10:58.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:11:28.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:11:28.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:11:58.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:11:58.254 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:12:28.346 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:12:28.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:12:58.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:12:58.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:13:28.527 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:13:28.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:13:58.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:13:58.660 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:14:28.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:14:28.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:14:58.801 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:14:58.805 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:15:28.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:15:28.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:15:59.046 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:15:59.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:16:29.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:16:29.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:16:59.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:16:59.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:17:29.502 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:17:29.505 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:17:59.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:17:59.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:18:29.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:18:29.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:18:59.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:18:59.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:19:29.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:19:29.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:19:59.915 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:19:59.918 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:20:29.988 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:20:29.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:21:00.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:21:00.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:21:30.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:21:30.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:22:00.393 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:22:00.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:22:30.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:22:30.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:23:00.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:23:00.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:23:30.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:23:30.628 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:24:00.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:24:00.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:24:30.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:24:30.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:25:00.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:25:00.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:25:30.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:25:31.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:26:01.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:26:01.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:26:31.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:26:31.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:27:01.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:27:01.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:27:31.564 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:27:31.567 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:28:01.610 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:28:01.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:28:31.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:28:31.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:29:01.709 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:29:01.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:29:31.811 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:29:31.814 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:30:01.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:30:01.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:30:31.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:30:31.992 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:31:02.144 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:31:02.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:31:32.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:31:32.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:32:02.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:32:02.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:32:32.538 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:32:32.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:33:02.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:33:02.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:33:32.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:33:32.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:34:02.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:34:02.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:34:33.013 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:34:33.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:35:03.070 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:35:03.073 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:35:33.417 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:35:33.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:36:03.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:36:03.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:36:33.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:36:33.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:37:03.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:37:03.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:37:33.703 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:37:33.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:38:03.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:38:03.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:38:33.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:38:33.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:39:04.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:39:04.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:39:34.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:39:34.518 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:40:04.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:40:04.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:40:34.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:40:34.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:41:04.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:41:04.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:41:34.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:41:34.852 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:42:04.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:42:04.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:42:34.994 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:42:34.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:43:05.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:43:05.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:43:35.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:43:35.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:44:05.304 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:44:05.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:44:35.384 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:44:35.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:45:05.553 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:45:05.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:45:35.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:45:35.612 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:46:05.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:46:05.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:46:35.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:46:35.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:47:06.023 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:47:06.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:47:36.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:47:36.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:48:06.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:48:06.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:48:36.916 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:48:36.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:49:06.969 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:49:06.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:49:37.116 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:49:37.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:50:07.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:50:07.465 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:50:37.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:50:37.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:51:07.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:51:07.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:51:37.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:51:37.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:52:07.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:52:07.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:52:38.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:52:38.164 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:53:08.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:53:08.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:53:38.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:53:38.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:54:08.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:54:08.509 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:54:38.586 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:54:38.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:55:08.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:55:08.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:55:38.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:55:38.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:56:08.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:56:08.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:56:39.095 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:56:39.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:57:09.215 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:57:09.218 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:57:39.270 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:57:39.274 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:58:09.364 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:58:09.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:58:39.773 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:58:39.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:59:09.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:59:09.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:59:40.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T06:59:40.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:00:10.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:00:10.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:00:40.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:00:40.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:01:10.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:01:10.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:01:40.583 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:01:40.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:02:10.697 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:02:10.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:02:40.749 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:02:40.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:03:10.837 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:03:10.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:03:40.966 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:03:40.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:04:11.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:04:11.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:04:41.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:04:41.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:05:11.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:05:11.382 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:05:41.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:05:41.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:06:11.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:06:11.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:06:41.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:06:41.696 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:07:11.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:07:11.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:07:41.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:07:41.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:08:12.120 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:08:12.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:08:22.016 INFO:teuthology.orchestra.run.smithi084.stdout:generic/538 5438s 2023-09-10T07:08:22.024 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/538 2023-09-10T07:08:22.025 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:22.028 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:22.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:22.118 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-09-10T07:08:22.589 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:22.594 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:22.594 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:25.944 INFO:teuthology.orchestra.run.smithi084.stdout:generic/539 3s 2023-09-10T07:08:25.952 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/539 2023-09-10T07:08:25.952 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:25.955 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:25.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:25.967 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-09-10T07:08:26.550 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:26.554 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:26.555 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:26.704 INFO:teuthology.orchestra.run.smithi084.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:26.708 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/540 2023-09-10T07:08:26.708 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/540 2023-09-10T07:08:26.709 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:26.711 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:26.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:26.721 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-09-10T07:08:26.925 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:26.929 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:26.929 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.036 INFO:teuthology.orchestra.run.smithi084.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:27.039 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/541 2023-09-10T07:08:27.040 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/541 2023-09-10T07:08:27.040 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:27.042 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:27.051 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-09-10T07:08:27.239 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:27.244 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:27.244 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.350 INFO:teuthology.orchestra.run.smithi084.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:27.354 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/542 2023-09-10T07:08:27.354 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/542 2023-09-10T07:08:27.354 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:27.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:27.365 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-09-10T07:08:27.539 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:27.543 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:27.544 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.644 INFO:teuthology.orchestra.run.smithi084.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:27.649 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/543 2023-09-10T07:08:27.649 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/543 2023-09-10T07:08:27.649 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:27.651 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:27.660 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-09-10T07:08:27.840 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:27.845 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:27.845 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.949 INFO:teuthology.orchestra.run.smithi084.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:27.952 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/544 2023-09-10T07:08:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/544 2023-09-10T07:08:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:27.955 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:27.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:27.963 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-09-10T07:08:28.137 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:28.141 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:28.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:28.327 INFO:teuthology.orchestra.run.smithi084.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-09-10T07:08:28.331 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/545 2023-09-10T07:08:28.331 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/545 2023-09-10T07:08:28.331 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:28.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:28.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:28.343 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-09-10T07:08:28.532 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:28.536 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:28.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:28.695 INFO:teuthology.orchestra.run.smithi084.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:28.698 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/546 2023-09-10T07:08:28.698 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/546 2023-09-10T07:08:28.699 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:28.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:28.709 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-09-10T07:08:28.900 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:28.904 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:28.905 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.023 INFO:teuthology.orchestra.run.smithi084.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:29.026 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/547 2023-09-10T07:08:29.027 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/547 2023-09-10T07:08:29.027 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:29.029 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:29.037 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-09-10T07:08:29.225 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:29.230 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:29.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.382 INFO:teuthology.orchestra.run.smithi084.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:29.386 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/548 2023-09-10T07:08:29.386 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/548 2023-09-10T07:08:29.386 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:29.389 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:29.398 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-09-10T07:08:29.592 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:29.596 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:29.596 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.724 INFO:teuthology.orchestra.run.smithi084.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:29.727 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/549 2023-09-10T07:08:29.728 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/549 2023-09-10T07:08:29.728 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:29.730 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:29.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:29.738 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-09-10T07:08:29.899 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:29.903 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:29.904 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.031 INFO:teuthology.orchestra.run.smithi084.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:30.035 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/550 2023-09-10T07:08:30.035 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/550 2023-09-10T07:08:30.036 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:30.038 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:30.047 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-09-10T07:08:30.236 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:30.240 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:30.241 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.344 INFO:teuthology.orchestra.run.smithi084.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:30.347 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/551 2023-09-10T07:08:30.348 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/551 2023-09-10T07:08:30.348 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:30.350 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:30.358 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-09-10T07:08:30.552 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:30.556 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:30.556 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.671 INFO:teuthology.orchestra.run.smithi084.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:30.674 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/552 2023-09-10T07:08:30.675 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/552 2023-09-10T07:08:30.675 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:30.677 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:30.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:30.686 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-09-10T07:08:30.872 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:30.876 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:30.876 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:31.045 INFO:teuthology.orchestra.run.smithi084.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-09-10T07:08:31.049 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/553 2023-09-10T07:08:31.049 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/553 2023-09-10T07:08:31.049 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:31.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:31.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:31.060 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-09-10T07:08:31.557 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:31.561 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:31.561 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:31.668 INFO:teuthology.orchestra.run.smithi084.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:31.671 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/554 2023-09-10T07:08:31.671 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/554 2023-09-10T07:08:31.672 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:31.673 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:31.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:31.682 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-09-10T07:08:31.857 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:31.862 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:31.862 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.007 INFO:teuthology.orchestra.run.smithi084.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-09-10T07:08:32.011 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/555 2023-09-10T07:08:32.011 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/555 2023-09-10T07:08:32.011 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:32.013 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:32.022 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-09-10T07:08:32.521 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:32.525 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:32.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.631 INFO:teuthology.orchestra.run.smithi084.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:32.634 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/556 2023-09-10T07:08:32.635 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/556 2023-09-10T07:08:32.635 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:32.637 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:32.645 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-09-10T07:08:32.817 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:32.821 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:32.821 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.943 INFO:teuthology.orchestra.run.smithi084.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:32.946 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/557 2023-09-10T07:08:32.947 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/557 2023-09-10T07:08:32.947 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:32.949 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:32.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:32.957 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-09-10T07:08:33.152 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:33.156 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:33.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.262 INFO:teuthology.orchestra.run.smithi084.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:33.266 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/558 2023-09-10T07:08:33.266 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/558 2023-09-10T07:08:33.266 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:33.268 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:33.277 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-09-10T07:08:33.460 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:33.464 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:33.464 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.565 INFO:teuthology.orchestra.run.smithi084.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:33.569 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/559 2023-09-10T07:08:33.569 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/559 2023-09-10T07:08:33.569 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:33.571 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:33.579 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-09-10T07:08:33.767 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:33.771 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:33.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.874 INFO:teuthology.orchestra.run.smithi084.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:33.877 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/560 2023-09-10T07:08:33.877 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/560 2023-09-10T07:08:33.878 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:33.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:33.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:33.888 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-09-10T07:08:34.076 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:34.080 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:34.081 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.198 INFO:teuthology.orchestra.run.smithi084.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:34.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/561 2023-09-10T07:08:34.202 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/561 2023-09-10T07:08:34.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:34.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:34.213 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-09-10T07:08:34.404 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:34.408 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:34.408 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.534 INFO:teuthology.orchestra.run.smithi084.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:34.538 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/562 2023-09-10T07:08:34.538 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/562 2023-09-10T07:08:34.538 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:34.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:34.548 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-09-10T07:08:34.728 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:34.732 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:34.732 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.872 INFO:teuthology.orchestra.run.smithi084.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:34.876 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/563 2023-09-10T07:08:34.876 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/563 2023-09-10T07:08:34.876 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:34.880 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:34.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:34.886 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-09-10T07:08:35.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:35.108 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:35.108 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:35.819 INFO:teuthology.orchestra.run.smithi084.stdout:generic/564 0s 2023-09-10T07:08:35.825 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/564 2023-09-10T07:08:35.825 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:35.828 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:35.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:35.839 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-09-10T07:08:36.364 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:36.368 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:36.368 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:36.471 INFO:teuthology.orchestra.run.smithi084.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:36.474 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/565 2023-09-10T07:08:36.475 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/565 2023-09-10T07:08:36.475 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:36.477 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:36.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:36.486 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-09-10T07:08:36.674 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:36.678 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:36.678 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:36.790 INFO:teuthology.orchestra.run.smithi084.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:36.793 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/566 2023-09-10T07:08:36.794 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/566 2023-09-10T07:08:36.794 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:36.796 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:36.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:36.804 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-09-10T07:08:36.987 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:36.991 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:36.992 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:37.092 INFO:teuthology.orchestra.run.smithi084.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:37.096 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/567 2023-09-10T07:08:37.096 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/567 2023-09-10T07:08:37.096 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:37.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:37.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:37.106 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-09-10T07:08:37.301 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:37.305 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:37.306 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:37.503 INFO:teuthology.orchestra.run.smithi084.stdout:generic/568 0s 2023-09-10T07:08:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/568 2023-09-10T07:08:37.508 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:37.510 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:37.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:37.679 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-09-10T07:08:38.052 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:38.056 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:38.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:38.286 INFO:teuthology.orchestra.run.smithi084.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:38.291 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/569 2023-09-10T07:08:38.291 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/569 2023-09-10T07:08:38.291 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:38.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:38.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:38.306 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-09-10T07:08:38.521 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:38.525 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:38.628 INFO:teuthology.orchestra.run.smithi084.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:38.632 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/570 2023-09-10T07:08:38.632 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/570 2023-09-10T07:08:38.632 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:38.634 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:38.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:38.642 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-09-10T07:08:38.832 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:38.836 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:38.836 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:42.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:08:42.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:08:45.095 INFO:teuthology.orchestra.run.smithi084.stdout:generic/571 7s 2023-09-10T07:08:45.102 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/571 2023-09-10T07:08:45.102 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:45.105 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:45.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:45.116 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-09-10T07:08:45.629 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:45.633 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:45.633 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:45.755 INFO:teuthology.orchestra.run.smithi084.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:45.759 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/572 2023-09-10T07:08:45.759 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/572 2023-09-10T07:08:45.760 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:45.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:45.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:45.770 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-09-10T07:08:45.952 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:45.957 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:45.957 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.114 INFO:teuthology.orchestra.run.smithi084.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:46.118 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/573 2023-09-10T07:08:46.118 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/573 2023-09-10T07:08:46.119 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:46.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:46.130 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-09-10T07:08:46.316 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:46.320 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:46.320 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.426 INFO:teuthology.orchestra.run.smithi084.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:46.430 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/574 2023-09-10T07:08:46.430 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/574 2023-09-10T07:08:46.430 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:46.432 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:46.441 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-09-10T07:08:46.620 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:46.624 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:46.624 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.724 INFO:teuthology.orchestra.run.smithi084.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:46.727 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/575 2023-09-10T07:08:46.728 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/575 2023-09-10T07:08:46.728 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:46.730 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:46.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:46.738 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-09-10T07:08:46.913 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:46.917 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:46.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.043 INFO:teuthology.orchestra.run.smithi084.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:47.046 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/576 2023-09-10T07:08:47.046 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/576 2023-09-10T07:08:47.047 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:47.049 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:47.058 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-09-10T07:08:47.260 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:47.264 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:47.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.365 INFO:teuthology.orchestra.run.smithi084.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:47.367 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/577 2023-09-10T07:08:47.367 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/577 2023-09-10T07:08:47.368 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:47.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:47.378 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-09-10T07:08:47.580 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:47.583 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:47.584 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.743 INFO:teuthology.orchestra.run.smithi084.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T07:08:47.746 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/578 2023-09-10T07:08:47.746 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/578 2023-09-10T07:08:47.747 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:47.749 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:47.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:47.757 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-09-10T07:08:48.298 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:48.303 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:48.303 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:48.417 INFO:teuthology.orchestra.run.smithi084.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:48.421 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/579 2023-09-10T07:08:48.422 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/579 2023-09-10T07:08:48.422 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:48.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:48.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:48.433 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-09-10T07:08:48.616 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:48.620 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:48.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:48.764 INFO:teuthology.orchestra.run.smithi084.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:48.767 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/580 2023-09-10T07:08:48.767 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/580 2023-09-10T07:08:48.767 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:48.769 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:48.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:48.777 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-09-10T07:08:48.979 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:48.983 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:48.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:49.896 INFO:teuthology.orchestra.run.smithi084.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:49.903 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/581 2023-09-10T07:08:49.903 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/581 2023-09-10T07:08:49.903 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:49.907 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:49.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:49.920 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-09-10T07:08:50.151 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:50.155 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:50.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:50.306 INFO:teuthology.orchestra.run.smithi084.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:50.310 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/582 2023-09-10T07:08:50.311 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/582 2023-09-10T07:08:50.311 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:50.313 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:50.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:50.323 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-09-10T07:08:50.545 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:50.549 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:50.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:50.707 INFO:teuthology.orchestra.run.smithi084.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:50.712 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/583 2023-09-10T07:08:50.712 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/583 2023-09-10T07:08:50.712 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:50.717 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:50.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:50.725 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-09-10T07:08:50.938 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:50.943 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:50.943 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:51.134 INFO:teuthology.orchestra.run.smithi084.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:51.138 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/584 2023-09-10T07:08:51.138 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/584 2023-09-10T07:08:51.138 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:51.141 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:51.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:51.150 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-09-10T07:08:51.342 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:51.346 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:51.346 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:51.463 INFO:teuthology.orchestra.run.smithi084.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:08:51.467 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/585 2023-09-10T07:08:51.467 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/585 2023-09-10T07:08:51.467 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:08:51.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:08:51.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:08:51.478 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-09-10T07:08:51.668 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:08:51.672 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:08:51.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:12.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:09:12.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:09:36.248 INFO:teuthology.orchestra.run.smithi084.stdout:generic/586 45s 2023-09-10T07:09:36.256 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/586 2023-09-10T07:09:36.256 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:36.261 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:36.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:36.272 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-09-10T07:09:36.832 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:36.837 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:36.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:37.232 INFO:teuthology.orchestra.run.smithi084.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T07:09:37.238 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/587 2023-09-10T07:09:37.238 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/587 2023-09-10T07:09:37.238 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:37.242 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:37.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:37.254 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-09-10T07:09:37.481 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:37.486 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:37.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:37.648 INFO:teuthology.orchestra.run.smithi084.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:37.653 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/588 2023-09-10T07:09:37.653 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/588 2023-09-10T07:09:37.653 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:37.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:37.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:37.667 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-09-10T07:09:37.883 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:37.888 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:37.888 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:38.016 INFO:teuthology.orchestra.run.smithi084.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:38.020 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/589 2023-09-10T07:09:38.020 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/589 2023-09-10T07:09:38.020 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:38.023 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:38.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:38.032 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-09-10T07:09:38.242 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:38.247 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:38.248 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:38.374 INFO:teuthology.orchestra.run.smithi084.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:38.378 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/590 2023-09-10T07:09:38.378 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/590 2023-09-10T07:09:38.378 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:38.380 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:38.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:38.390 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-09-10T07:09:38.597 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:38.601 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:38.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:38.999 INFO:teuthology.orchestra.run.smithi084.stdout:generic/591 0s 2023-09-10T07:09:39.016 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/591 2023-09-10T07:09:39.016 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:39.019 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:39.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:39.068 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-09-10T07:09:39.564 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:39.568 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:39.569 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:39.705 INFO:teuthology.orchestra.run.smithi084.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:39.709 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/592 2023-09-10T07:09:39.709 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/592 2023-09-10T07:09:39.709 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:39.712 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:39.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:39.720 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-09-10T07:09:39.904 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:39.908 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:39.908 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.055 INFO:teuthology.orchestra.run.smithi084.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:40.058 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/593 2023-09-10T07:09:40.059 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/593 2023-09-10T07:09:40.059 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:40.061 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:40.070 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-09-10T07:09:40.248 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:40.252 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:40.253 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.368 INFO:teuthology.orchestra.run.smithi084.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:40.372 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/594 2023-09-10T07:09:40.372 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/594 2023-09-10T07:09:40.373 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:40.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:40.383 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-09-10T07:09:40.595 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:40.599 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:40.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.730 INFO:teuthology.orchestra.run.smithi084.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:40.734 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/595 2023-09-10T07:09:40.734 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/595 2023-09-10T07:09:40.734 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:40.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:40.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:40.745 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-09-10T07:09:40.924 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:40.928 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:40.928 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:41.031 INFO:teuthology.orchestra.run.smithi084.stdout:generic/596 [not run] accton utility required, skipped this test 2023-09-10T07:09:41.035 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/596 2023-09-10T07:09:41.035 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/596 2023-09-10T07:09:41.035 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:41.037 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:41.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:41.046 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-09-10T07:09:41.239 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:41.245 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:41.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:42.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:09:42.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:09:42.911 INFO:teuthology.orchestra.run.smithi084.stdout:generic/597 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/597.out.bad) 2023-09-10T07:09:42.915 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/597.out 2023-09-10 00:14:15.768892178 +0000 2023-09-10T07:09:42.916 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/597.out.bad 2023-09-10 07:09:42.824469605 +0000 2023-09-10T07:09:42.916 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -4,11 +4,11 @@ 2023-09-10T07:09:42.916 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_symlinks = 0 2023-09-10T07:09:42.916 INFO:teuthology.orchestra.run.smithi084.stdout: successfully followed symlink 2023-09-10T07:09:42.916 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_symlinks = 1 2023-09-10T07:09:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: +successfully followed symlink 2023-09-10T07:09:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: == Test hardlink create protection when 2023-09-10T07:09:42.917 INFO:teuthology.orchestra.run.smithi084.stdout: == process != target owner and process cannot read target 2023-09-10T07:09:42.918 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_hardlinks = 0 2023-09-10T07:09:42.918 INFO:teuthology.orchestra.run.smithi084.stdout: -successfully created hardlink 2023-09-10T07:09:42.918 INFO:teuthology.orchestra.run.smithi084.stdout: +Permission denied 2023-09-10T07:09:42.918 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_hardlinks = 1 2023-09-10T07:09:42.918 INFO:teuthology.orchestra.run.smithi084.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-09-10T07:09:42.919 INFO:teuthology.orchestra.run.smithi084.stdout: +Permission denied 2023-09-10T07:09:42.919 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/597 2023-09-10T07:09:42.920 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/597 2023-09-10T07:09:42.920 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T07:09:42.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:42.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T07:09:42.937 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T07:09:42.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T07:09:42.938 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-09-10T07:09:43.492 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:43.496 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:43.496 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:44.048 INFO:teuthology.orchestra.run.smithi084.stdout:generic/598 - output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/598.out.bad) 2023-09-10T07:09:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/598.out 2023-09-10 00:14:15.768892178 +0000 2023-09-10T07:09:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/598.out.bad 2023-09-10 07:09:44.044448121 +0000 2023-09-10T07:09:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -5,13 +5,10 @@ 2023-09-10T07:09:44.050 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_regular = 1 2023-09-10T07:09:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: = group & world writable dir 2023-09-10T07:09:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_regular = 2 2023-09-10T07:09:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: = group & world writable dir 2023-09-10T07:09:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.052 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-09-10T07:09:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_fifos = 0 2023-09-10T07:09:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -19,10 +16,7 @@ 2023-09-10T07:09:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.053 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_fifos = 1 2023-09-10T07:09:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: = group & world writable dir 2023-09-10T07:09:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: fs.protected_fifos = 2 2023-09-10T07:09:44.054 INFO:teuthology.orchestra.run.smithi084.stdout: = group & world writable dir 2023-09-10T07:09:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: = only group writable dir 2023-09-10T07:09:44.055 INFO:teuthology.orchestra.run.smithi084.stdout: -Permission denied 2023-09-10T07:09:44.056 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/598 2023-09-10T07:09:44.056 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/598 2023-09-10T07:09:44.056 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T07:09:44.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:44.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T07:09:44.064 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T07:09:44.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T07:09:44.065 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-09-10T07:09:44.588 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:44.592 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:44.592 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:44.716 INFO:teuthology.orchestra.run.smithi084.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:44.720 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/599 2023-09-10T07:09:44.720 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/599 2023-09-10T07:09:44.720 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:44.722 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:44.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:44.731 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-09-10T07:09:44.908 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:44.912 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:44.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.016 INFO:teuthology.orchestra.run.smithi084.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:45.020 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/600 2023-09-10T07:09:45.020 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/600 2023-09-10T07:09:45.020 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:45.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:45.031 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-09-10T07:09:45.201 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:45.205 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:45.205 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.305 INFO:teuthology.orchestra.run.smithi084.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:45.309 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/601 2023-09-10T07:09:45.309 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/601 2023-09-10T07:09:45.309 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:45.311 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:45.320 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-09-10T07:09:45.526 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:45.531 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:45.531 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.721 INFO:teuthology.orchestra.run.smithi084.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:45.724 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/602 2023-09-10T07:09:45.724 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/602 2023-09-10T07:09:45.725 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:45.727 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:45.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:45.735 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-09-10T07:09:45.917 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:45.921 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:45.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.037 INFO:teuthology.orchestra.run.smithi084.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/603 2023-09-10T07:09:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/603 2023-09-10T07:09:46.041 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:46.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:46.051 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-09-10T07:09:46.233 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:46.237 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:46.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.339 INFO:teuthology.orchestra.run.smithi084.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:46.343 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/604 2023-09-10T07:09:46.343 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/604 2023-09-10T07:09:46.343 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:46.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:46.354 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-09-10T07:09:46.544 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:46.548 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:46.548 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.658 INFO:teuthology.orchestra.run.smithi084.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:46.662 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/605 2023-09-10T07:09:46.662 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/605 2023-09-10T07:09:46.662 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:46.664 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:46.673 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-09-10T07:09:46.851 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:46.856 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:46.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.956 INFO:teuthology.orchestra.run.smithi084.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:46.960 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/606 2023-09-10T07:09:46.960 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/606 2023-09-10T07:09:46.960 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:46.962 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:46.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:46.971 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-09-10T07:09:47.160 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:47.165 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:47.165 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:47.271 INFO:teuthology.orchestra.run.smithi084.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:47.275 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/607 2023-09-10T07:09:47.275 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/607 2023-09-10T07:09:47.275 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:47.278 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:47.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:47.288 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-09-10T07:09:47.472 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:47.476 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:47.476 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:47.631 INFO:teuthology.orchestra.run.smithi084.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:47.634 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/608 2023-09-10T07:09:47.634 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/608 2023-09-10T07:09:47.635 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:47.637 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:47.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:47.645 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-09-10T07:09:47.829 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:47.833 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:47.834 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:48.433 INFO:teuthology.orchestra.run.smithi084.stdout:generic/609 1s 2023-09-10T07:09:48.441 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/609 2023-09-10T07:09:48.441 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:48.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:48.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:48.457 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-09-10T07:09:48.989 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:48.994 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:48.994 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.097 INFO:teuthology.orchestra.run.smithi084.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:49.101 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/610 2023-09-10T07:09:49.101 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/610 2023-09-10T07:09:49.101 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:49.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:49.112 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-09-10T07:09:49.285 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:49.289 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:49.289 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.439 INFO:teuthology.orchestra.run.smithi084.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:49.443 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/611 2023-09-10T07:09:49.443 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/611 2023-09-10T07:09:49.443 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:49.445 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:49.454 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-09-10T07:09:49.644 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:49.649 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:49.649 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.800 INFO:teuthology.orchestra.run.smithi084.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T07:09:49.804 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/612 2023-09-10T07:09:49.804 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/612 2023-09-10T07:09:49.804 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:49.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:49.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:49.815 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-09-10T07:09:50.374 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:50.378 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:50.378 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:50.506 INFO:teuthology.orchestra.run.smithi084.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:50.510 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/613 2023-09-10T07:09:50.510 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/613 2023-09-10T07:09:50.510 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:50.512 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:50.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:50.521 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-09-10T07:09:50.709 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:50.713 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:50.714 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:50.816 INFO:teuthology.orchestra.run.smithi084.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:50.819 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/614 2023-09-10T07:09:50.820 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/614 2023-09-10T07:09:50.820 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:50.822 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:50.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:50.830 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-09-10T07:09:51.008 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:51.012 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:51.012 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.115 INFO:teuthology.orchestra.run.smithi084.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:51.118 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/615 2023-09-10T07:09:51.119 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/615 2023-09-10T07:09:51.119 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:51.121 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:51.129 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-09-10T07:09:51.307 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:51.312 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:51.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.437 INFO:teuthology.orchestra.run.smithi084.stdout:generic/616 [not run] kernel does not support IO_URING 2023-09-10T07:09:51.441 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/616 2023-09-10T07:09:51.441 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/616 2023-09-10T07:09:51.441 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:51.443 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:51.452 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-09-10T07:09:51.632 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:51.636 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:51.636 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.789 INFO:teuthology.orchestra.run.smithi084.stdout:generic/617 [not run] kernel does not support IO_URING 2023-09-10T07:09:51.792 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/617 2023-09-10T07:09:51.792 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/617 2023-09-10T07:09:51.793 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:51.795 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:51.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:51.803 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-09-10T07:09:51.985 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:51.987 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:51.988 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.092 INFO:teuthology.orchestra.run.smithi084.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:52.096 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/618 2023-09-10T07:09:52.096 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/618 2023-09-10T07:09:52.097 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:52.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:52.107 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-09-10T07:09:52.280 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:52.284 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:52.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.384 INFO:teuthology.orchestra.run.smithi084.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:52.387 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/619 2023-09-10T07:09:52.388 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/619 2023-09-10T07:09:52.388 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:52.390 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:52.398 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-09-10T07:09:52.589 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:52.593 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:52.593 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.736 INFO:teuthology.orchestra.run.smithi084.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:52.740 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/620 2023-09-10T07:09:52.740 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/620 2023-09-10T07:09:52.740 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:52.742 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:52.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:52.750 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-09-10T07:09:52.936 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:52.940 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:52.940 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.071 INFO:teuthology.orchestra.run.smithi084.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:53.074 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/621 2023-09-10T07:09:53.075 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/621 2023-09-10T07:09:53.075 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:53.077 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:53.085 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-09-10T07:09:53.265 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:53.269 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:53.269 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.420 INFO:teuthology.orchestra.run.smithi084.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:53.424 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/622 2023-09-10T07:09:53.424 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/622 2023-09-10T07:09:53.425 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:53.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:53.436 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-09-10T07:09:53.633 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:53.638 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:53.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.744 INFO:teuthology.orchestra.run.smithi084.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:53.747 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/623 2023-09-10T07:09:53.748 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/623 2023-09-10T07:09:53.748 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:53.750 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:53.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:53.758 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-09-10T07:09:53.972 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:53.976 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:53.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.124 INFO:teuthology.orchestra.run.smithi084.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/624 2023-09-10T07:09:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/624 2023-09-10T07:09:54.128 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:54.130 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:54.138 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-09-10T07:09:54.328 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:54.332 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:54.332 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.436 INFO:teuthology.orchestra.run.smithi084.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:54.440 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/625 2023-09-10T07:09:54.440 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/625 2023-09-10T07:09:54.440 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:54.442 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:54.450 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-09-10T07:09:54.633 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:54.637 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:54.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.755 INFO:teuthology.orchestra.run.smithi084.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:54.759 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/626 2023-09-10T07:09:54.759 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/626 2023-09-10T07:09:54.760 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:54.762 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:54.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:54.770 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-09-10T07:09:54.940 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:54.944 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:54.944 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.052 INFO:teuthology.orchestra.run.smithi084.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:55.056 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/627 2023-09-10T07:09:55.056 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/627 2023-09-10T07:09:55.056 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:55.058 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:55.066 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-09-10T07:09:55.245 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:55.249 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:55.249 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.366 INFO:teuthology.orchestra.run.smithi084.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:55.370 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/628 2023-09-10T07:09:55.370 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/628 2023-09-10T07:09:55.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:55.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:55.381 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-09-10T07:09:55.567 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:55.571 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:55.572 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.691 INFO:teuthology.orchestra.run.smithi084.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:55.694 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/629 2023-09-10T07:09:55.695 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/629 2023-09-10T07:09:55.695 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:55.697 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:55.706 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-09-10T07:09:55.889 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:55.893 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:55.894 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:55.999 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/630 2023-09-10T07:09:55.999 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/630 2023-09-10T07:09:56.000 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:56.002 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:56.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:56.010 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-09-10T07:09:56.205 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:56.209 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:56.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:56.314 INFO:teuthology.orchestra.run.smithi084.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:09:56.318 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/631 2023-09-10T07:09:56.319 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/631 2023-09-10T07:09:56.319 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:09:56.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:09:56.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:09:56.330 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-09-10T07:09:56.530 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:09:56.534 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:09:56.534 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:02.345 INFO:teuthology.orchestra.run.smithi084.stdout:generic/632 6s 2023-09-10T07:10:02.352 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/632 2023-09-10T07:10:02.353 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:02.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:02.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:02.368 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-09-10T07:10:02.592 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:02.597 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:02.597 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:03.166 INFO:teuthology.orchestra.run.smithi084.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/633.out.bad) 2023-09-10T07:10:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: --- tests/generic/633.out 2023-09-10 00:14:15.772892114 +0000 2023-09-10T07:10:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: +++ /tmp/tmp.4PMIK897QPxfstests-dev/results//generic/633.out.bad 2023-09-10 07:10:03.124112110 +0000 2023-09-10T07:10:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: @@ -1,2 +1,3 @@ 2023-09-10T07:10:03.295 INFO:teuthology.orchestra.run.smithi084.stdout: QA output created by 633 2023-09-10T07:10:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: Silence is golden 2023-09-10T07:10:03.296 INFO:teuthology.orchestra.run.smithi084.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-09-10T07:10:03.366 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/633 2023-09-10T07:10:03.366 INFO:teuthology.orchestra.run.smithi084.stdout:Failures: generic/633 2023-09-10T07:10:03.366 INFO:teuthology.orchestra.run.smithi084.stdout:Failed 1 of 1 tests 2023-09-10T07:10:03.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:03.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T07:10:03.410 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-09-10T07:10:03.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-09-10T07:10:03.411 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-09-10T07:10:03.681 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:03.685 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:03.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:03.794 INFO:teuthology.orchestra.run.smithi084.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:03.798 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/634 2023-09-10T07:10:03.798 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/634 2023-09-10T07:10:03.798 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:03.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:03.809 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-09-10T07:10:04.004 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:04.008 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:04.008 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:04.111 INFO:teuthology.orchestra.run.smithi084.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:04.115 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/635 2023-09-10T07:10:04.115 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/635 2023-09-10T07:10:04.115 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:04.118 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:04.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:04.126 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-09-10T07:10:04.304 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:04.308 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:04.423 INFO:teuthology.orchestra.run.smithi084.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:04.427 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/636 2023-09-10T07:10:04.427 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/636 2023-09-10T07:10:04.427 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:04.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:04.438 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-09-10T07:10:04.613 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:04.617 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:06.602 INFO:teuthology.orchestra.run.smithi084.stdout:generic/637 2s 2023-09-10T07:10:06.609 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/637 2023-09-10T07:10:06.610 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:06.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:06.626 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-09-10T07:10:07.207 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:07.212 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:07.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:07.396 INFO:teuthology.orchestra.run.smithi084.stdout:generic/638 0s 2023-09-10T07:10:07.401 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/638 2023-09-10T07:10:07.402 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:07.404 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:07.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:07.413 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-09-10T07:10:07.627 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:07.632 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:07.632 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.027 INFO:teuthology.orchestra.run.smithi084.stdout:generic/639 3s 2023-09-10T07:10:10.080 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/639 2023-09-10T07:10:10.080 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:10.084 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:10.096 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-09-10T07:10:10.322 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:10.327 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:10.327 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.528 INFO:teuthology.orchestra.run.smithi084.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:10.532 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/640 2023-09-10T07:10:10.533 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/640 2023-09-10T07:10:10.533 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:10.535 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:10.546 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-09-10T07:10:10.776 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:10.781 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:10.781 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.906 INFO:teuthology.orchestra.run.smithi084.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:10.910 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/641 2023-09-10T07:10:10.910 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/641 2023-09-10T07:10:10.911 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:10.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:10.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:10.923 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-09-10T07:10:11.141 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:11.146 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:11.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.276 INFO:teuthology.orchestra.run.smithi084.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/642 2023-09-10T07:10:11.281 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/642 2023-09-10T07:10:11.282 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:11.284 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:11.295 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-09-10T07:10:11.509 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:11.514 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:11.514 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.621 INFO:teuthology.orchestra.run.smithi084.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/643 2023-09-10T07:10:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/643 2023-09-10T07:10:11.625 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:11.636 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-09-10T07:10:11.812 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:11.816 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.957 INFO:teuthology.orchestra.run.smithi084.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-09-10T07:10:11.961 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/644 2023-09-10T07:10:11.961 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/644 2023-09-10T07:10:11.961 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:11.963 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:11.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:11.972 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-09-10T07:10:12.173 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:12.177 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:12.177 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:12.286 INFO:teuthology.orchestra.run.smithi084.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-09-10T07:10:12.289 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/645 2023-09-10T07:10:12.289 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/645 2023-09-10T07:10:12.290 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:12.291 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:12.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:12.300 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-09-10T07:10:12.492 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:12.496 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:12.497 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:12.601 INFO:teuthology.orchestra.run.smithi084.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/646 2023-09-10T07:10:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/646 2023-09-10T07:10:12.605 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:12.607 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:12.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:12.616 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-09-10T07:10:12.784 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:12.788 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:12.788 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:12.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:10:12.915 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:10:13.195 INFO:teuthology.orchestra.run.smithi084.stdout:generic/647 1s 2023-09-10T07:10:13.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/647 2023-09-10T07:10:13.201 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:13.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:13.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:13.213 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-09-10T07:10:13.753 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:13.757 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:13.757 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:13.902 INFO:teuthology.orchestra.run.smithi084.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T07:10:13.906 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/648 2023-09-10T07:10:13.906 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/648 2023-09-10T07:10:13.906 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:13.908 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:13.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:13.918 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-09-10T07:10:14.093 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:14.098 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:14.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:14.269 INFO:teuthology.orchestra.run.smithi084.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-09-10T07:10:14.273 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/649 2023-09-10T07:10:14.273 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/649 2023-09-10T07:10:14.273 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T07:10:14.275 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:14.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T07:10:14.284 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-09-10T07:10:14.800 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T07:10:14.804 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T07:10:14.805 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T07:10:42.982 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:10:42.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:11:13.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:11:13.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:11:43.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:11:43.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:12:13.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:12:13.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:12:43.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:12:43.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:13:13.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:13:13.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:13:44.238 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:13:44.241 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:13:44.264 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T07:13:44.264+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48298) UID: 0 2023-09-10T07:13:44.265 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T07:13:44.264+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48298) UID: 0 2023-09-10T07:13:44.265 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T07:13:44.264+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48298) UID: 0 2023-09-10T07:13:44.266 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T07:13:44.264+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48298) UID: 0 2023-09-10T07:17:12.746 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:17:12.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:17:12.996 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T07:17:12.995+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48320) UID: 0 2023-09-10T07:17:12.997 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T07:17:12.995+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48320) UID: 0 2023-09-10T07:17:12.998 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T07:17:12.995+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48320) UID: 0 2023-09-10T07:17:12.998 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T07:17:12.995+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48320) UID: 0 2023-09-10T07:20:37.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:20:37.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:20:37.696 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T07:20:37.692+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 431812) UID: 0 2023-09-10T07:20:37.697 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T07:20:37.692+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 431812) UID: 0 2023-09-10T07:27:48.683 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T07:27:48.677+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434176) UID: 0 2023-09-10T07:27:48.703 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T07:27:48.677+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434176) UID: 0 2023-09-10T07:27:48.703 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T07:27:48.677+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434176) UID: 0 2023-09-10T07:27:48.704 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T07:27:48.677+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434176) UID: 0 2023-09-10T07:42:31.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:42:31.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T07:42:31.634 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T07:42:31.628+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48411) UID: 0 2023-09-10T07:42:31.635 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T07:42:31.628+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48411) UID: 0 2023-09-10T07:42:31.635 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T07:42:31.628+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48411) UID: 0 2023-09-10T07:42:31.635 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T07:42:31.628+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48411) UID: 0 2023-09-10T07:42:32.074 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T07:42:32.070+0000 7fba0d687640 -1 Fail to open '/proc/438893/cmdline' error = (2) No such file or directory 2023-09-10T07:42:32.074 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T07:42:32.070+0000 7fba0d687640 -1 received signal: Hangup from (PID: 438893) UID: 0 2023-09-10T07:42:32.075 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T07:42:32.070+0000 7f9cd2f2f640 -1 Fail to open '/proc/438893/cmdline' error = (2) No such file or directory 2023-09-10T07:42:32.075 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T07:42:32.070+0000 7f9cd2f2f640 -1 received signal: Hangup from (PID: 438893) UID: 0 2023-09-10T07:54:07.159 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T07:54:07.153+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442806) UID: 0 2023-09-10T07:54:07.160 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T07:54:07.153+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442806) UID: 0 2023-09-10T07:54:07.160 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T07:54:07.153+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442806) UID: 0 2023-09-10T07:54:07.161 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T07:54:07.153+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442806) UID: 0 2023-09-10T08:08:14.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:08:14.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:08:14.981 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T08:08:14.977+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48503) UID: 0 2023-09-10T08:08:14.982 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T08:08:14.977+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48503) UID: 0 2023-09-10T08:08:14.983 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T08:08:14.977+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48503) UID: 0 2023-09-10T08:08:14.983 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T08:08:14.977+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48503) UID: 0 2023-09-10T08:08:15.164 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T08:08:15.159+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 447173) UID: 0 2023-09-10T08:08:15.165 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T08:08:15.159+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 447173) UID: 0 2023-09-10T08:21:59.012 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:21:59.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:21:59.261 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T08:21:59.253+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48560) UID: 0 2023-09-10T08:21:59.262 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T08:21:59.253+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48560) UID: 0 2023-09-10T08:21:59.263 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T08:21:59.253+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48560) UID: 0 2023-09-10T08:21:59.264 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T08:21:59.253+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48560) UID: 0 2023-09-10T08:21:59.310 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T08:21:59.301+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 451375) UID: 0 2023-09-10T08:21:59.310 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T08:21:59.301+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 451375) UID: 0 2023-09-10T08:29:25.215 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T08:29:25.206+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 453551) UID: 0 2023-09-10T08:29:25.216 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T08:29:25.206+0000 7f4f7bd04640 -1 Fail to open '/proc/453551/cmdline' error = (2) No such file or directory 2023-09-10T08:29:25.217 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T08:29:25.206+0000 7f4f7bd04640 -1 received signal: Hangup from (PID: 453551) UID: 0 2023-09-10T08:29:25.217 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T08:29:25.210+0000 7fa8621c0640 -1 Fail to open '/proc/453551/cmdline' error = (2) No such file or directory 2023-09-10T08:29:25.217 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T08:29:25.210+0000 7fa8621c0640 -1 received signal: Hangup from (PID: 453551) UID: 0 2023-09-10T08:29:25.218 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T08:29:25.210+0000 7f9cbac9e640 -1 Fail to open '/proc/453551/cmdline' error = (2) No such file or directory 2023-09-10T08:29:25.218 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T08:29:25.210+0000 7f9cbac9e640 -1 received signal: Hangup from (PID: 453551) UID: 0 2023-09-10T08:37:15.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:37:15.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:37:15.788 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T08:37:15.782+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48618) UID: 0 2023-09-10T08:37:15.788 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T08:37:15.782+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48618) UID: 0 2023-09-10T08:37:15.789 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T08:37:15.782+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48618) UID: 0 2023-09-10T08:37:15.789 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T08:37:15.782+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48618) UID: 0 2023-09-10T08:37:15.939 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T08:37:15.930+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 456013) UID: 0 2023-09-10T08:37:15.940 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T08:37:15.934+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 456013) UID: 0 2023-09-10T08:45:32.368 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T08:45:32.358+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458557) UID: 0 2023-09-10T08:45:32.391 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T08:45:32.358+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458557) UID: 0 2023-09-10T08:45:32.391 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T08:45:32.358+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458557) UID: 0 2023-09-10T08:45:32.392 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T08:45:32.358+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 458557) UID: 0 2023-09-10T08:53:20.784 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:53:20.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T08:53:21.098 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T08:53:21.090+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 460870) UID: 0 2023-09-10T08:53:21.099 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T08:53:21.090+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 460870) UID: 0 2023-09-10T09:02:14.271 INFO:tasks.ceph.osd.3.smithi084.stderr:2023-09-10T09:02:14.262+0000 7f9cbac9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463387) UID: 0 2023-09-10T09:02:14.272 INFO:tasks.ceph.osd.1.smithi084.stderr:2023-09-10T09:02:14.262+0000 7fa8621c0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463387) UID: 0 2023-09-10T09:02:14.272 INFO:tasks.ceph.osd.2.smithi084.stderr:2023-09-10T09:02:14.262+0000 7f4f7bd04640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463387) UID: 0 2023-09-10T09:02:14.273 INFO:tasks.ceph.osd.0.smithi084.stderr:2023-09-10T09:02:14.262+0000 7fe2eb377640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463387) UID: 0 2023-09-10T09:11:15.384 INFO:teuthology.orchestra.run.smithi084.stdout:generic/650 7260s 2023-09-10T09:11:17.106 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/650 2023-09-10T09:11:17.106 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:17.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:17.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:17.195 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-09-10T09:11:22.961 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:22.966 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:22.966 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:23.790 INFO:teuthology.orchestra.run.smithi084.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:23.800 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/651 2023-09-10T09:11:23.800 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/651 2023-09-10T09:11:23.800 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:23.804 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:23.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:23.821 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-09-10T09:11:24.142 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:24.147 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:24.147 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:24.660 INFO:teuthology.orchestra.run.smithi084.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:24.665 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/652 2023-09-10T09:11:24.665 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/652 2023-09-10T09:11:24.665 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:24.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:24.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:24.683 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-09-10T09:11:25.090 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:25.094 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:25.095 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:25.244 INFO:teuthology.orchestra.run.smithi084.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:25.247 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/653 2023-09-10T09:11:25.248 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/653 2023-09-10T09:11:25.248 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:25.251 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:25.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:25.268 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-09-10T09:11:25.561 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:25.569 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:25.570 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:25.744 INFO:teuthology.orchestra.run.smithi084.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:25.747 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/654 2023-09-10T09:11:25.747 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/654 2023-09-10T09:11:25.748 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:25.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:25.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:25.795 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-09-10T09:11:26.097 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:26.102 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:26.103 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:26.300 INFO:teuthology.orchestra.run.smithi084.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:26.309 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/655 2023-09-10T09:11:26.309 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/655 2023-09-10T09:11:26.309 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:26.312 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:26.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:26.324 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-09-10T09:11:26.687 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:26.696 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:26.697 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:26.987 INFO:teuthology.orchestra.run.smithi084.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-09-10T09:11:26.991 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/656 2023-09-10T09:11:26.991 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/656 2023-09-10T09:11:26.991 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:27.000 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:27.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:27.019 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-09-10T09:11:27.328 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:27.333 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:27.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:27.523 INFO:teuthology.orchestra.run.smithi084.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/657 2023-09-10T09:11:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/657 2023-09-10T09:11:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:27.539 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:27.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:27.553 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-09-10T09:11:27.879 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:27.884 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:27.884 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:28.099 INFO:teuthology.orchestra.run.smithi084.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:28.113 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/658 2023-09-10T09:11:28.113 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/658 2023-09-10T09:11:28.113 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:28.122 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:28.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:28.135 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-09-10T09:11:28.487 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:28.492 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:28.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:28.663 INFO:teuthology.orchestra.run.smithi084.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:28.668 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/659 2023-09-10T09:11:28.668 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/659 2023-09-10T09:11:28.669 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:28.676 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:28.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:28.694 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-09-10T09:11:28.995 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:29.004 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:29.004 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:29.336 INFO:teuthology.orchestra.run.smithi084.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:29.345 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/660 2023-09-10T09:11:29.345 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/660 2023-09-10T09:11:29.345 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:29.350 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:29.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:29.368 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-09-10T09:11:29.675 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:29.679 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:29.679 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:29.998 INFO:teuthology.orchestra.run.smithi084.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:30.002 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/661 2023-09-10T09:11:30.002 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/661 2023-09-10T09:11:30.002 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:30.005 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:30.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:30.023 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-09-10T09:11:30.317 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:30.321 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:30.321 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:30.514 INFO:teuthology.orchestra.run.smithi084.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:30.518 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/662 2023-09-10T09:11:30.518 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/662 2023-09-10T09:11:30.519 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:30.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:30.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:30.543 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-09-10T09:11:30.819 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:30.824 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:30.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:30.986 INFO:teuthology.orchestra.run.smithi084.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:30.990 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/663 2023-09-10T09:11:30.991 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/663 2023-09-10T09:11:30.991 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:30.993 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:31.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:31.004 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-09-10T09:11:31.290 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:31.295 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:31.295 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:31.477 INFO:teuthology.orchestra.run.smithi084.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/664 2023-09-10T09:11:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/664 2023-09-10T09:11:31.481 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:31.483 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:31.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:31.494 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-09-10T09:11:31.760 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:31.772 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:31.772 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:32.293 INFO:teuthology.orchestra.run.smithi084.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:32.296 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/665 2023-09-10T09:11:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/665 2023-09-10T09:11:32.297 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:32.299 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:32.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:32.311 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-09-10T09:11:32.615 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:32.619 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:32.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:33.003 INFO:teuthology.orchestra.run.smithi084.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:33.009 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/666 2023-09-10T09:11:33.009 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/666 2023-09-10T09:11:33.010 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:33.013 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:33.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:33.032 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-09-10T09:11:33.363 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:33.369 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:33.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:33.735 INFO:teuthology.orchestra.run.smithi084.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:33.742 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/667 2023-09-10T09:11:33.743 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/667 2023-09-10T09:11:33.743 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:33.745 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:33.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:33.767 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-09-10T09:11:34.446 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:34.460 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:34.461 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:34.786 INFO:teuthology.orchestra.run.smithi084.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:34.790 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/668 2023-09-10T09:11:34.790 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/668 2023-09-10T09:11:34.791 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:34.793 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:34.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:34.807 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-09-10T09:11:35.087 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:35.092 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:35.092 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:35.504 INFO:teuthology.orchestra.run.smithi084.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/669 2023-09-10T09:11:35.508 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/669 2023-09-10T09:11:35.509 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:35.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:35.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:35.534 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-09-10T09:11:35.825 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:35.830 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:35.830 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:35.975 INFO:teuthology.orchestra.run.smithi084.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:35.979 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/670 2023-09-10T09:11:35.979 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/670 2023-09-10T09:11:35.979 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:35.984 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:36.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:36.009 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-09-10T09:11:36.289 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:36.293 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:36.293 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:36.558 INFO:teuthology.orchestra.run.smithi084.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:36.562 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/671 2023-09-10T09:11:36.562 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/671 2023-09-10T09:11:36.562 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:36.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:36.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:36.576 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-09-10T09:11:36.884 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:36.888 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:36.888 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:37.183 INFO:teuthology.orchestra.run.smithi084.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:37.192 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/672 2023-09-10T09:11:37.192 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/672 2023-09-10T09:11:37.193 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:37.195 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:37.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:37.207 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-09-10T09:11:37.543 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:37.548 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:37.548 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:39.220 INFO:teuthology.orchestra.run.smithi084.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:39.225 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/673 2023-09-10T09:11:39.225 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/673 2023-09-10T09:11:39.225 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:39.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:39.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:39.244 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-09-10T09:11:39.521 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:39.526 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:39.526 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:39.871 INFO:teuthology.orchestra.run.smithi084.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:39.875 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/674 2023-09-10T09:11:39.875 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/674 2023-09-10T09:11:39.876 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:39.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:39.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:39.892 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-09-10T09:11:40.178 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:40.183 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:40.184 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:40.482 INFO:teuthology.orchestra.run.smithi084.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:11:40.486 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/675 2023-09-10T09:11:40.486 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/675 2023-09-10T09:11:40.487 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:11:40.489 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:11:40.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:11:40.499 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-09-10T09:11:40.807 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:11:40.812 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:11:40.812 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:14:07.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T09:14:07.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-10T09:14:07.374 INFO:tasks.ceph.mds.c.smithi084.stderr:2023-09-10T09:14:07.366+0000 7fba0d687640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 475362) UID: 0 2023-09-10T09:14:07.375 INFO:tasks.ceph.mds.a.smithi084.stderr:2023-09-10T09:14:07.366+0000 7f9cd2f2f640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 475362) UID: 0 2023-09-10T09:14:07.558 INFO:tasks.ceph.osd.4.smithi100.stderr:2023-09-10T09:14:07.552+0000 7f67a684a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48736) UID: 0 2023-09-10T09:14:07.560 INFO:tasks.ceph.osd.5.smithi100.stderr:2023-09-10T09:14:07.552+0000 7f267d576640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48736) UID: 0 2023-09-10T09:14:07.561 INFO:tasks.ceph.osd.7.smithi100.stderr:2023-09-10T09:14:07.552+0000 7fcbd7b19640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48736) UID: 0 2023-09-10T09:14:07.561 INFO:tasks.ceph.osd.6.smithi100.stderr:2023-09-10T09:14:07.552+0000 7f75ef10b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48736) UID: 0 2023-09-10T09:16:26.881 INFO:teuthology.orchestra.run.smithi084.stdout:generic/676 286s 2023-09-10T09:16:26.892 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/676 2023-09-10T09:16:26.892 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:26.895 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:26.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:26.913 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-09-10T09:16:27.553 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:27.557 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:27.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:28.485 INFO:teuthology.orchestra.run.smithi084.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:28.490 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/677 2023-09-10T09:16:28.490 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/677 2023-09-10T09:16:28.490 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:28.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:28.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:28.504 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-09-10T09:16:28.776 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:28.780 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:28.780 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:29.365 INFO:teuthology.orchestra.run.smithi084.stdout:generic/678 [not run] kernel does not support IO_URING 2023-09-10T09:16:29.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/678 2023-09-10T09:16:29.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/678 2023-09-10T09:16:29.370 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:29.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:29.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:29.385 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-09-10T09:16:29.655 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:29.660 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:29.661 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:29.905 INFO:teuthology.orchestra.run.smithi084.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:29.909 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/679 2023-09-10T09:16:29.910 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/679 2023-09-10T09:16:29.910 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:29.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:29.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:29.921 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-09-10T09:16:30.193 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:30.197 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:30.197 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:34.210 INFO:teuthology.orchestra.run.smithi084.stdout:generic/680 4s 2023-09-10T09:16:34.229 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/680 2023-09-10T09:16:34.229 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:34.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:34.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:34.242 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-09-10T09:16:34.869 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:34.874 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:34.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:35.323 INFO:teuthology.orchestra.run.smithi084.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T09:16:35.327 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/681 2023-09-10T09:16:35.328 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/681 2023-09-10T09:16:35.328 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:35.330 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:35.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:35.346 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-09-10T09:16:35.603 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:35.608 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:35.608 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:35.759 INFO:teuthology.orchestra.run.smithi084.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-09-10T09:16:35.770 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/682 2023-09-10T09:16:35.770 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/682 2023-09-10T09:16:35.770 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:35.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:35.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:35.782 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-09-10T09:16:36.104 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:36.109 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:36.109 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:36.918 INFO:teuthology.orchestra.run.smithi084.stdout:generic/683 [not run] /tmp/tmp.8YBtWphbTqtest: file alloc unit 4194304 larger than op length 65536 2023-09-10T09:16:36.923 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/683 2023-09-10T09:16:36.923 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/683 2023-09-10T09:16:36.924 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:36.926 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:36.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:36.939 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-09-10T09:16:37.199 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:37.203 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:37.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:39.593 INFO:teuthology.orchestra.run.smithi084.stdout:generic/684 [not run] /tmp/tmp.8YBtWphbTqtest: file alloc unit 4194304 larger than op length 65536 2023-09-10T09:16:39.597 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/684 2023-09-10T09:16:39.597 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/684 2023-09-10T09:16:39.597 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:39.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:39.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:39.616 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-09-10T09:16:39.914 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:39.920 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:39.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:41.586 INFO:teuthology.orchestra.run.smithi084.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-09-10T09:16:41.590 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/685 2023-09-10T09:16:41.591 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/685 2023-09-10T09:16:41.591 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:41.598 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:41.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:41.612 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-09-10T09:16:41.993 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:41.998 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:41.999 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:43.749 INFO:teuthology.orchestra.run.smithi084.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-09-10T09:16:43.753 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/686 2023-09-10T09:16:43.753 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/686 2023-09-10T09:16:43.754 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:43.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:43.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:43.765 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-09-10T09:16:44.046 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:44.051 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:44.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:45.642 INFO:teuthology.orchestra.run.smithi084.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-09-10T09:16:45.647 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/687 2023-09-10T09:16:45.647 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/687 2023-09-10T09:16:45.647 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:45.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:45.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:45.662 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-09-10T09:16:46.027 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:46.032 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:46.033 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:46.507 INFO:teuthology.orchestra.run.smithi084.stdout:generic/688 [not run] /tmp/tmp.8YBtWphbTqtest: file alloc unit 4194304 larger than op length 65536 2023-09-10T09:16:46.518 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/688 2023-09-10T09:16:46.519 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/688 2023-09-10T09:16:46.519 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:46.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:46.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:46.533 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-09-10T09:16:46.843 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:46.848 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:46.848 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:47.615 INFO:teuthology.orchestra.run.smithi084.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-09-10T09:16:47.620 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/689 2023-09-10T09:16:47.621 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/689 2023-09-10T09:16:47.621 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:47.625 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:47.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:47.639 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-09-10T09:16:47.941 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:47.946 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:47.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:48.810 INFO:teuthology.orchestra.run.smithi084.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:48.814 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/690 2023-09-10T09:16:48.814 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/690 2023-09-10T09:16:48.815 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:48.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:48.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:48.830 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-09-10T09:16:49.227 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:49.232 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:49.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:49.811 INFO:teuthology.orchestra.run.smithi084.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:49.815 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/691 2023-09-10T09:16:49.815 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/691 2023-09-10T09:16:49.815 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:49.818 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:49.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:49.829 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-09-10T09:16:50.172 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:50.176 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:50.176 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:50.406 INFO:teuthology.orchestra.run.smithi084.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:50.410 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/692 2023-09-10T09:16:50.411 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/692 2023-09-10T09:16:50.411 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:50.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:50.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:50.422 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-09-10T09:16:50.717 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:50.723 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:50.723 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:50.938 INFO:teuthology.orchestra.run.smithi084.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:50.942 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/693 2023-09-10T09:16:50.943 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/693 2023-09-10T09:16:50.943 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:50.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:50.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:50.979 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-09-10T09:16:51.336 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:51.341 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:51.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:52.495 INFO:teuthology.orchestra.run.smithi084.stdout:generic/694 1s 2023-09-10T09:16:52.504 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/694 2023-09-10T09:16:52.504 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:52.509 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:52.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:52.521 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-09-10T09:16:52.810 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:52.815 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:52.815 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:53.201 INFO:teuthology.orchestra.run.smithi084.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:53.206 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/695 2023-09-10T09:16:53.206 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/695 2023-09-10T09:16:53.206 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:53.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:53.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:53.221 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-09-10T09:16:53.507 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:53.513 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:53.513 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:53.889 INFO:teuthology.orchestra.run.smithi084.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:53.897 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/696 2023-09-10T09:16:53.897 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/696 2023-09-10T09:16:53.898 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:53.900 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:53.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:53.910 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-09-10T09:16:54.198 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:54.203 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:54.203 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:54.424 INFO:teuthology.orchestra.run.smithi084.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-09-10T09:16:54.431 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/697 2023-09-10T09:16:54.432 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/697 2023-09-10T09:16:54.432 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:54.469 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:54.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:54.480 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-09-10T09:16:54.754 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:54.761 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:54.761 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:54.939 INFO:teuthology.orchestra.run.smithi084.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:54.943 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/698 2023-09-10T09:16:54.944 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/698 2023-09-10T09:16:54.944 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:54.946 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:54.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:54.956 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-09-10T09:16:55.265 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:55.273 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:55.273 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:55.735 INFO:teuthology.orchestra.run.smithi084.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:55.739 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/699 2023-09-10T09:16:55.740 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/699 2023-09-10T09:16:55.740 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:55.742 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:55.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:55.753 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-09-10T09:16:56.043 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:56.047 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:56.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:56.197 INFO:teuthology.orchestra.run.smithi084.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:56.201 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/700 2023-09-10T09:16:56.202 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/700 2023-09-10T09:16:56.202 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:56.204 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:56.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:56.224 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-09-10T09:16:56.512 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:56.519 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:56.519 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:57.399 INFO:teuthology.orchestra.run.smithi084.stdout:generic/701 1s 2023-09-10T09:16:57.406 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/701 2023-09-10T09:16:57.406 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:57.409 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:57.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:57.419 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-09-10T09:16:58.042 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:58.047 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:58.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:58.283 INFO:teuthology.orchestra.run.smithi084.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:58.287 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/702 2023-09-10T09:16:58.287 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/702 2023-09-10T09:16:58.287 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:58.289 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:58.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:58.301 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-09-10T09:16:58.600 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:58.604 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:58.604 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:59.106 INFO:teuthology.orchestra.run.smithi084.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:16:59.111 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/703 2023-09-10T09:16:59.111 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/703 2023-09-10T09:16:59.111 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:16:59.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:16:59.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:16:59.127 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-09-10T09:16:59.412 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:16:59.417 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:16:59.417 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:00.389 INFO:teuthology.orchestra.run.smithi084.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-09-10T09:17:00.393 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/704 2023-09-10T09:17:00.393 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/704 2023-09-10T09:17:00.394 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:00.402 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:00.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:00.414 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-09-10T09:17:00.763 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:00.768 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:00.768 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:01.033 INFO:teuthology.orchestra.run.smithi084.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:17:01.040 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/705 2023-09-10T09:17:01.041 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/705 2023-09-10T09:17:01.041 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:01.043 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:01.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:01.068 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-09-10T09:17:01.369 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:01.374 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:01.374 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:03.897 INFO:teuthology.orchestra.run.smithi084.stdout:generic/706 2s 2023-09-10T09:17:03.903 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/706 2023-09-10T09:17:03.904 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:03.906 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:03.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:03.933 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-09-10T09:17:04.658 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:04.662 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:04.829 INFO:teuthology.orchestra.run.smithi084.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-09-10T09:17:04.833 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/707 2023-09-10T09:17:04.833 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/707 2023-09-10T09:17:04.833 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:04.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:04.844 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-09-10T09:17:05.166 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:05.173 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:05.962 INFO:teuthology.orchestra.run.smithi084.stdout:generic/708 0s 2023-09-10T09:17:05.970 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/708 2023-09-10T09:17:05.970 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:05.975 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:05.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:05.984 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-09-10T09:17:06.593 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:06.601 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:06.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:06.940 INFO:teuthology.orchestra.run.smithi084.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:06.951 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/709 2023-09-10T09:17:06.952 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/709 2023-09-10T09:17:06.952 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:06.954 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:06.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:06.965 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-09-10T09:17:07.678 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:07.682 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:07.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:07.990 INFO:teuthology.orchestra.run.smithi084.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:07.995 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/710 2023-09-10T09:17:07.995 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/710 2023-09-10T09:17:07.995 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:07.997 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:08.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:08.015 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-09-10T09:17:08.621 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:08.626 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:08.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:08.907 INFO:teuthology.orchestra.run.smithi084.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:08.912 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/711 2023-09-10T09:17:08.912 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/711 2023-09-10T09:17:08.912 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:08.916 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:08.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:08.932 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-09-10T09:17:09.634 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:09.656 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:09.656 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:10.112 INFO:teuthology.orchestra.run.smithi084.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:10.116 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/712 2023-09-10T09:17:10.117 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/712 2023-09-10T09:17:10.117 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:10.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:10.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:10.141 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-09-10T09:17:10.785 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:10.790 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:10.790 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:11.141 INFO:teuthology.orchestra.run.smithi084.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-09-10T09:17:11.152 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/713 2023-09-10T09:17:11.153 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/713 2023-09-10T09:17:11.153 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:11.156 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:11.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:11.176 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-09-10T09:17:11.850 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:11.855 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:11.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:12.330 INFO:teuthology.orchestra.run.smithi084.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:12.334 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/714 2023-09-10T09:17:12.334 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/714 2023-09-10T09:17:12.334 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:12.337 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:12.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:12.349 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-09-10T09:17:12.966 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:12.977 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:12.977 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:13.295 INFO:teuthology.orchestra.run.smithi084.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-09-10T09:17:13.299 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/715 2023-09-10T09:17:13.299 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/715 2023-09-10T09:17:13.299 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:13.302 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:13.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:13.313 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-09-10T09:17:13.926 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:13.931 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:13.931 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:14.363 INFO:teuthology.orchestra.run.smithi084.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:14.369 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/716 2023-09-10T09:17:14.369 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/716 2023-09-10T09:17:14.369 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:14.372 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:14.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:14.383 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-09-10T09:17:15.015 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:15.019 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:15.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:15.236 INFO:teuthology.orchestra.run.smithi084.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:15.242 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/717 2023-09-10T09:17:15.242 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/717 2023-09-10T09:17:15.242 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:15.245 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:15.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:15.265 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-09-10T09:17:15.918 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:15.923 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:15.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:16.163 INFO:teuthology.orchestra.run.smithi084.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:16.167 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/718 2023-09-10T09:17:16.167 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/718 2023-09-10T09:17:16.167 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:16.170 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:16.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:16.183 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-09-10T09:17:16.771 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:16.775 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:16.776 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:17.064 INFO:teuthology.orchestra.run.smithi084.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:17.068 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/719 2023-09-10T09:17:17.068 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/719 2023-09-10T09:17:17.069 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:17.072 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:17.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:17.083 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-09-10T09:17:17.714 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:17.719 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:17.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:18.004 INFO:teuthology.orchestra.run.smithi084.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:18.008 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/720 2023-09-10T09:17:18.008 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/720 2023-09-10T09:17:18.008 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:18.010 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:18.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:18.022 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-09-10T09:17:18.655 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:18.669 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:18.669 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:18.904 INFO:teuthology.orchestra.run.smithi084.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-09-10T09:17:18.908 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/721 2023-09-10T09:17:18.908 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/721 2023-09-10T09:17:18.909 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:18.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:18.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:18.922 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-09-10T09:17:19.208 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:19.213 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:19.213 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:19.447 INFO:teuthology.orchestra.run.smithi084.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-09-10T09:17:19.450 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/722 2023-09-10T09:17:19.451 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/722 2023-09-10T09:17:19.451 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:19.453 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:19.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:19.463 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-09-10T09:17:20.200 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:20.212 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:20.212 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:20.812 INFO:teuthology.orchestra.run.smithi084.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-09-10T09:17:20.888 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/723 2023-09-10T09:17:20.889 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/723 2023-09-10T09:17:20.889 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:20.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:20.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:20.927 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-09-10T09:17:21.872 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:21.877 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:21.878 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:22.282 INFO:teuthology.orchestra.run.smithi084.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-09-10T09:17:22.287 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/724 2023-09-10T09:17:22.287 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/724 2023-09-10T09:17:22.287 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:22.290 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:22.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:22.300 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-09-10T09:17:24.277 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:24.281 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:24.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:24.685 INFO:teuthology.orchestra.run.smithi084.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-09-10T09:17:24.691 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/725 2023-09-10T09:17:24.691 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/725 2023-09-10T09:17:24.691 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:24.694 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:24.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:24.710 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-09-10T09:17:25.502 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:25.506 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:25.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:27.090 INFO:teuthology.orchestra.run.smithi084.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-09-10T09:17:27.095 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/726 2023-09-10T09:17:27.095 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/726 2023-09-10T09:17:27.096 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:27.098 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:27.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:27.116 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-09-10T09:17:27.715 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:27.719 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:27.720 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:28.791 INFO:teuthology.orchestra.run.smithi084.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-09-10T09:17:28.795 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/727 2023-09-10T09:17:28.795 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/727 2023-09-10T09:17:28.796 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:28.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:28.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:28.813 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-09-10T09:17:29.518 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:29.522 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:29.523 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:33.974 INFO:teuthology.orchestra.run.smithi084.stdout:generic/728 4s 2023-09-10T09:17:34.015 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/728 2023-09-10T09:17:34.015 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:34.017 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:34.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:34.027 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-09-10T09:17:34.356 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:34.361 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:34.361 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:35.397 INFO:teuthology.orchestra.run.smithi084.stdout:generic/729 1s 2023-09-10T09:17:35.409 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/729 2023-09-10T09:17:35.410 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:35.412 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:35.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:35.426 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-09-10T09:17:36.099 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:36.105 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:36.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:36.313 INFO:teuthology.orchestra.run.smithi084.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-09-10T09:17:36.317 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/730 2023-09-10T09:17:36.317 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/730 2023-09-10T09:17:36.317 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:36.320 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:36.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:36.339 DEBUG:teuthology.orchestra.run.smithi084:> (cd /tmp/tmp.4PMIK897QPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-09-10T09:17:36.624 INFO:teuthology.orchestra.run.smithi084.stdout:FSTYP -- ceph-fuse 2023-09-10T09:17:36.628 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM -- Linux/x86_64 smithi084 5.15.0-83-generic #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 2023-09-10T09:17:36.629 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:36.767 INFO:teuthology.orchestra.run.smithi084.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-09-10T09:17:36.771 INFO:teuthology.orchestra.run.smithi084.stdout:Ran: generic/731 2023-09-10T09:17:36.771 INFO:teuthology.orchestra.run.smithi084.stdout:Not run: generic/731 2023-09-10T09:17:36.771 INFO:teuthology.orchestra.run.smithi084.stdout:Passed all 1 tests 2023-09-10T09:17:36.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:36.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-09-10T09:17:36.782 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-09-10T09:17:36.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo userdel --force --remove fsgqa 2023-09-10T09:17:37.315 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: user fsgqa is currently used by process 496350 2023-09-10T09:17:37.403 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-09-10T09:17:38.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo userdel --force --remove 123456-fsgqa 2023-09-10T09:17:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-09-10T09:17:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-09-10T09:17:40.407 DEBUG:teuthology.orchestra.run.smithi084:> sudo groupdel fsgqa 2023-09-10T09:17:40.510 INFO:teuthology.orchestra.run.smithi084.stderr:groupdel: group 'fsgqa' does not exist 2023-09-10T09:17:40.511 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-10T09:17:40.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:17:40.512 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.4PMIK897QPxfstests-dev/results) 2023-09-10T09:17:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-09-10T09:17:40.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T09:17:40.570 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.4PMIK897QPxfstests-dev 2023-09-10T09:17:40.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf /tmp/tmp.4PMIK897QPxfstests-dev 2023-09-10T09:17:41.854 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-09-10T09:17:41.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-10T09:17:42.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-09-10T09:17:42.631 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-09-10T09:17:42.632 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T09:17:42.632 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:17:42.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336532k,nr_inodes=4084133,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-10T09:17:42.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:17:42.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:17:42.765 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-10T09:17:42.886 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T09:17:42.887 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:17:43.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336372k,nr_inodes=4084093,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19869 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-10T09:17:43.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:17:43.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:17:43.180 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-09-10T09:17:43.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T09:17:43.383 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-09-10T09:17:43.383 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T09:17:43.383 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:17:43.389 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336532k,nr_inodes=4084133,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-10T09:17:43.389 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:17:43.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:17:43.390 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-09-10T09:17:43.435 INFO:teuthology.orchestra.run.smithi084.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-09-10T09:17:43.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T09:17:43.436 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T09:17:43.437 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:17:43.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336372k,nr_inodes=4084093,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19869 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-10T09:17:43.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:17:43.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:17:43.444 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-09-10T09:17:43.489 INFO:teuthology.orchestra.run.smithi100.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-09-10T09:17:43.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T09:17:43.490 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T09:17:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 -- 172.21.15.84:0/105813040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 msgr2=0x7fa0b415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:46.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 --2- 172.21.15.84:0/105813040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b415a1e0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fa0b406ea70 tx=0x7fa0a401c810 comp rx=0 tx=0).stop 2023-09-10T09:17:46.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 -- 172.21.15.84:0/105813040 shutdown_connections 2023-09-10T09:17:46.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 --2- 172.21.15.84:0/105813040 >> v2:172.21.15.100:3300/0 conn(0x7fa0b40ce470 0x7fa0b40b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:46.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 --2- 172.21.15.84:0/105813040 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b4159020 0x7fa0b40cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:46.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 --2- 172.21.15.84:0/105813040 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b415a1e0 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:46.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.934+0000 7fa0b97ba640 1 -- 172.21.15.84:0/105813040 >> 172.21.15.84:0/105813040 conn(0x7fa0b40cb7c0 msgr2=0x7fa0b40cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:46.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.946+0000 7fa0b97ba640 1 -- 172.21.15.84:0/105813040 shutdown_connections 2023-09-10T09:17:46.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.946+0000 7fa0b97ba640 1 -- 172.21.15.84:0/105813040 wait complete. 2023-09-10T09:17:46.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.950+0000 7fa0b97ba640 1 Processor -- start 2023-09-10T09:17:46.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.954+0000 7fa0b97ba640 1 -- start start 2023-09-10T09:17:46.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:46.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 0x7fa0b40a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b4159020 0x7fa0b40aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b43e0 con 0x7fa0b40c9b60 2023-09-10T09:17:46.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b3340 con 0x7fa0b4159020 2023-09-10T09:17:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b3620 con 0x7fa0b40ce470 2023-09-10T09:17:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:46.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 0x7fa0b40a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:46.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59876/0 (socket says 172.21.15.84:59876) 2023-09-10T09:17:46.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b2ffd640 1 -- 172.21.15.84:0/2013156153 learned_addr learned my addr 172.21.15.84:0/2013156153 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:46.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 -- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b4159020 msgr2=0x7fa0b40aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:46.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b4159020 0x7fa0b40aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:46.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 -- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 msgr2=0x7fa0b40ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:46.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:46.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 -- 172.21.15.84:0/2013156153 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4009560 con 0x7fa0b40ce470 2023-09-10T09:17:46.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b2ffd640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T09:17:46.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b27fc640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 0x7fa0b40a9fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00d650 tx=0x7fa09c00db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:46.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c005220 con 0x7fa0b40ce470 2023-09-10T09:17:46.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa09c005470 con 0x7fa0b40ce470 2023-09-10T09:17:46.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c009820 con 0x7fa0b40ce470 2023-09-10T09:17:46.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.958+0000 7fa0b97ba640 1 -- 172.21.15.84:0/2013156153 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b40b3900 con 0x7fa0b40ce470 2023-09-10T09:17:46.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.978+0000 7fa0b97ba640 1 -- 172.21.15.84:0/2013156153 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b40b3ec0 con 0x7fa0b40ce470 2023-09-10T09:17:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.986+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa09c009980 con 0x7fa0b40ce470 2023-09-10T09:17:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.986+0000 7fa0ab7fe640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:46.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.986+0000 7fa0b2ffd640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:47.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:47.002+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa09c053dd0 con 0x7fa0b40ce470 2023-09-10T09:17:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:46.986+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b406f3a0 con 0x7fa0b40ce470 2023-09-10T09:17:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:47.042+0000 7fa0b2ffd640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 0x7fa094067fe0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009230 tx=0x7fa0a401b050 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:47.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:47.662+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa09c050110 con 0x7fa0b40ce470 2023-09-10T09:17:47.979 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:47.970+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0b4073400 con 0x7fa0b40ce470 2023-09-10T09:17:48.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.002+0000 7fa0ab7fe640 1 -- 172.21.15.84:0/2013156153 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fa09c017030 con 0x7fa0b40ce470 2023-09-10T09:17:48.022 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:48.023 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T09:17:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T09:17:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 msgr2=0x7fa094067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 0x7fa094067fe0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009230 tx=0x7fa0a401b050 comp rx=0 tx=0).stop 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 msgr2=0x7fa0b40a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 0x7fa0b40a9fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00d650 tx=0x7fa09c00db10 comp rx=0 tx=0).stop 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 shutdown_connections 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa094065b20 0x7fa094067fe0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b4159020 0x7fa0b40aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ce470 0x7fa0b40a9fd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 --2- 172.21.15.84:0/2013156153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa0b40c9b60 0x7fa0b40ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 >> 172.21.15.84:0/2013156153 conn(0x7fa0b40cb7c0 msgr2=0x7fa0b4151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:48.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 shutdown_connections 2023-09-10T09:17:48.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.006+0000 7fa0a97fa640 1 -- 172.21.15.84:0/2013156153 wait complete. 2023-09-10T09:17:48.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T09:17:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.226+0000 7fcef0f2f640 1 -- 172.21.15.84:0/3625869136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 msgr2=0x7fceec156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.234 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.226+0000 7fcef0f2f640 1 --2- 172.21.15.84:0/3625869136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec156670 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fcee4009cb0 tx=0x7fcee401cd50 comp rx=0 tx=0).stop 2023-09-10T09:17:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.230+0000 7fcef0f2f640 1 -- 172.21.15.84:0/3625869136 shutdown_connections 2023-09-10T09:17:48.239 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.230+0000 7fcef0f2f640 1 --2- 172.21.15.84:0/3625869136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec156670 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.230+0000 7fcef0f2f640 1 --2- 172.21.15.84:0/3625869136 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0cac30 0x7fceec069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.230+0000 7fcef0f2f640 1 -- 172.21.15.84:0/3625869136 >> 172.21.15.84:0/3625869136 conn(0x7fceec0ae510 msgr2=0x7fceec0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- 172.21.15.84:0/3625869136 shutdown_connections 2023-09-10T09:17:48.240 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- 172.21.15.84:0/3625869136 wait complete. 2023-09-10T09:17:48.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 Processor -- start 2023-09-10T09:17:48.241 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- start start 2023-09-10T09:17:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 0x7fceec14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:48.243 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 0x7fceec14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c5030 con 0x7fceec06a380 2023-09-10T09:17:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c6860 con 0x7fceec0cac30 2023-09-10T09:17:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcef0f2f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c5280 con 0x7fceec0abd70 2023-09-10T09:17:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceea59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:48.244 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceea59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec0c6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59886/0 (socket says 172.21.15.84:59886) 2023-09-10T09:17:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 0x7fceec14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcee3fff640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 0x7fceec14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceea59c640 1 -- 172.21.15.84:0/404271376 learned_addr learned my addr 172.21.15.84:0/404271376 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 -- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 msgr2=0x7fceec14b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.245 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 0x7fceec14b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 -- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 msgr2=0x7fceec0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 -- 172.21.15.84:0/404271376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40098e0 con 0x7fceec0cac30 2023-09-10T09:17:48.246 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcee3fff640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 0x7fceec14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T09:17:48.247 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fceead9d640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 0x7fceec14bd70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ac000 tx=0x7fcee4003c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:48.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.234+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40bc070 con 0x7fceec0cac30 2023-09-10T09:17:48.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcee40ad970 con 0x7fceec0cac30 2023-09-10T09:17:48.248 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee40add80 con 0x7fceec0cac30 2023-09-10T09:17:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcef0f2f640 1 -- 172.21.15.84:0/404271376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0c5560 con 0x7fceec0cac30 2023-09-10T09:17:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcef0f2f640 1 -- 172.21.15.84:0/404271376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec0c5b20 con 0x7fceec0cac30 2023-09-10T09:17:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcee40b4040 con 0x7fceec0cac30 2023-09-10T09:17:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcee2ffd640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 0x7fcecc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:48.249 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcee411dec0 con 0x7fceec0cac30 2023-09-10T09:17:48.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fceea59c640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 0x7fcecc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:48.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.238+0000 7fceea59c640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 0x7fcecc067fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007fd0 tx=0x7fcedc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:48.250 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.242+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec073400 con 0x7fceec0cac30 2023-09-10T09:17:48.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.518+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcee40eb770 con 0x7fceec0cac30 2023-09-10T09:17:48.760 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.754+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceec0b29a0 con 0x7fceec0cac30 2023-09-10T09:17:48.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.950+0000 7fcee2ffd640 1 -- 172.21.15.84:0/404271376 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16811 (secure 0 0 0) 0x7fcee40eed90 con 0x7fceec0cac30 2023-09-10T09:17:48.960 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:48.960 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:24.343665+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T09:17:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 msgr2=0x7fcecc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 0x7fcecc067fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fcedc007fd0 tx=0x7fcedc009040 comp rx=0 tx=0).stop 2023-09-10T09:17:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 msgr2=0x7fceec14bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:48.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 0x7fceec14bd70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcee40ac000 tx=0x7fcee4003c40 comp rx=0 tx=0).stop 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 shutdown_connections 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcecc065b20 0x7fcecc067fe0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fceec0cac30 0x7fceec14bd70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fceec0abd70 0x7fceec14b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 --2- 172.21.15.84:0/404271376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fceec06a380 0x7fceec0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:48.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 >> 172.21.15.84:0/404271376 conn(0x7fceec0ae510 msgr2=0x7fceec0c7930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:48.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 shutdown_connections 2023-09-10T09:17:48.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:48.954+0000 7fcee0ff9640 1 -- 172.21.15.84:0/404271376 wait complete. 2023-09-10T09:17:48.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-10T00:12:27.877151+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-10T00:14:04.782922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-09-10T00:14:05.890931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-10T09:17:48.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-10T09:17:49.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- 172.21.15.84:0/1925826480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62ac003980 msgr2=0x7f62ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 --2- 172.21.15.84:0/1925826480 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62ac003980 0x7f62ac003da0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009940 tx=0x7f62bc01c740 comp rx=0 tx=0).stop 2023-09-10T09:17:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c6c2b640 1 -- 172.21.15.84:0/1925826480 reap_dead start 2023-09-10T09:17:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- 172.21.15.84:0/1925826480 shutdown_connections 2023-09-10T09:17:49.154 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- 172.21.15.84:0/1925826480 >> 172.21.15.84:0/1925826480 conn(0x7f62b80553a0 msgr2=0x7f62b80557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- 172.21.15.84:0/1925826480 shutdown_connections 2023-09-10T09:17:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- 172.21.15.84:0/1925826480 wait complete. 2023-09-10T09:17:49.155 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 Processor -- start 2023-09-10T09:17:49.156 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.146+0000 7f62c742c640 1 -- start start 2023-09-10T09:17:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b80d9b20 0x7f62b80e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b80db980 0x7f62b80da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80e6680 con 0x7f62b80e6200 2023-09-10T09:17:49.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80dbe00 con 0x7f62b80d9b20 2023-09-10T09:17:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.154+0000 7f62c742c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b804d220 con 0x7f62b80db980 2023-09-10T09:17:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59912/0 (socket says 172.21.15.84:59912) 2023-09-10T09:17:49.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 -- 172.21.15.84:0/3008444359 learned_addr learned my addr 172.21.15.84:0/3008444359 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:49.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c642a640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b80d9b20 0x7f62b80e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 -- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b80db980 msgr2=0x7f62b80da2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-10T09:17:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b80db980 0x7f62b80da2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 -- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b80d9b20 msgr2=0x7f62b80e5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b80d9b20 0x7f62b80e5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:49.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 -- 172.21.15.84:0/3008444359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b804c610 con 0x7f62b80e6200 2023-09-10T09:17:49.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c5c29640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009ee0 tx=0x7f62b0011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:49.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0016450 con 0x7f62b80e6200 2023-09-10T09:17:49.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62b00165b0 con 0x7f62b80e6200 2023-09-10T09:17:49.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b804c8f0 con 0x7f62b80e6200 2023-09-10T09:17:49.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b804ceb0 con 0x7f62b80e6200 2023-09-10T09:17:49.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.158+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b00169c0 con 0x7f62b80e6200 2023-09-10T09:17:49.169 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.162+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a8005260 con 0x7f62b80e6200 2023-09-10T09:17:49.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.346+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f62b0016b20 con 0x7f62b80e6200 2023-09-10T09:17:49.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.346+0000 7f62b6ffd640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 0x7f62a4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:49.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.346+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f62b0088be0 con 0x7f62b80e6200 2023-09-10T09:17:49.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.346+0000 7f62c642a640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 0x7f62a4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:49.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:49.346+0000 7f62c642a640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 0x7f62a4067fe0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af000 tx=0x7f62bc0194e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:50.429 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.422+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f62b00565f0 con 0x7f62b80e6200 2023-09-10T09:17:50.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.662+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62a8005a90 con 0x7f62b80e6200 2023-09-10T09:17:50.798 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.790+0000 7f62b6ffd640 1 -- 172.21.15.84:0/3008444359 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62b002c020 con 0x7f62b80e6200 2023-09-10T09:17:50.799 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2023-09-10T09:17:50.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 msgr2=0x7f62a4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:50.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 0x7f62a4067fe0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af000 tx=0x7f62bc0194e0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 msgr2=0x7f62b80db440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:50.802 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009ee0 tx=0x7f62b0011ee0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 shutdown_connections 2023-09-10T09:17:50.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f62a4065b20 0x7f62a4067fe0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f62b80db980 0x7f62b80da2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62b80e6200 0x7f62b80db440 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.803 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 --2- 172.21.15.84:0/3008444359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62b80d9b20 0x7f62b80e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:50.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 >> 172.21.15.84:0/3008444359 conn(0x7f62b80553a0 msgr2=0x7f62b80dc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:50.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 shutdown_connections 2023-09-10T09:17:50.804 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.794+0000 7f62c742c640 1 -- 172.21.15.84:0/3008444359 wait complete. 2023-09-10T09:17:50.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-10T09:17:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.990+0000 7f4f11368640 1 -- 172.21.15.84:0/3300468307 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c15b4f0 msgr2=0x7f4f0c15b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:50.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.990+0000 7f4f11368640 1 --2- 172.21.15.84:0/3300468307 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c15b4f0 0x7f4f0c15b980 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4f04009c80 tx=0x7f4f0401ccb0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.998+0000 7f4f11368640 1 -- 172.21.15.84:0/3300468307 shutdown_connections 2023-09-10T09:17:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.998+0000 7f4f11368640 1 --2- 172.21.15.84:0/3300468307 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c15b4f0 0x7f4f0c15b980 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.998+0000 7f4f11368640 1 --2- 172.21.15.84:0/3300468307 >> v2:172.21.15.100:3300/0 conn(0x7f4f0c06d4d0 0x7f4f0c06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:50.998+0000 7f4f11368640 1 -- 172.21.15.84:0/3300468307 >> 172.21.15.84:0/3300468307 conn(0x7f4f0c0af230 msgr2=0x7f4f0c0af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.002+0000 7f4f11368640 1 -- 172.21.15.84:0/3300468307 shutdown_connections 2023-09-10T09:17:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.002+0000 7f4f11368640 1 -- 172.21.15.84:0/3300468307 wait complete. 2023-09-10T09:17:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.002+0000 7f4f11368640 1 Processor -- start 2023-09-10T09:17:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.002+0000 7f4f11368640 1 -- start start 2023-09-10T09:17:51.012 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c06d4d0 0x7f4f0c14e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c1579d0 0x7f4f0c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c14c830 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c151740 con 0x7f4f0c06d4d0 2023-09-10T09:17:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c151a20 con 0x7f4f0c1579d0 2023-09-10T09:17:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55756/0 (socket says 172.21.15.84:55756) 2023-09-10T09:17:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 -- 172.21.15.84:0/4233976412 learned_addr learned my addr 172.21.15.84:0/4233976412 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 -- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c1579d0 msgr2=0x7f4f0c070d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-10T09:17:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c1579d0 0x7f4f0c070d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 -- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c06d4d0 msgr2=0x7f4f0c14e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c06d4d0 0x7f4f0c14e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 -- 172.21.15.84:0/4233976412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40094a0 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f0b7fe640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f4f040b0040 tx=0x7f4f040092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f040b7890 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4f040b7ae0 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04004000 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f040098e0 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c151fe0 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.006+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c151b60 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.010+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f4f040bd020 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.010+0000 7f4f037fe640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 0x7f4eec0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.010+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f04121e80 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.019 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.010+0000 7f4f0affd640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 0x7f4eec0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:51.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.018+0000 7f4f0affd640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 0x7f4eec0680b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4efc007fd0 tx=0x7f4efc0079a0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.030+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f4f0c151b60 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.252 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.242+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f0c151b60 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.253 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.246+0000 7f4f037fe640 1 -- 172.21.15.84:0/4233976412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f040c5020 con 0x7f4f0c15b4f0 2023-09-10T09:17:51.254 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2023-09-10T09:17:51.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 msgr2=0x7f4eec0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:51.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 0x7f4eec0680b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4efc007fd0 tx=0x7f4efc0079a0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.257 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 msgr2=0x7f4f0c159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:51.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f4f040b0040 tx=0x7f4f040092c0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 shutdown_connections 2023-09-10T09:17:51.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4eec065bf0 0x7f4eec0680b0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4f0c15b4f0 0x7f4f0c159360 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.258 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f0c1579d0 0x7f4f0c070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 --2- 172.21.15.84:0/4233976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c06d4d0 0x7f4f0c14e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.250+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 >> 172.21.15.84:0/4233976412 conn(0x7f4f0c0af230 msgr2=0x7f4f0c06cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:51.259 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.254+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 shutdown_connections 2023-09-10T09:17:51.260 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.254+0000 7f4f11368640 1 -- 172.21.15.84:0/4233976412 wait complete. 2023-09-10T09:17:51.279 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-10T09:17:51.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.450+0000 7f1365308640 1 -- 172.21.15.84:0/1852023003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 msgr2=0x7f13600d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:51.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.450+0000 7f1365308640 1 --2- 172.21.15.84:0/1852023003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f13600d0370 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f1354005fd0 tx=0x7f135401c6a0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.458+0000 7f1365308640 1 -- 172.21.15.84:0/1852023003 shutdown_connections 2023-09-10T09:17:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.458+0000 7f1365308640 1 --2- 172.21.15.84:0/1852023003 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f13600d0370 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.458+0000 7f1365308640 1 -- 172.21.15.84:0/1852023003 >> 172.21.15.84:0/1852023003 conn(0x7f13600cd4e0 msgr2=0x7f13600cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.458+0000 7f1365308640 1 -- 172.21.15.84:0/1852023003 shutdown_connections 2023-09-10T09:17:51.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.462+0000 7f1365308640 1 -- 172.21.15.84:0/1852023003 wait complete. 2023-09-10T09:17:51.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.462+0000 7f1365308640 1 Processor -- start 2023-09-10T09:17:51.471 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- start start 2023-09-10T09:17:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13600cff30 0x7f136014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.473 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f136015ae60 0x7f13600b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601512e0 con 0x7f136006acd0 2023-09-10T09:17:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13601509d0 con 0x7f136015ae60 2023-09-10T09:17:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136014a9b0 con 0x7f13600cff30 2023-09-10T09:17:51.474 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55770/0 (socket says 172.21.15.84:55770) 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 -- 172.21.15.84:0/3447120859 learned_addr learned my addr 172.21.15.84:0/3447120859 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 -- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13600cff30 msgr2=0x7f136014a0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13600cff30 0x7f136014a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 -- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f136015ae60 msgr2=0x7f13600b0ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T09:17:51.475 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f136015ae60 0x7f13600b0ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:51.476 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 -- 172.21.15.84:0/3447120859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009560 con 0x7f136006acd0 2023-09-10T09:17:51.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f135effd640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f135000c460 tx=0x7f135000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:51.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13500052d0 con 0x7f136006acd0 2023-09-10T09:17:51.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1350005450 con 0x7f136006acd0 2023-09-10T09:17:51.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136014f950 con 0x7f136006acd0 2023-09-10T09:17:51.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1350012950 con 0x7f136006acd0 2023-09-10T09:17:51.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.466+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1360150f00 con 0x7f136006acd0 2023-09-10T09:17:51.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.470+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136006c610 con 0x7f136006acd0 2023-09-10T09:17:51.746 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1350012ab0 con 0x7f136006acd0 2023-09-10T09:17:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f13477fe640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 0x7f134c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1350083b20 con 0x7f136006acd0 2023-09-10T09:17:51.747 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f135e7fc640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 0x7f134c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f13500ade50 con 0x7f136006acd0 2023-09-10T09:17:51.748 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:51.738+0000 7f135e7fc640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 0x7f134c067fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1358007fd0 tx=0x7f1358001860 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:52.024 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1360073400 con 0x7f136006acd0 2023-09-10T09:17:52.025 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f13477fe640 1 -- 172.21.15.84:0/3447120859 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1350051380 con 0x7f136006acd0 2023-09-10T09:17:52.025 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2023-09-10T09:17:52.026 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 msgr2=0x7f134c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 0x7f134c067fe0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1358007fd0 tx=0x7f1358001860 comp rx=0 tx=0).stop 2023-09-10T09:17:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 msgr2=0x7f136014ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.027 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f135000c460 tx=0x7f135000c920 comp rx=0 tx=0).stop 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 shutdown_connections 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f134c065b20 0x7f134c067fe0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f136015ae60 0x7f13600b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13600cff30 0x7f136014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 --2- 172.21.15.84:0/3447120859 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f136006acd0 0x7f136014ced0 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.028 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 >> 172.21.15.84:0/3447120859 conn(0x7f13600cd4e0 msgr2=0x7f1360152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:52.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 shutdown_connections 2023-09-10T09:17:52.029 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.018+0000 7f1365308640 1 -- 172.21.15.84:0/3447120859 wait complete. 2023-09-10T09:17:52.057 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T09:17:52.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 -- 172.21.15.84:0/4260323412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a015c970 msgr2=0x7f57a006b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 --2- 172.21.15.84:0/4260323412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a015c970 0x7f57a006b1c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57a00c4840 tx=0x7f579801cb50 comp rx=0 tx=0).stop 2023-09-10T09:17:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 -- 172.21.15.84:0/4260323412 shutdown_connections 2023-09-10T09:17:52.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 --2- 172.21.15.84:0/4260323412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a015c970 0x7f57a006b1c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 --2- 172.21.15.84:0/4260323412 >> v2:172.21.15.84:3300/0 conn(0x7f57a00cd080 0x7f57a00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 --2- 172.21.15.84:0/4260323412 >> v2:172.21.15.100:3300/0 conn(0x7f57a006cec0 0x7f57a006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.214+0000 7f57a7c73640 1 -- 172.21.15.84:0/4260323412 >> 172.21.15.84:0/4260323412 conn(0x7f57a00ca240 msgr2=0x7f57a00ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:52.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- 172.21.15.84:0/4260323412 shutdown_connections 2023-09-10T09:17:52.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- 172.21.15.84:0/4260323412 wait complete. 2023-09-10T09:17:52.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 Processor -- start 2023-09-10T09:17:52.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- start start 2023-09-10T09:17:52.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 0x7f57a01f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a5a0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 0x7f57a01f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a5a0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 0x7f57a01f61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:42616/0 (socket says 172.21.15.84:42616) 2023-09-10T09:17:52.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a520e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a520e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55794/0 (socket says 172.21.15.84:55794) 2023-09-10T09:17:52.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a5a0f640 1 -- 172.21.15.84:0/2070724346 learned_addr learned my addr 172.21.15.84:0/2070724346 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:52.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a0158090 0x7f57a00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a0158540 con 0x7f57a015c970 2023-09-10T09:17:52.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c7220 con 0x7f57a00cd080 2023-09-10T09:17:52.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.218+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00c6610 con 0x7f57a0158090 2023-09-10T09:17:52.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a6210640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a0158090 0x7f57a00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 -- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a0158090 msgr2=0x7f57a00c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a0158090 0x7f57a00c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.231 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 -- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 msgr2=0x7f57a01f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 0x7f57a01f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798009820 con 0x7f57a015c970 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a520e640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f5790009e70 tx=0x7f579000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000ccc0 con 0x7f57a015c970 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5790004020 con 0x7f57a015c970 2023-09-10T09:17:52.232 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790004410 con 0x7f57a015c970 2023-09-10T09:17:52.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00c68f0 con 0x7f57a015c970 2023-09-10T09:17:52.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a00c6eb0 con 0x7f57a015c970 2023-09-10T09:17:52.233 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.222+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a00c7070 con 0x7f57a015c970 2023-09-10T09:17:52.264 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.258+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f57900137d0 con 0x7f57a015c970 2023-09-10T09:17:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.258+0000 7f57967fc640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 0x7f5784068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.258+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5790088440 con 0x7f57a015c970 2023-09-10T09:17:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.258+0000 7f57a5a0f640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 0x7f5784068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.265 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.258+0000 7f57a5a0f640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 0x7f5784068030 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f579c005bd0 tx=0x7f579c0091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:52.299 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.290+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5790055d80 con 0x7f57a015c970 2023-09-10T09:17:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.586+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57a006acf0 con 0x7f57a015c970 2023-09-10T09:17:52.638 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.630+0000 7f57967fc640 1 -- 172.21.15.84:0/2070724346 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f57900593a0 con 0x7f57a015c970 2023-09-10T09:17:52.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:52.639 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T09:17:52.639 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T09:17:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 msgr2=0x7f5784068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 0x7f5784068030 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f579c005bd0 tx=0x7f579c0091e0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 msgr2=0x7f57a0157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f5790009e70 tx=0x7f579000ed90 comp rx=0 tx=0).stop 2023-09-10T09:17:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 shutdown_connections 2023-09-10T09:17:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5784065b70 0x7f5784068030 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f57a0158090 0x7f57a00c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a015c970 0x7f57a0157b50 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 --2- 172.21.15.84:0/2070724346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57a00cd080 0x7f57a01f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 >> 172.21.15.84:0/2070724346 conn(0x7f57a00ca240 msgr2=0x7f57a0159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:52.643 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 shutdown_connections 2023-09-10T09:17:52.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.634+0000 7f57a7c73640 1 -- 172.21.15.84:0/2070724346 wait complete. 2023-09-10T09:17:52.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T09:17:52.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- 172.21.15.84:0/2652182787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 msgr2=0x7f889c06ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 --2- 172.21.15.84:0/2652182787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c06ff30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f888c009870 tx=0x7f888c01c7d0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.814 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- 172.21.15.84:0/2652182787 shutdown_connections 2023-09-10T09:17:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 --2- 172.21.15.84:0/2652182787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c06ff30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 --2- 172.21.15.84:0/2652182787 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 0x7f889c0ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- 172.21.15.84:0/2652182787 >> 172.21.15.84:0/2652182787 conn(0x7f889c0cc670 msgr2=0x7f889c0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- 172.21.15.84:0/2652182787 shutdown_connections 2023-09-10T09:17:52.815 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- 172.21.15.84:0/2652182787 wait complete. 2023-09-10T09:17:52.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 Processor -- start 2023-09-10T09:17:52.816 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.806+0000 7f88a3357640 1 -- start start 2023-09-10T09:17:52.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 0x7f889c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.818 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c3c80 con 0x7f889c15b460 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c3f20 con 0x7f889c06fad0 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0c4200 con 0x7f889c1579f0 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55802/0 (socket says 172.21.15.84:55802) 2023-09-10T09:17:52.819 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 -- 172.21.15.84:0/3726319984 learned_addr learned my addr 172.21.15.84:0/3726319984 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:52.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a10f3640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a08f2640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 0x7f889c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 -- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 msgr2=0x7f889c145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 0x7f889c145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.820 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 -- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 msgr2=0x7f889c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 -- 172.21.15.84:0/3726319984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0094a0 con 0x7f889c15b460 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a18f4640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f889400caa0 tx=0x7f889400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400a840 con 0x7f889c15b460 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f889400aab0 con 0x7f889c15b460 2023-09-10T09:17:52.821 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c0c44e0 con 0x7f889c15b460 2023-09-10T09:17:52.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894012420 con 0x7f889c15b460 2023-09-10T09:17:52.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0c4aa0 con 0x7f889c15b460 2023-09-10T09:17:52.822 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.810+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c0c4c90 con 0x7f889c15b460 2023-09-10T09:17:52.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.826+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f889401b400 con 0x7f889c15b460 2023-09-10T09:17:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.826+0000 7f8891ffb640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 0x7f8880067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.830+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f88940840b0 con 0x7f889c15b460 2023-09-10T09:17:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.830+0000 7f88a10f3640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 0x7f8880067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:52.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.830+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f8894084530 con 0x7f889c15b460 2023-09-10T09:17:52.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:52.830+0000 7f88a10f3640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 0x7f8880067fe0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f889c1569b0 tx=0x7f8898009110 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:53.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.050+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f889c0712c0 con 0x7f889c15b460 2023-09-10T09:17:53.118 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.110+0000 7f8891ffb640 1 -- 172.21.15.84:0/3726319984 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16811 (secure 0 0 0) 0x7f88940519c0 con 0x7f889c15b460 2023-09-10T09:17:53.119 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:53.119 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:24.343665+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T09:17:53.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 msgr2=0x7f8880067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 0x7f8880067fe0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f889c1569b0 tx=0x7f8898009110 comp rx=0 tx=0).stop 2023-09-10T09:17:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 msgr2=0x7f889c0c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f889400caa0 tx=0x7f889400cb90 comp rx=0 tx=0).stop 2023-09-10T09:17:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 shutdown_connections 2023-09-10T09:17:53.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8880065b20 0x7f8880067fe0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f889c15b460 0x7f889c0c3740 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f889c1579f0 0x7f889c145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 --2- 172.21.15.84:0/3726319984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f889c06fad0 0x7f889c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 >> 172.21.15.84:0/3726319984 conn(0x7f889c0cc670 msgr2=0x7f889c1525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:53.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 shutdown_connections 2023-09-10T09:17:53.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.114+0000 7f88a3357640 1 -- 172.21.15.84:0/3726319984 wait complete. 2023-09-10T09:17:53.151 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-10T09:17:53.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T09:17:53.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.330+0000 7f764f7e5640 1 -- 172.21.15.84:0/301506993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7634003980 msgr2=0x7f7634003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.330+0000 7f764f7e5640 1 --2- 172.21.15.84:0/301506993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7634003980 0x7f7634003da0 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f764400c2e0 tx=0x7f764401d040 comp rx=0 tx=0).stop 2023-09-10T09:17:53.338 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.330+0000 7f764dd82640 1 -- 172.21.15.84:0/301506993 reap_dead start 2023-09-10T09:17:53.339 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.334+0000 7f764f7e5640 1 -- 172.21.15.84:0/301506993 shutdown_connections 2023-09-10T09:17:53.340 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.334+0000 7f764f7e5640 1 -- 172.21.15.84:0/301506993 >> 172.21.15.84:0/301506993 conn(0x7f76480cc670 msgr2=0x7f76480cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:53.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- 172.21.15.84:0/301506993 shutdown_connections 2023-09-10T09:17:53.345 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- 172.21.15.84:0/301506993 wait complete. 2023-09-10T09:17:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 Processor -- start 2023-09-10T09:17:53.346 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- start start 2023-09-10T09:17:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7634003980 0x7f76480c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f764806bae0 0x7f764806bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648150700 con 0x7f76480c5350 2023-09-10T09:17:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764806c4a0 con 0x7f7634003980 2023-09-10T09:17:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764f7e5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76480c2790 con 0x7f764806bae0 2023-09-10T09:17:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:53.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55812/0 (socket says 172.21.15.84:55812) 2023-09-10T09:17:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 -- 172.21.15.84:0/1647015688 learned_addr learned my addr 172.21.15.84:0/1647015688 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 -- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f764806bae0 msgr2=0x7f764806bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f764806bae0 0x7f764806bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 -- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7634003980 msgr2=0x7f76480c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7634003980 0x7f76480c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.338+0000 7f764cd80640 1 -- 172.21.15.84:0/1647015688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764814fa80 con 0x7f76480c5350 2023-09-10T09:17:53.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.342+0000 7f764cd80640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f763800b4c0 tx=0x7f763800b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.342+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011830 con 0x7f76480c5350 2023-09-10T09:17:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.342+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7638011a80 con 0x7f76480c5350 2023-09-10T09:17:53.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.342+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7638011e90 con 0x7f76480c5350 2023-09-10T09:17:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.346+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764814fd60 con 0x7f76480c5350 2023-09-10T09:17:53.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.346+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7648150320 con 0x7f76480c5350 2023-09-10T09:17:53.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.346+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76480712c0 con 0x7f76480c5350 2023-09-10T09:17:53.425 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.418+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7638024440 con 0x7f76480c5350 2023-09-10T09:17:53.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.418+0000 7f763dffb640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 0x7f762c068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.426 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.418+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7638083d60 con 0x7f76480c5350 2023-09-10T09:17:53.427 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.418+0000 7f764d581640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 0x7f762c068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:53.428 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.422+0000 7f764d581640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 0x7f762c068060 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f76440ac000 tx=0x7f7634005800 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:53.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.458+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f76380515b0 con 0x7f76480c5350 2023-09-10T09:17:53.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.762+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76481504b0 con 0x7f76480c5350 2023-09-10T09:17:53.770 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.762+0000 7f763dffb640 1 -- 172.21.15.84:0/1647015688 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7f7638054bd0 con 0x7f76480c5350 2023-09-10T09:17:53.771 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:53.771 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T09:17:53.771 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T09:17:53.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 msgr2=0x7f762c068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 0x7f762c068060 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f76440ac000 tx=0x7f7634005800 comp rx=0 tx=0).stop 2023-09-10T09:17:53.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 msgr2=0x7f76480c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f763800b4c0 tx=0x7f763800b980 comp rx=0 tx=0).stop 2023-09-10T09:17:53.774 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 shutdown_connections 2023-09-10T09:17:53.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f762c065ba0 0x7f762c068060 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f764806bae0 0x7f764806bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f76480c5350 0x7f76480c57b0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 --2- 172.21.15.84:0/1647015688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7634003980 0x7f76480c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 >> 172.21.15.84:0/1647015688 conn(0x7f76480cc670 msgr2=0x7f76480cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:53.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 shutdown_connections 2023-09-10T09:17:53.776 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.766+0000 7f764f7e5640 1 -- 172.21.15.84:0/1647015688 wait complete. 2023-09-10T09:17:53.797 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T09:17:53.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 -- 172.21.15.84:0/2275573752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70159020 msgr2=0x7fac700cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 --2- 172.21.15.84:0/2275573752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70159020 0x7fac700cdf30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fac700c23f0 tx=0x7fac5c01c770 comp rx=0 tx=0).stop 2023-09-10T09:17:53.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 -- 172.21.15.84:0/2275573752 shutdown_connections 2023-09-10T09:17:53.959 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 --2- 172.21.15.84:0/2275573752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70159020 0x7fac700cdf30 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 --2- 172.21.15.84:0/2275573752 >> v2:172.21.15.84:3300/0 conn(0x7fac700c9b60 0x7fac7015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.950+0000 7fac76f17640 1 -- 172.21.15.84:0/2275573752 >> 172.21.15.84:0/2275573752 conn(0x7fac700cb7c0 msgr2=0x7fac700cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:53.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.954+0000 7fac76f17640 1 -- 172.21.15.84:0/2275573752 shutdown_connections 2023-09-10T09:17:53.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.954+0000 7fac76f17640 1 -- 172.21.15.84:0/2275573752 wait complete. 2023-09-10T09:17:53.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.954+0000 7fac76f17640 1 Processor -- start 2023-09-10T09:17:53.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.954+0000 7fac76f17640 1 -- start start 2023-09-10T09:17:53.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac700ce470 0x7fac7006c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:53.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac70159020 0x7fac70150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:53.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55824/0 (socket says 172.21.15.84:55824) 2023-09-10T09:17:53.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 -- 172.21.15.84:0/3223986972 learned_addr learned my addr 172.21.15.84:0/3223986972 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7014eb90 con 0x7fac700c9b60 2023-09-10T09:17:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac6ffff640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac700ce470 0x7fac7006c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7014df10 con 0x7fac700ce470 2023-09-10T09:17:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7014e1f0 con 0x7fac70159020 2023-09-10T09:17:53.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac754b4640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac70159020 0x7fac70150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:53.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 -- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac70159020 msgr2=0x7fac70150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac70159020 0x7fac70150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 -- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac700ce470 msgr2=0x7fac7006c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:53.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac700ce470 0x7fac7006c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:53.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0094a0 con 0x7fac700c9b60 2023-09-10T09:17:53.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.958+0000 7fac74cb3640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b4a0 tx=0x7fac6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.962+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64010610 con 0x7fac700c9b60 2023-09-10T09:17:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.962+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fac64010860 con 0x7fac700c9b60 2023-09-10T09:17:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.962+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7014e4d0 con 0x7fac700c9b60 2023-09-10T09:17:53.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.966+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64010cb0 con 0x7fac700c9b60 2023-09-10T09:17:53.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.966+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7006c860 con 0x7fac700c9b60 2023-09-10T09:17:53.973 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:53.966+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac700c21e0 con 0x7fac700c9b60 2023-09-10T09:17:54.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.046+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fac64019450 con 0x7fac700c9b60 2023-09-10T09:17:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.046+0000 7fac6d7fa640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 0x7fac54067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.046+0000 7fac6ffff640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 0x7fac54067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.046+0000 7fac6ffff640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 0x7fac54067fe0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0af000 tx=0x7fac5c01afb0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.074+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac64054f60 con 0x7fac700c9b60 2023-09-10T09:17:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.074+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fac640512a0 con 0x7fac700c9b60 2023-09-10T09:17:54.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac7006f3a0 con 0x7fac700c9b60 2023-09-10T09:17:54.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac6d7fa640 1 -- 172.21.15.84:0/3223986972 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4910 (secure 0 0 0) 0x7fac640548c0 con 0x7fac700c9b60 2023-09-10T09:17:54.334 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:54.334 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-10T00:14:06.904563+0000","modified":"2023-09-10T00:14:08.908584+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5619":{"gid":5619,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.84:6836/2849085608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2849085608},{"type":"v1","addr":"172.21.15.84:6836","nonce":2849085608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-09-10T09:17:54.335 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 16 2023-09-10T09:17:54.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 msgr2=0x7fac54067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.335 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 0x7fac54067fe0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0af000 tx=0x7fac5c01afb0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 msgr2=0x7fac701492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b4a0 tx=0x7fac6400b960 comp rx=0 tx=0).stop 2023-09-10T09:17:54.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 shutdown_connections 2023-09-10T09:17:54.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fac54065b20 0x7fac54067fe0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.336 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac70159020 0x7fac70150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac700ce470 0x7fac7006c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 --2- 172.21.15.84:0/3223986972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fac700c9b60 0x7fac701492c0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 >> 172.21.15.84:0/3223986972 conn(0x7fac700cb7c0 msgr2=0x7fac7006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:54.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 shutdown_connections 2023-09-10T09:17:54.337 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.326+0000 7fac76f17640 1 -- 172.21.15.84:0/3223986972 wait complete. 2023-09-10T09:17:54.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T09:17:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 -- 172.21.15.84:0/2475891014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 msgr2=0x7f54240af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2475891014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240af520 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f5420009900 tx=0x7f542002d8f0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 -- 172.21.15.84:0/2475891014 shutdown_connections 2023-09-10T09:17:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2475891014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240af520 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 -- 172.21.15.84:0/2475891014 >> 172.21.15.84:0/2475891014 conn(0x7f54240cc670 msgr2=0x7f54240cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 -- 172.21.15.84:0/2475891014 shutdown_connections 2023-09-10T09:17:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.506+0000 7f542b3ba640 1 -- 172.21.15.84:0/2475891014 wait complete. 2023-09-10T09:17:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 Processor -- start 2023-09-10T09:17:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 -- start start 2023-09-10T09:17:54.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55840/0 (socket says 172.21.15.84:55840) 2023-09-10T09:17:54.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 -- 172.21.15.84:0/2284966126 learned_addr learned my addr 172.21.15.84:0/2284966126 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:54.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54240c7820 0x7f542414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54240c6610 0x7f5424069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c4660 con 0x7f542406fd30 2023-09-10T09:17:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542414f0b0 con 0x7f54240c7820 2023-09-10T09:17:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240c5570 con 0x7f54240c6610 2023-09-10T09:17:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429957640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54240c6610 0x7f5424069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5428955640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54240c7820 0x7f542414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 -- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54240c6610 msgr2=0x7f5424069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54240c6610 0x7f5424069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 -- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54240c7820 msgr2=0x7f542414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54240c7820 0x7f542414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009560 con 0x7f542406fd30 2023-09-10T09:17:54.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5429156640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f54200c1040 tx=0x7f54200b6860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420003a10 con 0x7f542406fd30 2023-09-10T09:17:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5420003c60 con 0x7f542406fd30 2023-09-10T09:17:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.510+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54240c5850 con 0x7f542406fd30 2023-09-10T09:17:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200c7460 con 0x7f542406fd30 2023-09-10T09:17:54.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240c5e10 con 0x7f542406fd30 2023-09-10T09:17:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f54200c5070 con 0x7f542406fd30 2023-09-10T09:17:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5419ffb640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 0x7f5408067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f542012ea70 con 0x7f542406fd30 2023-09-10T09:17:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5428955640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 0x7f5408067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54240712c0 con 0x7f542406fd30 2023-09-10T09:17:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.514+0000 7f5428955640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 0x7f5408067fe0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f54240b1d30 tx=0x7f541c009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:54.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.522+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f54200fc540 con 0x7f542406fd30 2023-09-10T09:17:54.767 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.758+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5424073400 con 0x7f542406fd30 2023-09-10T09:17:54.769 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f5419ffb640 1 -- 172.21.15.84:0/2284966126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16811 (secure 0 0 0) 0x7f54200c3030 con 0x7f542406fd30 2023-09-10T09:17:54.770 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:17:54.770 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":42,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T00:14:24.343665+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-09-10T00:14:04.782922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-09-10T00:14:05.890931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T09:17:54.771 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 msgr2=0x7f5408067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 0x7f5408067fe0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f54240b1d30 tx=0x7f541c009040 comp rx=0 tx=0).stop 2023-09-10T09:17:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 msgr2=0x7f54240c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f54200c1040 tx=0x7f54200b6860 comp rx=0 tx=0).stop 2023-09-10T09:17:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 shutdown_connections 2023-09-10T09:17:54.772 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5408065b20 0x7f5408067fe0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f54240c6610 0x7f5424069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54240c7820 0x7f542414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 --2- 172.21.15.84:0/2284966126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f542406fd30 0x7f54240c4eb0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 >> 172.21.15.84:0/2284966126 conn(0x7f54240cc670 msgr2=0x7f54240ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.762+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 shutdown_connections 2023-09-10T09:17:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.766+0000 7f542b3ba640 1 -- 172.21.15.84:0/2284966126 wait complete. 2023-09-10T09:17:54.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-10T09:17:54.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 -- 172.21.15.84:0/218867753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 msgr2=0x7f9fb815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 --2- 172.21.15.84:0/218867753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 0x7f9fb815d250 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009900 tx=0x7f9fa801c890 comp rx=0 tx=0).stop 2023-09-10T09:17:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 -- 172.21.15.84:0/218867753 shutdown_connections 2023-09-10T09:17:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 --2- 172.21.15.84:0/218867753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 0x7f9fb815d250 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 --2- 172.21.15.84:0/218867753 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb80b07b0 0x7f9fb80b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 -- 172.21.15.84:0/218867753 >> 172.21.15.84:0/218867753 conn(0x7f9fb80cb7c0 msgr2=0x7f9fb80cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 -- 172.21.15.84:0/218867753 shutdown_connections 2023-09-10T09:17:54.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.938+0000 7f9fc0559640 1 -- 172.21.15.84:0/218867753 wait complete. 2023-09-10T09:17:54.953 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.946+0000 7f9fc0559640 1 Processor -- start 2023-09-10T09:17:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.954+0000 7f9fc0559640 1 -- start start 2023-09-10T09:17:54.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 0x7f9fb80b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb80b07b0 0x7f9fb80b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80b2b90 con 0x7f9fb80ad740 2023-09-10T09:17:54.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80b39b0 con 0x7f9fb815c0c0 2023-09-10T09:17:54.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80b21c0 con 0x7f9fb80b07b0 2023-09-10T09:17:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.967 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:42670/0 (socket says 172.21.15.84:42670) 2023-09-10T09:17:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 -- 172.21.15.84:0/575660123 learned_addr learned my addr 172.21.15.84:0/575660123 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 -- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb80b07b0 msgr2=0x7f9fb80b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb80b07b0 0x7f9fb80b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 -- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 msgr2=0x7f9fb80b2650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T09:17:54.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 0x7f9fb80b2650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:54.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 -- 172.21.15.84:0/575660123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8009560 con 0x7f9fb815c0c0 2023-09-10T09:17:54.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fbeaf6640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e8f0 tx=0x7f9fb400edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:54.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400ccc0 con 0x7f9fb815c0c0 2023-09-10T09:17:54.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb8151810 con 0x7f9fb815c0c0 2023-09-10T09:17:54.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb806b580 con 0x7f9fb815c0c0 2023-09-10T09:17:54.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9fb400ce20 con 0x7f9fb815c0c0 2023-09-10T09:17:54.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.958+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4005280 con 0x7f9fb815c0c0 2023-09-10T09:17:54.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8073390 con 0x7f9fb815c0c0 2023-09-10T09:17:54.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f9fb40053e0 con 0x7f9fb815c0c0 2023-09-10T09:17:54.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9faeffd640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 0x7f9f9c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:54.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fb4014070 con 0x7f9fb815c0c0 2023-09-10T09:17:54.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9fbe2f5640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 0x7f9f9c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:54.972 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.962+0000 7f9fbe2f5640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 0x7f9f9c068010 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0001b60 tx=0x7f9fb0007d30 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:54.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:54.978+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f9fb4054f20 con 0x7f9fb815c0c0 2023-09-10T09:17:55.291 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.282+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9fb815d550 con 0x7f9fb815c0c0 2023-09-10T09:17:55.694 INFO:tasks.ceph.mon.a.smithi084.stderr:2023-09-10T09:17:55.686+0000 7fd319008640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-10T09:17:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.718+0000 7f9faeffd640 1 -- 172.21.15.84:0/575660123 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9fb4054d40 con 0x7f9fb815c0c0 2023-09-10T09:17:55.726 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-10T09:17:55.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.722+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 msgr2=0x7f9f9c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:55.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.722+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 0x7f9f9c068010 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0001b60 tx=0x7f9fb0007d30 comp rx=0 tx=0).stop 2023-09-10T09:17:55.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.722+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 msgr2=0x7f9fb81512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:55.730 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.722+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400e8f0 tx=0x7f9fb400edb0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 shutdown_connections 2023-09-10T09:17:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f9f9c065b50 0x7f9f9c068010 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb815c0c0 0x7f9fb81512d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb80b07b0 0x7f9fb80b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 --2- 172.21.15.84:0/575660123 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9fb80ad740 0x7f9fb80b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 >> 172.21.15.84:0/575660123 conn(0x7f9fb80cb7c0 msgr2=0x7f9fb8158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 shutdown_connections 2023-09-10T09:17:55.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.726+0000 7f9fc0559640 1 -- 172.21.15.84:0/575660123 wait complete. 2023-09-10T09:17:55.767 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-10T09:17:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/2723337197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0ac3f0 msgr2=0x7f96bc15c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:55.925 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/2723337197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc15c030 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009bc0 tx=0x7f96b401cb80 comp rx=0 tx=0).stop 2023-09-10T09:17:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/2723337197 shutdown_connections 2023-09-10T09:17:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/2723337197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc15c030 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.926 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/2723337197 >> 172.21.15.84:0/2723337197 conn(0x7f96bc0c9a00 msgr2=0x7f96bc0c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:55.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/2723337197 shutdown_connections 2023-09-10T09:17:55.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/2723337197 wait complete. 2023-09-10T09:17:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 Processor -- start 2023-09-10T09:17:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- start start 2023-09-10T09:17:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 0x7f96bc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:55.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0cc5d0 0x7f96bc14c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:55.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0afba0 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0afdf0 con 0x7f96bc0cc5d0 2023-09-10T09:17:55.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0b00d0 con 0x7f96bc06da10 2023-09-10T09:17:55.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:55.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55854/0 (socket says 172.21.15.84:55854) 2023-09-10T09:17:55.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 -- 172.21.15.84:0/1827130297 learned_addr learned my addr 172.21.15.84:0/1827130297 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:55.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c12f9640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0cc5d0 0x7f96bc14c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:55.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c0af8640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 0x7f96bc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:55.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 -- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 msgr2=0x7f96bc155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:55.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 0x7f96bc155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 -- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0cc5d0 msgr2=0x7f96bc14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:55.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0cc5d0 0x7f96bc14c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:55.936 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 -- 172.21.15.84:0/1827130297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4009820 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c0af8640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 0x7f96bc155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:17:55.937 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96bbfff640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c410 tx=0x7f96a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:55.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8011790 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.938 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96a80119e0 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8011dd0 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc0b03b0 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.918+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc0b0970 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc09b080 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f96a801c460 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96b97fa640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 0x7f96a0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96c0af8640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 0x7f96a0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:55.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f96a80834f0 con 0x7f96bc0ac3f0 2023-09-10T09:17:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.922+0000 7f96c0af8640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 0x7f96a0067fe0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f96bc152560 tx=0x7f96b0009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:55.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:55.926+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f96a8050de0 con 0x7f96bc0ac3f0 2023-09-10T09:17:56.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.114+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f96bc0b2f00 con 0x7f96bc0ac3f0 2023-09-10T09:17:56.346 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2023-09-10T09:17:56.775 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.766+0000 7f96b97fa640 1 -- 172.21.15.84:0/1827130297 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96a8054400 con 0x7f96bc0ac3f0 2023-09-10T09:17:56.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 msgr2=0x7f96a0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:56.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 0x7f96a0067fe0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f96bc152560 tx=0x7f96b0009040 comp rx=0 tx=0).stop 2023-09-10T09:17:56.779 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 msgr2=0x7f96bc14c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:56.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c410 tx=0x7f96a800c8d0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 shutdown_connections 2023-09-10T09:17:56.780 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f96a0065b20 0x7f96a0067fe0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96bc0cc5d0 0x7f96bc14c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.781 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f96bc0ac3f0 0x7f96bc14c1e0 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 --2- 172.21.15.84:0/1827130297 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f96bc06da10 0x7f96bc155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 >> 172.21.15.84:0/1827130297 conn(0x7f96bc0c9a00 msgr2=0x7f96bc15a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:56.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 shutdown_connections 2023-09-10T09:17:56.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.770+0000 7f96c2d5c640 1 -- 172.21.15.84:0/1827130297 wait complete. 2023-09-10T09:17:56.801 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-10T09:17:56.931 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- 172.21.15.84:0/2114598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c0c8350 msgr2=0x7f796c0c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:56.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 --2- 172.21.15.84:0/2114598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c0c8350 0x7f796c0c8800 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f7960009900 tx=0x7f796001c880 comp rx=0 tx=0).stop 2023-09-10T09:17:56.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- 172.21.15.84:0/2114598402 shutdown_connections 2023-09-10T09:17:56.932 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 --2- 172.21.15.84:0/2114598402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c0c8350 0x7f796c0c8800 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 --2- 172.21.15.84:0/2114598402 >> v2:172.21.15.100:3300/0 conn(0x7f796c156720 0x7f796c06bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- 172.21.15.84:0/2114598402 >> 172.21.15.84:0/2114598402 conn(0x7f796c0c91a0 msgr2=0x7f796c0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:56.933 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- 172.21.15.84:0/2114598402 shutdown_connections 2023-09-10T09:17:56.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- 172.21.15.84:0/2114598402 wait complete. 2023-09-10T09:17:56.934 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 Processor -- start 2023-09-10T09:17:56.935 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 -- start start 2023-09-10T09:17:56.939 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 0x7f796c1476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.922+0000 7f797306e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f796c0c8350 0x7f796c155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:56.940 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c147c00 con 0x7f796c156720 2023-09-10T09:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0cbbd0 con 0x7f796c0c8350 2023-09-10T09:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0cbeb0 con 0x7f796c0b1a40 2023-09-10T09:17:56.941 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55868/0 (socket says 172.21.15.84:55868) 2023-09-10T09:17:56.942 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 -- 172.21.15.84:0/1981535836 learned_addr learned my addr 172.21.15.84:0/1981535836 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f796bfff640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f796c0c8350 0x7f796c155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f7970e0a640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 0x7f796c1476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:56.943 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 -- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 msgr2=0x7f796c1476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 0x7f796c1476c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.944 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 -- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f796c0c8350 msgr2=0x7f796c155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f796c0c8350 0x7f796c155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 -- 172.21.15.84:0/1981535836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009560 con 0x7f796c156720 2023-09-10T09:17:56.945 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f7970e0a640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 0x7f796c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797160b640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f795c001570 tx=0x7f795c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c003db0 con 0x7f796c156720 2023-09-10T09:17:56.946 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f795c005070 con 0x7f796c156720 2023-09-10T09:17:56.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c0cc190 con 0x7f796c156720 2023-09-10T09:17:56.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c005480 con 0x7f796c156720 2023-09-10T09:17:56.947 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c154860 con 0x7f796c156720 2023-09-10T09:17:56.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c154a50 con 0x7f796c156720 2023-09-10T09:17:56.948 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f795c0055e0 con 0x7f796c156720 2023-09-10T09:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 0x7f7958067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f795c083070 con 0x7f796c156720 2023-09-10T09:17:56.949 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f7970e0a640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 0x7f7958067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.926+0000 7f7970e0a640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 0x7f7958067fe0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7964005fd0 tx=0x7f7964005de0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:56.950 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:56.930+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f795c050790 con 0x7f796c156720 2023-09-10T09:17:57.095 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.086+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f796c04d8c0 con 0x7f796c156720 2023-09-10T09:17:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.990+0000 7f79697fa640 1 -- 172.21.15.84:0/1981535836 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f795c053db0 con 0x7f796c156720 2023-09-10T09:17:57.999 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2023-09-10T09:17:58.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 msgr2=0x7f7958067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 0x7f7958067fe0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7964005fd0 tx=0x7f7964005de0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 msgr2=0x7f796c157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f795c001570 tx=0x7f795c00cd20 comp rx=0 tx=0).stop 2023-09-10T09:17:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 shutdown_connections 2023-09-10T09:17:58.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7958065b20 0x7f7958067fe0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f796c156720 0x7f796c157d80 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f796c0c8350 0x7f796c155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 --2- 172.21.15.84:0/1981535836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f796c0b1a40 0x7f796c1476c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 >> 172.21.15.84:0/1981535836 conn(0x7f796c0c91a0 msgr2=0x7f796c06d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 shutdown_connections 2023-09-10T09:17:58.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:57.994+0000 7f797306e640 1 -- 172.21.15.84:0/1981535836 wait complete. 2023-09-10T09:17:58.019 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-10T09:17:58.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 -- 172.21.15.84:0/651535896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 msgr2=0x7f7dd0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:58.151 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/651535896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7dd0003da0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009b60 tx=0x7f7dd801d220 comp rx=0 tx=0).stop 2023-09-10T09:17:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 -- 172.21.15.84:0/651535896 shutdown_connections 2023-09-10T09:17:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/651535896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7dd0003da0 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 -- 172.21.15.84:0/651535896 >> 172.21.15.84:0/651535896 conn(0x7f7de80c91a0 msgr2=0x7f7de80c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 -- 172.21.15.84:0/651535896 shutdown_connections 2023-09-10T09:17:58.153 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.142+0000 7f7dee4bc640 1 -- 172.21.15.84:0/651535896 wait complete. 2023-09-10T09:17:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 Processor -- start 2023-09-10T09:17:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- start start 2023-09-10T09:17:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:58.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80c4400 0x7f7de80a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de81f4760 0x7f7de81f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de81f5120 con 0x7f7dd0003980 2023-09-10T09:17:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c55b0 con 0x7f7de80c4400 2023-09-10T09:17:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c49a0 con 0x7f7de81f4760 2023-09-10T09:17:58.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55890/0 (socket says 172.21.15.84:55890) 2023-09-10T09:17:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 -- 172.21.15.84:0/1833983593 learned_addr learned my addr 172.21.15.84:0/1833983593 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de77fe640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80c4400 0x7f7de80a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:58.160 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7deca59640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de81f4760 0x7f7de81f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 -- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de81f4760 msgr2=0x7f7de81f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de81f4760 0x7f7de81f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 -- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80c4400 msgr2=0x7f7de80a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80c4400 0x7f7de80a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:58.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 -- 172.21.15.84:0/1833983593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80c4c80 con 0x7f7dd0003980 2023-09-10T09:17:58.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de7fff640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009a80 tx=0x7f7dd80056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:58.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80bc070 con 0x7f7dd0003980 2023-09-10T09:17:58.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7dd80a5e90 con 0x7f7dd0003980 2023-09-10T09:17:58.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de80c4f60 con 0x7f7dd0003980 2023-09-10T09:17:58.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8004c20 con 0x7f7dd0003980 2023-09-10T09:17:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de80adb30 con 0x7f7dd0003980 2023-09-10T09:17:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804d8c0 con 0x7f7dd0003980 2023-09-10T09:17:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7dd80b3070 con 0x7f7dd0003980 2023-09-10T09:17:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.146+0000 7f7de4ff9640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 0x7f7dd4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:58.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.150+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7dd811d360 con 0x7f7dd0003980 2023-09-10T09:17:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.150+0000 7f7de77fe640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 0x7f7dd4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.150+0000 7f7de77fe640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 0x7f7dd4067fe0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0017b0 tx=0x7f7ddc0016a0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:58.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.154+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7dd80eacb0 con 0x7f7dd0003980 2023-09-10T09:17:58.316 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.306+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7de81409a0 con 0x7f7dd0003980 2023-09-10T09:17:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.990+0000 7f7de4ff9640 1 -- 172.21.15.84:0/1833983593 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7dd80b10d0 con 0x7f7dd0003980 2023-09-10T09:17:59.000 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2023-09-10T09:17:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 msgr2=0x7f7dd4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 0x7f7dd4067fe0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0017b0 tx=0x7f7ddc0016a0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 msgr2=0x7f7de80ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009a80 tx=0x7f7dd80056a0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 shutdown_connections 2023-09-10T09:17:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7dd4065b20 0x7f7dd4067fe0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de81f4760 0x7f7de81f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80c4400 0x7f7de80a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 --2- 172.21.15.84:0/1833983593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7dd0003980 0x7f7de80ad5f0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 >> 172.21.15.84:0/1833983593 conn(0x7f7de80c91a0 msgr2=0x7f7de813e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 shutdown_connections 2023-09-10T09:17:59.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:58.994+0000 7f7dee4bc640 1 -- 172.21.15.84:0/1833983593 wait complete. 2023-09-10T09:17:59.018 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 30 2023-09-10T09:17:59.157 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- 172.21.15.84:0/1099426426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 msgr2=0x7fe07000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 --2- 172.21.15.84:0/1099426426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe07000b990 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c610 tx=0x7fe07c01faa0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- 172.21.15.84:0/1099426426 shutdown_connections 2023-09-10T09:17:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 --2- 172.21.15.84:0/1099426426 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe07000b990 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.158 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- 172.21.15.84:0/1099426426 >> 172.21.15.84:0/1099426426 conn(0x7fe0840ca240 msgr2=0x7fe0840ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:59.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- 172.21.15.84:0/1099426426 shutdown_connections 2023-09-10T09:17:59.159 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- 172.21.15.84:0/1099426426 wait complete. 2023-09-10T09:17:59.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 Processor -- start 2023-09-10T09:17:59.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 -- start start 2023-09-10T09:17:59.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0840b22d0 0x7fe0840b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.161 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.150+0000 7fe08c308640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0841e08a0 0x7fe0841e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08c308640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b2c70 con 0x7fe070005050 2023-09-10T09:17:59.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08c308640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084153e10 con 0x7fe0840b22d0 2023-09-10T09:17:59.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08c308640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c5130 con 0x7fe0841e08a0 2023-09-10T09:17:59.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:59.162 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55912/0 (socket says 172.21.15.84:55912) 2023-09-10T09:17:59.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 -- 172.21.15.84:0/3249967444 learned_addr learned my addr 172.21.15.84:0/3249967444 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:59.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 -- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0841e08a0 msgr2=0x7fe0841e0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0841e08a0 0x7fe0841e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 -- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0840b22d0 msgr2=0x7fe0840b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.163 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0840b22d0 0x7fe0840b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 -- 172.21.15.84:0/3249967444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840c53b0 con 0x7fe070005050 2023-09-10T09:17:59.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08a0a4640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fe0800066a0 tx=0x7fe0800016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:59.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080011870 con 0x7fe070005050 2023-09-10T09:17:59.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe080011ae0 con 0x7fe070005050 2023-09-10T09:17:59.164 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080004e20 con 0x7fe070005050 2023-09-10T09:17:59.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08c308640 1 -- 172.21.15.84:0/3249967444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0840c5690 con 0x7fe070005050 2023-09-10T09:17:59.165 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe08c308640 1 -- 172.21.15.84:0/3249967444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840c5c50 con 0x7fe070005050 2023-09-10T09:17:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe060005260 con 0x7fe070005050 2023-09-10T09:17:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe08001a400 con 0x7fe070005050 2023-09-10T09:17:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 0x7fe068067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.166 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe080083e70 con 0x7fe070005050 2023-09-10T09:17:59.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.154+0000 7fe0898a3640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 0x7fe068067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:59.167 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.158+0000 7fe0898a3640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 0x7fe068067fe0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe0841596a0 tx=0x7fe0740093c0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:59.168 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.162+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe080051900 con 0x7fe070005050 2023-09-10T09:17:59.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.346+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config reset", "num": 30} v 0) v1 -- 0x7fe0600050d0 con 0x7fe070005050 2023-09-10T09:17:59.387 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.378+0000 7fe07affd640 1 -- 172.21.15.84:0/3249967444 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 30}]=0 v32) v1 ==== 71+0+0 (secure 0 0 0) 0x7fe080015080 con 0x7fe070005050 2023-09-10T09:17:59.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 msgr2=0x7fe068067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 0x7fe068067fe0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe0841596a0 tx=0x7fe0740093c0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.396 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 msgr2=0x7fe0841538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fe0800066a0 tx=0x7fe0800016e0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 shutdown_connections 2023-09-10T09:17:59.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe068065b20 0x7fe068067fe0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe0841e08a0 0x7fe0841e0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.397 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0840b22d0 0x7fe0840b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 --2- 172.21.15.84:0/3249967444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe070005050 0x7fe0841538d0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 >> 172.21.15.84:0/3249967444 conn(0x7fe0840ca240 msgr2=0x7fe0840ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:59.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 shutdown_connections 2023-09-10T09:17:59.398 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.390+0000 7fe078ff9640 1 -- 172.21.15.84:0/3249967444 wait complete. 2023-09-10T09:17:59.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-09-10T09:17:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.598+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1191678862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52900047d0 msgr2=0x7f5290004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.606 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.598+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1191678862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52900047d0 0x7f5290004c50 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f52a4070780 tx=0x7f52a001e8b0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.606+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1191678862 shutdown_connections 2023-09-10T09:17:59.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.606+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1191678862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52900047d0 0x7f5290004c50 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.606+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1191678862 >> 172.21.15.84:0/1191678862 conn(0x7f52a40ca240 msgr2=0x7f52a40ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:17:59.613 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.606+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1191678862 shutdown_connections 2023-09-10T09:17:59.614 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.606+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1191678862 wait complete. 2023-09-10T09:17:59.620 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.610+0000 7f52ab6d3640 1 Processor -- start 2023-09-10T09:17:59.623 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- start start 2023-09-10T09:17:59.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52900047d0 0x7f52a414ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52a40c6aa0 0x7f52a40c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.625 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40c42d0 con 0x7f52a40c6aa0 2023-09-10T09:17:59.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40c7460 con 0x7f52900047d0 2023-09-10T09:17:59.626 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40a9970 con 0x7f52a40c52a0 2023-09-10T09:17:59.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:59.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.84:36888/0 (socket says 172.21.15.84:36888) 2023-09-10T09:17:59.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 -- 172.21.15.84:0/1543858675 learned_addr learned my addr 172.21.15.84:0/1543858675 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:17:59.627 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a946f640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52900047d0 0x7f52a414ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 -- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52900047d0 msgr2=0x7f52a414ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:17:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52900047d0 0x7f52a414ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 -- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52a40c6aa0 msgr2=0x7f52a40c6f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-10T09:17:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52a40c6aa0 0x7f52a40c6f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:17:59.628 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 -- 172.21.15.84:0/1543858675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40c5720 con 0x7f52a40c52a0 2023-09-10T09:17:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52a8c6e640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c650 tx=0x7f52a00a9e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a00ab070 con 0x7f52a40c52a0 2023-09-10T09:17:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a40a9970 con 0x7f52a40c52a0 2023-09-10T09:17:59.629 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40c5c80 con 0x7f52a40c52a0 2023-09-10T09:17:59.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f52a00064e0 con 0x7f52a40c52a0 2023-09-10T09:17:59.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.618+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a00a9370 con 0x7f52a40c52a0 2023-09-10T09:17:59.630 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.622+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f52a00ae070 con 0x7f52a40c52a0 2023-09-10T09:17:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.622+0000 7f5299ffb640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 0x7f52880680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:17:59.631 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.622+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5284005260 con 0x7f52a40c52a0 2023-09-10T09:17:59.632 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.622+0000 7f52a946f640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 0x7f52880680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:17:59.633 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.626+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f52a00ac070 con 0x7f52a40c52a0 2023-09-10T09:17:59.634 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.626+0000 7f52a946f640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 0x7f52880680e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f529c0013e0 tx=0x7f529c00c040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:17:59.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:17:59.634+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f52a00eab10 con 0x7f52a40c52a0 2023-09-10T09:18:00.301 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:00.294+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f5284005510 con 0x7f52a40c52a0 2023-09-10T09:18:01.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.042+0000 7f5299ffb640 1 -- 172.21.15.84:0/1543858675 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v16457) v1 ==== 144+0+0 (secure 0 0 0) 0x7f52a00ee130 con 0x7f52a40c52a0 2023-09-10T09:18:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 msgr2=0x7f52880680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 0x7f52880680e0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f529c0013e0 tx=0x7f529c00c040 comp rx=0 tx=0).stop 2023-09-10T09:18:01.060 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 msgr2=0x7f52a40c3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:01.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52a000c650 tx=0x7f52a00a9e20 comp rx=0 tx=0).stop 2023-09-10T09:18:01.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 shutdown_connections 2023-09-10T09:18:01.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5288065c20 0x7f52880680e0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:01.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f52a40c6aa0 0x7f52a40c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:01.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f52a40c52a0 0x7f52a40c3d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:01.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 --2- 172.21.15.84:0/1543858675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52900047d0 0x7f52a414ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:01.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 >> 172.21.15.84:0/1543858675 conn(0x7f52a40ca240 msgr2=0x7f52a40cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:01.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 shutdown_connections 2023-09-10T09:18:01.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:01.054+0000 7f52ab6d3640 1 -- 172.21.15.84:0/1543858675 wait complete. 2023-09-10T09:18:01.087 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-09-10T09:18:01.087 INFO:tasks.cephfs_test_runner: 2023-09-10T09:18:01.088 INFO:tasks.cephfs_test_runner:====================================================================== 2023-09-10T09:18:01.088 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-10T09:18:01.089 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-10T09:18:01.089 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-09-10T09:18:01.089 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-09-10T09:18:01.089 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-09-10T09:18:01.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-09-10T09:18:01.090 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-09-10T09:18:01.090 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-09-10T09:18:01.090 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-09-10T09:18:01.091 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-09-10T09:18:01.091 INFO:tasks.cephfs_test_runner: 2023-09-10T09:18:01.091 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-10T09:18:01.091 INFO:tasks.cephfs_test_runner:Ran 1 test in 32666.572s 2023-09-10T09:18:01.092 INFO:tasks.cephfs_test_runner: 2023-09-10T09:18:01.092 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-09-10T09:18:01.092 INFO:tasks.cephfs_test_runner: 2023-09-10T09:18:01.093 INFO:tasks.cephfs_test_runner:====================================================================== 2023-09-10T09:18:01.093 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-10T09:18:01.093 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-09-10T09:18:01.093 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-09-10T09:18:01.094 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-09-10T09:18:01.094 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-09-10T09:18:01.094 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-09-10T09:18:01.094 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-09-10T09:18:01.095 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-09-10T09:18:01.095 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-09-10T09:18:01.095 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-09-10T09:18:01.095 INFO:tasks.cephfs_test_runner: 2023-09-10T09:18:01.096 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-10T09:18:02.306 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=20cb6af52c1347569f5182647a8e53e4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9670cca5bc8e17916865dc84939edfc10b1f2c00/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-09-10T09:18:02.308 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-09-10T09:18:02.317 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-10T09:18:02.327 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-10T09:18:02.327 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T09:18:02.327 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:18:02.369 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336532k,nr_inodes=4084133,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-10T09:18:02.369 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2023-09-10T09:18:02.369 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:18:02.450 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336532k,nr_inodes=4084133,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19839 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274692k,nr_inodes=818673,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274696k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-09-10T09:18:02.450 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T09:18:02.450 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:18:02.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336372k,nr_inodes=4084093,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19869 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-10T09:18:02.473 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-09-10T09:18:02.474 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-10T09:18:02.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16336372k,nr_inodes=4084093,mode=755,inode64 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev,inode64 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19869 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274660k,nr_inodes=818665,mode=700,uid=1000,gid=1271,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274664k,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-09-10T09:18:02.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.530 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2023-09-10T09:18:02.556 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-09-10T09:18:02.557 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-10T09:18:02.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-09-10T09:18:02.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.656 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-10T09:18:02.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2023-09-10T09:18:02.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.932 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2023-09-10T09:18:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-09-10T09:18:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-09-10T09:18:02.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:02.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-09-10T09:18:03.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:03.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-09-10T09:18:03.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-10T09:18:03.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2023-09-10T09:18:03.420 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-10T09:18:03.429 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-10T09:18:03.430 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T09:18:03.696 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- 172.21.15.84:0/1949146270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd260004d10 msgr2=0x7fd260005170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/1949146270 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd260004d10 0x7fd260005170 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fd27806e360 tx=0x7fd26c01cde0 comp rx=0 tx=0).stop 2023-09-10T09:18:03.697 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd276d9d640 1 -- 172.21.15.84:0/1949146270 reap_dead start 2023-09-10T09:18:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- 172.21.15.84:0/1949146270 shutdown_connections 2023-09-10T09:18:03.698 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- 172.21.15.84:0/1949146270 >> 172.21.15.84:0/1949146270 conn(0x7fd2780cc460 msgr2=0x7fd2780cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- 172.21.15.84:0/1949146270 shutdown_connections 2023-09-10T09:18:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- 172.21.15.84:0/1949146270 wait complete. 2023-09-10T09:18:03.699 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 Processor -- start 2023-09-10T09:18:03.700 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.690+0000 7fd27cc8e640 1 -- start start 2023-09-10T09:18:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd278155420 0x7fd2780c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:03.701 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd278155800 0x7fd278153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780c3c60 con 0x7fd278154630 2023-09-10T09:18:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780bff90 con 0x7fd278155420 2023-09-10T09:18:03.702 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd27cc8e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780c0550 con 0x7fd278155800 2023-09-10T09:18:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49372/0 (socket says 172.21.15.84:49372) 2023-09-10T09:18:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 -- 172.21.15.84:0/3849458953 learned_addr learned my addr 172.21.15.84:0/3849458953 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:03.703 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd276d9d640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd278155800 0x7fd278153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:03.704 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 -- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd278155800 msgr2=0x7fd278153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:03.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd278155800 0x7fd278153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:03.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 -- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd278155420 msgr2=0x7fd2780c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:03.705 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd278155420 0x7fd2780c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:03.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 -- 172.21.15.84:0/3849458953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c23a0 con 0x7fd278154630 2023-09-10T09:18:03.706 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.694+0000 7fd275d9b640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fd26800c7e0 tx=0x7fd26800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:03.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.698+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268005270 con 0x7fd278154630 2023-09-10T09:18:03.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.698+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd2680053d0 con 0x7fd278154630 2023-09-10T09:18:03.707 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.698+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2780c2680 con 0x7fd278154630 2023-09-10T09:18:03.708 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.698+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800a8a0 con 0x7fd278154630 2023-09-10T09:18:03.710 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.702+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2780c0f20 con 0x7fd278154630 2023-09-10T09:18:03.711 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.702+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fd26800aa00 con 0x7fd278154630 2023-09-10T09:18:03.712 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.706+0000 7fd266ffd640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 0x7fd258068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:03.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.706+0000 7fd27659c640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 0x7fd258068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:03.713 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.706+0000 7fd27659c640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 0x7fd258068030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd27815cd20 tx=0x7fd270001910 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:03.714 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.706+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd268082760 con 0x7fd278154630 2023-09-10T09:18:03.718 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.710+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780c28c0 con 0x7fd278154630 2023-09-10T09:18:03.727 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:03.718+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fd268050260 con 0x7fd278154630 2023-09-10T09:18:04.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.334+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2780c7420 con 0x7fd258065b70 2023-09-10T09:18:04.452 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.446+0000 7fd266ffd640 1 -- 172.21.15.84:0/3849458953 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48968 (secure 0 0 0) 0x7fd27000fbf0 con 0x7fd258065b70 2023-09-10T09:18:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:04.466 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T09:18:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.462+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 msgr2=0x7fd258068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:04.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.462+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 0x7fd258068030 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd27815cd20 tx=0x7fd270001910 comp rx=0 tx=0).stop 2023-09-10T09:18:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.462+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 msgr2=0x7fd2780c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:04.469 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.462+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fd26800c7e0 tx=0x7fd26800cca0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 shutdown_connections 2023-09-10T09:18:04.501 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fd258065b70 0x7fd258068030 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd278155800 0x7fd278153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd278154630 0x7fd2780c1ac0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.502 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 --2- 172.21.15.84:0/3849458953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd278155420 0x7fd2780c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 >> 172.21.15.84:0/3849458953 conn(0x7fd2780cc460 msgr2=0x7fd278157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:04.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 shutdown_connections 2023-09-10T09:18:04.503 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.494+0000 7fd27cc8e640 1 -- 172.21.15.84:0/3849458953 wait complete. 2023-09-10T09:18:04.533 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16400,"stamp":"2023-09-10T09:18:03.404878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":63066088,"kb_used_data":49705736,"kb_used_omap":51188,"kb_used_meta":13188939,"kb_avail":691908632,"statfs":{"total":773094113280,"available":708514439168,"internally_reserved":0,"allocated":50898673664,"data_stored":50793465510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52416979,"internal_metadata":13505474093},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":333,"apply_latency_ms":333,"commit_latency_ns":333000000,"apply_latency_ns":333000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59064855869,"num_objects":-48229,"num_object_clones":0,"num_object_copies":-96458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48229,"num_whiteouts":0,"num_read":-1544033,"num_read_kb":-110454914,"num_write":-8384220,"num_write_kb":-165422613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.469737"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-09-10T09:17:56.536944+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T09:17:56.536944+0000","last_peered":"2023-09-10T09:17:56.536944+0000","last_clean":"2023-09-10T09:17:56.536944+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T09:17:56.536944+0000","last_undegraded":"2023-09-10T09:17:56.536944+0000","last_fullsized":"2023-09-10T09:17:56.536944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424515990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6759924,"kb_used_data":5099048,"kb_used_omap":3889,"kb_used_meta":1656974,"kb_avail":87611916,"statfs":{"total":96636764160,"available":89714601984,"internally_reserved":0,"allocated":5221425152,"data_stored":5210448510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3982558,"internal_metadata":1696742178},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":6.0670000000000002,"5min":1.7909999999999999,"15min":1.4099999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":101.46599999999999,"5min":101.46599999999999,"15min":101.46599999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":6.7859999999999996,"5min":2.145,"15min":1.635},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":100.76900000000001,"5min":100.76900000000001,"15min":100.76900000000001},"last":0.626}]},{"osd":1,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":5.9370000000000003,"5min":3.6890000000000001,"15min":2.2810000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":100.916,"5min":122.065,"15min":122.065},"last":0.85399999999999998},{"interface":"front","average":{"1min":6.8520000000000003,"5min":3.871,"15min":2.4009999999999998},"min":{"1min":0.35699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":101.889,"5min":122.29300000000001,"15min":122.29300000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":8.3629999999999995,"5min":2.4649999999999999,"15min":3.2130000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":101.251,"5min":101.251,"15min":407.11200000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":6.5800000000000001,"5min":2.1600000000000001,"15min":3.3090000000000002},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":102.158,"5min":102.158,"15min":401.80399999999997},"last":0.89300000000000002}]},{"osd":3,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":4.3470000000000004,"5min":1.722,"15min":1.4470000000000001},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":35.219999999999999,"5min":35.219999999999999,"15min":35.219999999999999},"last":8.5129999999999999},{"interface":"front","average":{"1min":2.7210000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":34.845999999999997,"5min":34.845999999999997,"15min":34.845999999999997},"last":8.5419999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":0.83699999999999997,"15min":0.84399999999999997},"min":{"1min":0.32800000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.3919999999999995,"5min":9.3919999999999995,"15min":9.3919999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":2.504,"5min":1.1910000000000001,"15min":0.98899999999999999},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":28.582999999999998,"5min":28.582999999999998,"15min":28.582999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96099999999999997,"15min":0.92900000000000005},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9089999999999998,"5min":9.298,"15min":9.298},"last":4.4379999999999997},{"interface":"front","average":{"1min":2.601,"5min":1.1990000000000001,"15min":1.093},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":2.2629999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.0580000000000001,"15min":1.0760000000000001},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":6.266,"5min":6.266,"15min":7.524},"last":3.4830000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.5,"15min":1.2350000000000001},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":60.18,"5min":60.18,"15min":60.18},"last":3.625}]}]},{"osd":6,"up_from":15,"seq":64424515989,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8439780,"kb_used_data":6851260,"kb_used_omap":4585,"kb_used_meta":1532694,"kb_avail":85932060,"statfs":{"total":96636764160,"available":87994429440,"internally_reserved":0,"allocated":7015690240,"data_stored":7000890063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4695110,"internal_metadata":1569479610},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.83799999999999997,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23400000000000001},"max":{"1min":3.4380000000000002,"5min":4.9299999999999997,"15min":32.689999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.482,"15min":1.587},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.219},"max":{"1min":12.692,"5min":12.692,"15min":40.506999999999998},"last":1.0049999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.0740000000000001,"15min":1.0940000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":4.2489999999999997,"5min":9.2859999999999996,"15min":18.416},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":1.014,"15min":1.0840000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":3.4780000000000002,"5min":14.537000000000001,"15min":14.537000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.3140000000000001,"15min":1.3759999999999999},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1280000000000001,"5min":9.1280000000000001,"15min":31.853000000000002},"last":19.606000000000002},{"interface":"front","average":{"1min":1.548,"5min":1.3859999999999999,"15min":1.5760000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.1690000000000005,"5min":14.693,"15min":31.811},"last":19.684000000000001}]},{"osd":3,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.2829999999999999,"15min":1.345},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":3.5299999999999998,"5min":5.7169999999999996,"15min":33.710000000000001},"last":1.413},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1509999999999998,"15min":1.895},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.276,"5min":12.276,"15min":25.001000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.27600000000000002},"max":{"1min":3.504,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":2.2869999999999999,"5min":1.492,"15min":1.228},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.26300000000000001},"max":{"1min":16.704999999999998,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.70399999999999996}]},{"osd":5,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.23,"15min":1.194},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":5.71,"5min":10.051,"15min":18.574999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":3.5550000000000002,"5min":4.984,"15min":11.757999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.6539999999999999,"15min":1.4399999999999999},"min":{"1min":0.50900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":13.103,"5min":13.103,"15min":15.888},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.115,"15min":1.115},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":13.057,"5min":13.057,"15min":18.524999999999999},"last":1.5669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424515990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8083044,"kb_used_data":6593900,"kb_used_omap":10125,"kb_used_meta":1410098,"kb_avail":86288796,"statfs":{"total":96636764160,"available":88359727104,"internally_reserved":0,"allocated":6752153600,"data_stored":6738520022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10368951,"internal_metadata":1443940425},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.2050000000000001,"5min":1.1619999999999999,"15min":1.0109999999999999},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":19.716000000000001,"5min":19.716000000000001,"15min":25.914999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.3759999999999999,"15min":1.1639999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":19.927,"5min":19.927,"15min":23.588000000000001},"last":1.3009999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.2629999999999999,"15min":1.304},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":8.9830000000000005,"5min":9.4109999999999996,"15min":38.207999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.258,"15min":1.3939999999999999},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":4.2450000000000001,"5min":6.766,"15min":38.604999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5069999999999999,"15min":2.0390000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27700000000000002},"max":{"1min":10.103,"5min":10.103,"15min":195.44999999999999},"last":5.266},{"interface":"front","average":{"1min":1.145,"5min":1.2170000000000001,"15min":1.988},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.9349999999999996,"5min":7.9349999999999996,"15min":196.434},"last":5.2060000000000004}]},{"osd":3,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":1.593,"15min":1.4419999999999999},"min":{"1min":0.36099999999999999,"5min":0.31900000000000001,"15min":0.29199999999999998},"max":{"1min":20.577999999999999,"5min":20.577999999999999,"15min":23.27},"last":5.2279999999999998},{"interface":"front","average":{"1min":3.4169999999999998,"5min":1.7070000000000001,"15min":1.47},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.30399999999999999},"max":{"1min":20.448,"5min":20.448,"15min":26.555},"last":5.157}]},{"osd":4,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.86899999999999999},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":4.0359999999999996,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.101,"15min":1.0209999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.24099999999999999},"max":{"1min":3.6259999999999999,"5min":6.9770000000000003,"15min":6.9770000000000003},"last":1.3380000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.05,"15min":1.165},"min":{"1min":0.379,"5min":0.252,"15min":0.252},"max":{"1min":9.5980000000000008,"5min":9.5980000000000008,"15min":26.523},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.26100000000000001},"max":{"1min":4.9480000000000004,"5min":6.8150000000000004,"15min":8.0039999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.33800000000000002},"max":{"1min":4.4649999999999999,"5min":7.1740000000000004,"15min":21.768999999999998},"last":2.2930000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.998,"15min":1.159},"min":{"1min":0.38500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":7.9000000000000004,"5min":7.9000000000000004,"15min":26.585999999999999},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424515988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8280284,"kb_used_data":6501456,"kb_used_omap":10519,"kb_used_meta":1768296,"kb_avail":86091556,"statfs":{"total":96636764160,"available":88157753344,"internally_reserved":0,"allocated":6657490944,"data_stored":6643435634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10772002,"internal_metadata":1810735582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":2.4060000000000001,"15min":1.536},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":8.0020000000000007,"5min":170.905,"15min":170.905},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.423,"15min":1.8009999999999999},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.8339999999999996,"5min":171.51599999999999,"15min":171.51599999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":2.661,"15min":2.5800000000000001},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.251},"max":{"1min":8.1880000000000006,"5min":171.24600000000001,"15min":171.24600000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4430000000000001,"15min":1.8440000000000001},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":8.3290000000000006,"5min":169.994,"15min":169.994},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":2.6680000000000001,"15min":1.8620000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.0370000000000008,"5min":170.63300000000001,"15min":170.63300000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.161,"5min":2.621,"15min":1.698},"min":{"1min":0.33900000000000002,"5min":0.318,"15min":0.29199999999999998},"max":{"1min":8.3599999999999994,"5min":170.95699999999999,"15min":170.95699999999999},"last":1.214}]},{"osd":3,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2150000000000001,"15min":1.5980000000000001},"min":{"1min":0.39400000000000002,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":50.055999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.74,"5min":1.3859999999999999,"15min":1.5529999999999999},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":8.1539999999999999,"5min":8.1539999999999999,"15min":39.930999999999997},"last":1.03}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":0.98599999999999999,"15min":1.042},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":8.2729999999999997,"5min":14.725,"15min":38.646999999999998},"last":1.323},{"interface":"front","average":{"1min":1.893,"5min":1.0329999999999999,"15min":1.1830000000000001},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.26900000000000002},"max":{"1min":15.965,"5min":15.965,"15min":29.584},"last":1.2649999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2770000000000001,"5min":1.238,"15min":1.109},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":14.502000000000001,"5min":14.502000000000001,"15min":14.502000000000001},"last":1.306},{"interface":"front","average":{"1min":1.9199999999999999,"5min":0.98799999999999999,"15min":0.89800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":1.381}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1949999999999998,"5min":1.4359999999999999,"15min":1.6060000000000001},"min":{"1min":0.379,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":16.007000000000001,"5min":16.007000000000001,"15min":76.921000000000006},"last":1.1000000000000001},{"interface":"front","average":{"1min":3.472,"5min":1.488,"15min":1.4490000000000001},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":24.486000000000001,"5min":24.486000000000001,"15min":40.084000000000003},"last":1.159}]}]},{"osd":3,"up_from":14,"seq":60129548684,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10410072,"kb_used_data":8673548,"kb_used_omap":3803,"kb_used_meta":1732708,"kb_avail":83961768,"statfs":{"total":96636764160,"available":85976850432,"internally_reserved":0,"allocated":8881713152,"data_stored":8864000611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894703,"internal_metadata":1774293585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.98299999999999998,"15min":1.218},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":5.4569999999999999,"5min":11.276,"15min":33.093000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.2450000000000001},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":34.662999999999997},"last":0.83199999999999996}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.02,"15min":1.425},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":68.977000000000004},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.0649999999999999,"15min":1.3180000000000001},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.219},"max":{"1min":9.5099999999999998,"5min":9.5099999999999998,"15min":68.938999999999993},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.3120000000000001,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.251},"max":{"1min":17.533000000000001,"5min":17.533000000000001,"15min":47.039000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.1559999999999999,"15min":1.821},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":10.214,"5min":10.214,"15min":36.241999999999997},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.014,"15min":1.357},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.5819999999999999,"5min":6.8899999999999997,"15min":33.210999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":3.036,"5min":1.5589999999999999,"15min":1.4099999999999999},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":39.707000000000001,"5min":39.707000000000001,"15min":39.707000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8420000000000001,"5min":1.6719999999999999,"15min":1.387},"min":{"1min":0.371,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":55.744,"5min":55.744,"15min":55.744},"last":1.141},{"interface":"front","average":{"1min":3.992,"5min":1.7529999999999999,"15min":1.3759999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":55.767000000000003,"5min":55.767000000000003,"15min":55.767000000000003},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.355,"15min":1.2450000000000001},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":26.262},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.135,"5min":0.86599999999999999,"15min":1.4259999999999999},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.9020000000000001,"5min":4.4630000000000001,"15min":33.179000000000002},"last":0.68899999999999995}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.1379999999999999,"15min":1.653},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":16.73,"5min":16.73,"15min":33.148000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.992000000000001,"5min":16.992000000000001,"15min":35.390999999999998},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129548687,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5093972,"kb_used_data":3605068,"kb_used_omap":4998,"kb_used_meta":1483897,"kb_avail":89277868,"statfs":{"total":96636764160,"available":91420536832,"internally_reserved":0,"allocated":3691589632,"data_stored":3684157324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5118553,"internal_metadata":1519510951},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.101,"15min":1.8089999999999999},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.19600000000000001},"max":{"1min":8.3399999999999999,"5min":8.3399999999999999,"15min":65.355000000000004},"last":3.6040000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.3009999999999999,"15min":2.3220000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20599999999999999},"max":{"1min":4.6609999999999996,"5min":7.9240000000000004,"15min":224.83600000000001},"last":2.419}]},{"osd":1,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":1.6779999999999999,"15min":2.585},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":43.220999999999997,"5min":43.220999999999997,"15min":224.595},"last":4.2300000000000004},{"interface":"front","average":{"1min":3.7349999999999999,"5min":1.679,"15min":1.591},"min":{"1min":0.26900000000000002,"5min":0.23200000000000001,"15min":0.20699999999999999},"max":{"1min":43.308999999999997,"5min":43.308999999999997,"15min":56.338999999999999},"last":4.4109999999999996}]},{"osd":3,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.627,"15min":2.6339999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.219},"max":{"1min":19.939,"5min":19.939,"15min":105.649},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.284,"15min":2.8820000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.217},"max":{"1min":3.0289999999999999,"5min":11.375999999999999,"15min":224.50999999999999},"last":3.4209999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.1699999999999999,"15min":1.2869999999999999},"min":{"1min":0.38800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.3419999999999996,"5min":6.0149999999999997,"15min":21.675000000000001},"last":3.4990000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.2849999999999999,"15min":1.3979999999999999},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":4.6539999999999999,"5min":6.149,"15min":21.744},"last":3.625}]},{"osd":5,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.4790000000000001,"15min":1.706},"min":{"1min":0.433,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":11.994,"5min":11.994,"15min":59.976999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.8939999999999999,"5min":1.2989999999999999,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":11.85,"5min":11.85,"15min":21.765000000000001},"last":3.4470000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.3300000000000001,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":4.7460000000000004,"5min":6.1050000000000004,"15min":59.996000000000002},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.2430000000000001,"15min":1.7470000000000001},"min":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2999999999999998,"5min":11.416,"15min":99.072000000000003},"last":3.4790000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.1619999999999999,"5min":1.6879999999999999,"15min":1.641},"min":{"1min":0.437,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":25.815000000000001,"5min":25.815000000000001,"15min":25.815000000000001},"last":3.5800000000000001},{"interface":"front","average":{"1min":4.0999999999999996,"5min":1.9339999999999999,"15min":1.8919999999999999},"min":{"1min":0.53300000000000003,"5min":0.379,"15min":0.379},"max":{"1min":26.306000000000001,"5min":26.306000000000001,"15min":59.938000000000002},"last":2.3799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129548689,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8023768,"kb_used_data":6162956,"kb_used_omap":6193,"kb_used_meta":1854606,"kb_avail":86348072,"statfs":{"total":96636764160,"available":88420425728,"internally_reserved":0,"allocated":6310866944,"data_stored":6297600702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6342184,"internal_metadata":1899117016},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":1.597,"15min":1.5740000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":38.545999999999999,"5min":38.545999999999999,"15min":60.738999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":2.9350000000000001,"5min":1.4970000000000001,"15min":1.1259999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":21.262,"5min":21.262,"15min":21.262},"last":0.442}]},{"osd":2,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.149,"15min":2.4380000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":20.335000000000001,"5min":20.335000000000001,"15min":228.64500000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.627,"5min":1.2669999999999999,"15min":2.3580000000000001},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":225.03800000000001},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5110000000000001,"5min":1.4530000000000001,"15min":1.5369999999999999},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.23999999999999999},"max":{"1min":34.484999999999999,"5min":34.484999999999999,"15min":53.753},"last":0.373},{"interface":"front","average":{"1min":3.3929999999999998,"5min":1.6160000000000001,"15min":1.8009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":32.694000000000003,"5min":32.694000000000003,"15min":46.237000000000002},"last":0.495}]},{"osd":4,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.2050000000000001,"15min":1.2929999999999999},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"max":{"1min":20.431999999999999,"5min":20.431999999999999,"15min":44.07},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.998,"5min":1.2989999999999999,"15min":1.1220000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":10.868,"5min":10.868,"15min":10.868},"last":0.66700000000000004}]},{"osd":5,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":1.3600000000000001,"15min":1.1830000000000001},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.28000000000000003},"max":{"1min":14.874000000000001,"5min":14.874000000000001,"15min":14.874000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.133,"5min":0.92700000000000005,"15min":1.1060000000000001},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.32700000000000001},"max":{"1min":5.2800000000000002,"5min":6.2149999999999999,"15min":18.288},"last":0.624}]},{"osd":6,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.92400000000000004,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":6.5339999999999998,"5min":6.5339999999999998,"15min":6.5339999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.9609999999999999,"5min":1.5149999999999999,"15min":1.502},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":22.178000000000001,"5min":22.178000000000001,"15min":44.040999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.675,"15min":1.3740000000000001},"min":{"1min":0.53600000000000003,"5min":0.45700000000000002,"15min":0.377},"max":{"1min":12.454000000000001,"5min":12.454000000000001,"15min":15.6},"last":0.83899999999999997},{"interface":"front","average":{"1min":2.7250000000000001,"5min":1.415,"15min":1.2749999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.40999999999999998},"max":{"1min":18.433,"5min":18.433,"15min":19.521000000000001},"last":0.59899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129548688,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7975244,"kb_used_data":6218500,"kb_used_omap":7073,"kb_used_meta":1749662,"kb_avail":86396596,"statfs":{"total":96636764160,"available":88470114304,"internally_reserved":0,"allocated":6367744000,"data_stored":6354412644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7242918,"internal_metadata":1791654746},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.86199999999999999,"15min":1.331},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":7.4619999999999997,"5min":7.4619999999999997,"15min":62.073},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":1.296,"15min":1.746},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":4.149,"5min":10.6,"15min":54.779000000000003},"last":2.536}]},{"osd":2,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.3420000000000001,"15min":1.2150000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.219},"max":{"1min":4.3579999999999997,"5min":10.715,"15min":40.866},"last":2.3730000000000002},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.151,"15min":1.286},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":5.3090000000000002,"5min":5.8449999999999998,"15min":73.090999999999994},"last":0.54200000000000004}]},{"osd":3,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.343,"15min":1.8779999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.217},"max":{"1min":7.5510000000000002,"5min":7.5510000000000002,"15min":73.126999999999995},"last":0.623},{"interface":"front","average":{"1min":1.429,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.26000000000000001},"max":{"1min":7.3949999999999996,"5min":7.3949999999999996,"15min":8.0190000000000001},"last":0.441}]},{"osd":4,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.202,"15min":1.4450000000000001},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.29799999999999999},"max":{"1min":5.5549999999999997,"5min":5.9189999999999996,"15min":73.176000000000002},"last":0.504},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.204,"15min":1.1519999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.4939999999999998,"5min":7.4939999999999998,"15min":20.803000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.514,"15min":1.4359999999999999},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.30099999999999999},"max":{"1min":4.8289999999999997,"5min":10.682,"15min":40.402999999999999},"last":2.331},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3440000000000001,"15min":1.528},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":5.8259999999999996,"5min":5.9829999999999997,"15min":73.195999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.26,"15min":1.1699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39200000000000002},"max":{"1min":7.5279999999999996,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.367,"15min":1.71},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":5.5229999999999997,"5min":7.9569999999999999,"15min":73.153999999999996},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.304,"15min":1.2749999999999999},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.371},"max":{"1min":7.556,"5min":7.556,"15min":7.556},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.546,"5min":1.7030000000000001,"15min":1.569},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":7.0030000000000001,"5min":10.645,"15min":40.444000000000003},"last":2.411}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T09:18:04.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T09:18:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.886+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/965849475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc740b0af0 msgr2=0x7fcc7406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.886+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/965849475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc740b0af0 0x7fcc7406c400 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009c80 tx=0x7fcc6c01f510 comp rx=0 tx=0).stop 2023-09-10T09:18:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.894+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/965849475 shutdown_connections 2023-09-10T09:18:04.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.894+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/965849475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc740b0af0 0x7fcc7406c400 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.894+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/965849475 >> 172.21.15.84:0/965849475 conn(0x7fcc740cca70 msgr2=0x7fcc740cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:04.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.898+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/965849475 shutdown_connections 2023-09-10T09:18:04.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.898+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/965849475 wait complete. 2023-09-10T09:18:04.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.898+0000 7fcc7bc8f640 1 Processor -- start 2023-09-10T09:18:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.898+0000 7fcc7bc8f640 1 -- start start 2023-09-10T09:18:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 0x7fcc7406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc740b0af0 0x7fcc740c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:04.908 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740c0c50 con 0x7fcc74150b40 2023-09-10T09:18:04.909 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740c0f30 con 0x7fcc740701e0 2023-09-10T09:18:04.910 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7bc8f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc740c1210 con 0x7fcc740b0af0 2023-09-10T09:18:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49388/0 (socket says 172.21.15.84:49388) 2023-09-10T09:18:04.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 -- 172.21.15.84:0/463097894 learned_addr learned my addr 172.21.15.84:0/463097894 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc79a2b640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 0x7fcc7406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 -- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc740b0af0 msgr2=0x7fcc740c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:04.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc740b0af0 0x7fcc740c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 -- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 msgr2=0x7fcc7406bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 0x7fcc7406bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:04.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 -- 172.21.15.84:0/463097894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0098e0 con 0x7fcc74150b40 2023-09-10T09:18:04.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc79a2b640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 0x7fcc7406bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T09:18:04.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc7a22c640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c01c120 tx=0x7fcc6c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:04.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c004d10 con 0x7fcc74150b40 2023-09-10T09:18:04.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcc6c005030 con 0x7fcc74150b40 2023-09-10T09:18:04.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.902+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c005400 con 0x7fcc74150b40 2023-09-10T09:18:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.906+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc740c14f0 con 0x7fcc74150b40 2023-09-10T09:18:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.906+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7406c490 con 0x7fcc74150b40 2023-09-10T09:18:04.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.906+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcc6c0b8050 con 0x7fcc74150b40 2023-09-10T09:18:04.927 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.910+0000 7fcc6a7fc640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 0x7fcc58068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.910+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcc6c121960 con 0x7fcc74150b40 2023-09-10T09:18:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.914+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc740712c0 con 0x7fcc74150b40 2023-09-10T09:18:04.928 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.914+0000 7fcc79a2b640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 0x7fcc58068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:04.929 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.914+0000 7fcc79a2b640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 0x7fcc58068080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fcc70007fd0 tx=0x7fcc70007e40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:04.930 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:04.922+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fcc6c0b6080 con 0x7fcc74150b40 2023-09-10T09:18:05.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.506+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc740712c0 con 0x7fcc58065bc0 2023-09-10T09:18:05.519 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.510+0000 7fcc6a7fc640 1 -- 172.21.15.84:0/463097894 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48947 (secure 0 0 0) 0x7fcc740712c0 con 0x7fcc58065bc0 2023-09-10T09:18:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:05.520 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T09:18:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 msgr2=0x7fcc58068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:05.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 0x7fcc58068080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fcc70007fd0 tx=0x7fcc70007e40 comp rx=0 tx=0).stop 2023-09-10T09:18:05.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 msgr2=0x7fcc741f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c01c120 tx=0x7fcc6c003c20 comp rx=0 tx=0).stop 2023-09-10T09:18:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 shutdown_connections 2023-09-10T09:18:05.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcc58065bc0 0x7fcc58068080 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcc74150b40 0x7fcc741f5390 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc740b0af0 0x7fcc740c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 --2- 172.21.15.84:0/463097894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc740701e0 0x7fcc7406bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 >> 172.21.15.84:0/463097894 conn(0x7fcc740cca70 msgr2=0x7fcc74154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:05.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 shutdown_connections 2023-09-10T09:18:05.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.522+0000 7fcc7bc8f640 1 -- 172.21.15.84:0/463097894 wait complete. 2023-09-10T09:18:05.553 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16401,"stamp":"2023-09-10T09:18:05.405995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":60239680,"kb_used_data":46828212,"kb_used_omap":51188,"kb_used_meta":13188939,"kb_avail":694735040,"statfs":{"total":773094113280,"available":711408680960,"internally_reserved":0,"allocated":47952089088,"data_stored":47853089173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52416979,"internal_metadata":13505474093},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":446,"apply_latency_ms":446,"commit_latency_ns":446000000,"apply_latency_ns":446000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59059716271,"num_objects":-48225,"num_object_clones":0,"num_object_copies":-96450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48225,"num_whiteouts":0,"num_read":-1544033,"num_read_kb":-110454914,"num_write":-8384224,"num_write_kb":-165422613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002353"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-09-10T09:17:56.536944+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T09:17:56.536944+0000","last_peered":"2023-09-10T09:17:56.536944+0000","last_clean":"2023-09-10T09:17:56.536944+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T09:17:56.536944+0000","last_undegraded":"2023-09-10T09:17:56.536944+0000","last_fullsized":"2023-09-10T09:17:56.536944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424515990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6759924,"kb_used_data":5099048,"kb_used_omap":3889,"kb_used_meta":1656974,"kb_avail":87611916,"statfs":{"total":96636764160,"available":89714601984,"internally_reserved":0,"allocated":5221425152,"data_stored":5210448510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3982558,"internal_metadata":1696742178},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":6.0670000000000002,"5min":1.7909999999999999,"15min":1.4099999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":101.46599999999999,"5min":101.46599999999999,"15min":101.46599999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":6.7859999999999996,"5min":2.145,"15min":1.635},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":100.76900000000001,"5min":100.76900000000001,"15min":100.76900000000001},"last":0.626}]},{"osd":1,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":5.9370000000000003,"5min":3.6890000000000001,"15min":2.2810000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":100.916,"5min":122.065,"15min":122.065},"last":0.85399999999999998},{"interface":"front","average":{"1min":6.8520000000000003,"5min":3.871,"15min":2.4009999999999998},"min":{"1min":0.35699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":101.889,"5min":122.29300000000001,"15min":122.29300000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":8.3629999999999995,"5min":2.4649999999999999,"15min":3.2130000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":101.251,"5min":101.251,"15min":407.11200000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":6.5800000000000001,"5min":2.1600000000000001,"15min":3.3090000000000002},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":102.158,"5min":102.158,"15min":401.80399999999997},"last":0.89300000000000002}]},{"osd":3,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":4.3470000000000004,"5min":1.722,"15min":1.4470000000000001},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":35.219999999999999,"5min":35.219999999999999,"15min":35.219999999999999},"last":8.5129999999999999},{"interface":"front","average":{"1min":2.7210000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":34.845999999999997,"5min":34.845999999999997,"15min":34.845999999999997},"last":8.5419999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":0.83699999999999997,"15min":0.84399999999999997},"min":{"1min":0.32800000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.3919999999999995,"5min":9.3919999999999995,"15min":9.3919999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":2.504,"5min":1.1910000000000001,"15min":0.98899999999999999},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":28.582999999999998,"5min":28.582999999999998,"15min":28.582999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96099999999999997,"15min":0.92900000000000005},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9089999999999998,"5min":9.298,"15min":9.298},"last":4.4379999999999997},{"interface":"front","average":{"1min":2.601,"5min":1.1990000000000001,"15min":1.093},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":2.2629999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.0580000000000001,"15min":1.0760000000000001},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":6.266,"5min":6.266,"15min":7.524},"last":3.4830000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.5,"15min":1.2350000000000001},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":60.18,"5min":60.18,"15min":60.18},"last":3.625}]}]},{"osd":6,"up_from":15,"seq":64424515989,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8439780,"kb_used_data":6851260,"kb_used_omap":4585,"kb_used_meta":1532694,"kb_avail":85932060,"statfs":{"total":96636764160,"available":87994429440,"internally_reserved":0,"allocated":7015690240,"data_stored":7000890063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4695110,"internal_metadata":1569479610},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.83799999999999997,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23400000000000001},"max":{"1min":3.4380000000000002,"5min":4.9299999999999997,"15min":32.689999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.482,"15min":1.587},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.219},"max":{"1min":12.692,"5min":12.692,"15min":40.506999999999998},"last":1.0049999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.0740000000000001,"15min":1.0940000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":4.2489999999999997,"5min":9.2859999999999996,"15min":18.416},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":1.014,"15min":1.0840000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":3.4780000000000002,"5min":14.537000000000001,"15min":14.537000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.3140000000000001,"15min":1.3759999999999999},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1280000000000001,"5min":9.1280000000000001,"15min":31.853000000000002},"last":19.606000000000002},{"interface":"front","average":{"1min":1.548,"5min":1.3859999999999999,"15min":1.5760000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.1690000000000005,"5min":14.693,"15min":31.811},"last":19.684000000000001}]},{"osd":3,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.2829999999999999,"15min":1.345},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":3.5299999999999998,"5min":5.7169999999999996,"15min":33.710000000000001},"last":1.413},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1509999999999998,"15min":1.895},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.276,"5min":12.276,"15min":25.001000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.27600000000000002},"max":{"1min":3.504,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":2.2869999999999999,"5min":1.492,"15min":1.228},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.26300000000000001},"max":{"1min":16.704999999999998,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.70399999999999996}]},{"osd":5,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.23,"15min":1.194},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":5.71,"5min":10.051,"15min":18.574999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":3.5550000000000002,"5min":4.984,"15min":11.757999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.6539999999999999,"15min":1.4399999999999999},"min":{"1min":0.50900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":13.103,"5min":13.103,"15min":15.888},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.115,"15min":1.115},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":13.057,"5min":13.057,"15min":18.524999999999999},"last":1.5669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424515990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8083044,"kb_used_data":6593900,"kb_used_omap":10125,"kb_used_meta":1410098,"kb_avail":86288796,"statfs":{"total":96636764160,"available":88359727104,"internally_reserved":0,"allocated":6752153600,"data_stored":6738520022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10368951,"internal_metadata":1443940425},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.2050000000000001,"5min":1.1619999999999999,"15min":1.0109999999999999},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":19.716000000000001,"5min":19.716000000000001,"15min":25.914999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.3759999999999999,"15min":1.1639999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":19.927,"5min":19.927,"15min":23.588000000000001},"last":1.3009999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.2629999999999999,"15min":1.304},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":8.9830000000000005,"5min":9.4109999999999996,"15min":38.207999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.258,"15min":1.3939999999999999},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":4.2450000000000001,"5min":6.766,"15min":38.604999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5069999999999999,"15min":2.0390000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27700000000000002},"max":{"1min":10.103,"5min":10.103,"15min":195.44999999999999},"last":5.266},{"interface":"front","average":{"1min":1.145,"5min":1.2170000000000001,"15min":1.988},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.9349999999999996,"5min":7.9349999999999996,"15min":196.434},"last":5.2060000000000004}]},{"osd":3,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":1.593,"15min":1.4419999999999999},"min":{"1min":0.36099999999999999,"5min":0.31900000000000001,"15min":0.29199999999999998},"max":{"1min":20.577999999999999,"5min":20.577999999999999,"15min":23.27},"last":5.2279999999999998},{"interface":"front","average":{"1min":3.4169999999999998,"5min":1.7070000000000001,"15min":1.47},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.30399999999999999},"max":{"1min":20.448,"5min":20.448,"15min":26.555},"last":5.157}]},{"osd":4,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.86899999999999999},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":4.0359999999999996,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.101,"15min":1.0209999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.24099999999999999},"max":{"1min":3.6259999999999999,"5min":6.9770000000000003,"15min":6.9770000000000003},"last":1.3380000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.05,"15min":1.165},"min":{"1min":0.379,"5min":0.252,"15min":0.252},"max":{"1min":9.5980000000000008,"5min":9.5980000000000008,"15min":26.523},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.26100000000000001},"max":{"1min":4.9480000000000004,"5min":6.8150000000000004,"15min":8.0039999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.33800000000000002},"max":{"1min":4.4649999999999999,"5min":7.1740000000000004,"15min":21.768999999999998},"last":2.2930000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.998,"15min":1.159},"min":{"1min":0.38500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":7.9000000000000004,"5min":7.9000000000000004,"15min":26.585999999999999},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424515988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8280284,"kb_used_data":6501456,"kb_used_omap":10519,"kb_used_meta":1768296,"kb_avail":86091556,"statfs":{"total":96636764160,"available":88157753344,"internally_reserved":0,"allocated":6657490944,"data_stored":6643435634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10772002,"internal_metadata":1810735582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":2.4060000000000001,"15min":1.536},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":8.0020000000000007,"5min":170.905,"15min":170.905},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.423,"15min":1.8009999999999999},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.8339999999999996,"5min":171.51599999999999,"15min":171.51599999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":2.661,"15min":2.5800000000000001},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.251},"max":{"1min":8.1880000000000006,"5min":171.24600000000001,"15min":171.24600000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4430000000000001,"15min":1.8440000000000001},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":8.3290000000000006,"5min":169.994,"15min":169.994},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":2.6680000000000001,"15min":1.8620000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.0370000000000008,"5min":170.63300000000001,"15min":170.63300000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.161,"5min":2.621,"15min":1.698},"min":{"1min":0.33900000000000002,"5min":0.318,"15min":0.29199999999999998},"max":{"1min":8.3599999999999994,"5min":170.95699999999999,"15min":170.95699999999999},"last":1.214}]},{"osd":3,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2150000000000001,"15min":1.5980000000000001},"min":{"1min":0.39400000000000002,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":50.055999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.74,"5min":1.3859999999999999,"15min":1.5529999999999999},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":8.1539999999999999,"5min":8.1539999999999999,"15min":39.930999999999997},"last":1.03}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":0.98599999999999999,"15min":1.042},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":8.2729999999999997,"5min":14.725,"15min":38.646999999999998},"last":1.323},{"interface":"front","average":{"1min":1.893,"5min":1.0329999999999999,"15min":1.1830000000000001},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.26900000000000002},"max":{"1min":15.965,"5min":15.965,"15min":29.584},"last":1.2649999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2770000000000001,"5min":1.238,"15min":1.109},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":14.502000000000001,"5min":14.502000000000001,"15min":14.502000000000001},"last":1.306},{"interface":"front","average":{"1min":1.9199999999999999,"5min":0.98799999999999999,"15min":0.89800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":1.381}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1949999999999998,"5min":1.4359999999999999,"15min":1.6060000000000001},"min":{"1min":0.379,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":16.007000000000001,"5min":16.007000000000001,"15min":76.921000000000006},"last":1.1000000000000001},{"interface":"front","average":{"1min":3.472,"5min":1.488,"15min":1.4490000000000001},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":24.486000000000001,"5min":24.486000000000001,"15min":40.084000000000003},"last":1.159}]}]},{"osd":3,"up_from":14,"seq":60129548684,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10410072,"kb_used_data":8673548,"kb_used_omap":3803,"kb_used_meta":1732708,"kb_avail":83961768,"statfs":{"total":96636764160,"available":85976850432,"internally_reserved":0,"allocated":8881713152,"data_stored":8864000611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894703,"internal_metadata":1774293585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.98299999999999998,"15min":1.218},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":5.4569999999999999,"5min":11.276,"15min":33.093000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.2450000000000001},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":34.662999999999997},"last":0.83199999999999996}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.02,"15min":1.425},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":68.977000000000004},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.0649999999999999,"15min":1.3180000000000001},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.219},"max":{"1min":9.5099999999999998,"5min":9.5099999999999998,"15min":68.938999999999993},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.3120000000000001,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.251},"max":{"1min":17.533000000000001,"5min":17.533000000000001,"15min":47.039000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.1559999999999999,"15min":1.821},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":10.214,"5min":10.214,"15min":36.241999999999997},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.014,"15min":1.357},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.5819999999999999,"5min":6.8899999999999997,"15min":33.210999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":3.036,"5min":1.5589999999999999,"15min":1.4099999999999999},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":39.707000000000001,"5min":39.707000000000001,"15min":39.707000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8420000000000001,"5min":1.6719999999999999,"15min":1.387},"min":{"1min":0.371,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":55.744,"5min":55.744,"15min":55.744},"last":1.141},{"interface":"front","average":{"1min":3.992,"5min":1.7529999999999999,"15min":1.3759999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":55.767000000000003,"5min":55.767000000000003,"15min":55.767000000000003},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.355,"15min":1.2450000000000001},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":26.262},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.135,"5min":0.86599999999999999,"15min":1.4259999999999999},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.9020000000000001,"5min":4.4630000000000001,"15min":33.179000000000002},"last":0.68899999999999995}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.1379999999999999,"15min":1.653},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":16.73,"5min":16.73,"15min":33.148000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.992000000000001,"5min":16.992000000000001,"15min":35.390999999999998},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129548687,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5093972,"kb_used_data":3605068,"kb_used_omap":4998,"kb_used_meta":1483897,"kb_avail":89277868,"statfs":{"total":96636764160,"available":91420536832,"internally_reserved":0,"allocated":3691589632,"data_stored":3684157324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5118553,"internal_metadata":1519510951},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.101,"15min":1.8089999999999999},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.19600000000000001},"max":{"1min":8.3399999999999999,"5min":8.3399999999999999,"15min":65.355000000000004},"last":3.6040000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.3009999999999999,"15min":2.3220000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20599999999999999},"max":{"1min":4.6609999999999996,"5min":7.9240000000000004,"15min":224.83600000000001},"last":2.419}]},{"osd":1,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":1.6779999999999999,"15min":2.585},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":43.220999999999997,"5min":43.220999999999997,"15min":224.595},"last":4.2300000000000004},{"interface":"front","average":{"1min":3.7349999999999999,"5min":1.679,"15min":1.591},"min":{"1min":0.26900000000000002,"5min":0.23200000000000001,"15min":0.20699999999999999},"max":{"1min":43.308999999999997,"5min":43.308999999999997,"15min":56.338999999999999},"last":4.4109999999999996}]},{"osd":3,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.627,"15min":2.6339999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.219},"max":{"1min":19.939,"5min":19.939,"15min":105.649},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.284,"15min":2.8820000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.217},"max":{"1min":3.0289999999999999,"5min":11.375999999999999,"15min":224.50999999999999},"last":3.4209999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.1699999999999999,"15min":1.2869999999999999},"min":{"1min":0.38800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.3419999999999996,"5min":6.0149999999999997,"15min":21.675000000000001},"last":3.4990000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.2849999999999999,"15min":1.3979999999999999},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":4.6539999999999999,"5min":6.149,"15min":21.744},"last":3.625}]},{"osd":5,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.4790000000000001,"15min":1.706},"min":{"1min":0.433,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":11.994,"5min":11.994,"15min":59.976999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.8939999999999999,"5min":1.2989999999999999,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":11.85,"5min":11.85,"15min":21.765000000000001},"last":3.4470000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.3300000000000001,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":4.7460000000000004,"5min":6.1050000000000004,"15min":59.996000000000002},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.2430000000000001,"15min":1.7470000000000001},"min":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2999999999999998,"5min":11.416,"15min":99.072000000000003},"last":3.4790000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.1619999999999999,"5min":1.6879999999999999,"15min":1.641},"min":{"1min":0.437,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":25.815000000000001,"5min":25.815000000000001,"15min":25.815000000000001},"last":3.5800000000000001},{"interface":"front","average":{"1min":4.0999999999999996,"5min":1.9339999999999999,"15min":1.8919999999999999},"min":{"1min":0.53300000000000003,"5min":0.379,"15min":0.379},"max":{"1min":26.306000000000001,"5min":26.306000000000001,"15min":59.938000000000002},"last":2.3799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129548689,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8023768,"kb_used_data":6162956,"kb_used_omap":6193,"kb_used_meta":1854606,"kb_avail":86348072,"statfs":{"total":96636764160,"available":88420425728,"internally_reserved":0,"allocated":6310866944,"data_stored":6297600702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6342184,"internal_metadata":1899117016},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":1.597,"15min":1.5740000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":38.545999999999999,"5min":38.545999999999999,"15min":60.738999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":2.9350000000000001,"5min":1.4970000000000001,"15min":1.1259999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":21.262,"5min":21.262,"15min":21.262},"last":0.442}]},{"osd":2,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.149,"15min":2.4380000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":20.335000000000001,"5min":20.335000000000001,"15min":228.64500000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.627,"5min":1.2669999999999999,"15min":2.3580000000000001},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":225.03800000000001},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5110000000000001,"5min":1.4530000000000001,"15min":1.5369999999999999},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.23999999999999999},"max":{"1min":34.484999999999999,"5min":34.484999999999999,"15min":53.753},"last":0.373},{"interface":"front","average":{"1min":3.3929999999999998,"5min":1.6160000000000001,"15min":1.8009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":32.694000000000003,"5min":32.694000000000003,"15min":46.237000000000002},"last":0.495}]},{"osd":4,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.2050000000000001,"15min":1.2929999999999999},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"max":{"1min":20.431999999999999,"5min":20.431999999999999,"15min":44.07},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.998,"5min":1.2989999999999999,"15min":1.1220000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":10.868,"5min":10.868,"15min":10.868},"last":0.66700000000000004}]},{"osd":5,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":1.3600000000000001,"15min":1.1830000000000001},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.28000000000000003},"max":{"1min":14.874000000000001,"5min":14.874000000000001,"15min":14.874000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.133,"5min":0.92700000000000005,"15min":1.1060000000000001},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.32700000000000001},"max":{"1min":5.2800000000000002,"5min":6.2149999999999999,"15min":18.288},"last":0.624}]},{"osd":6,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.92400000000000004,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":6.5339999999999998,"5min":6.5339999999999998,"15min":6.5339999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.9609999999999999,"5min":1.5149999999999999,"15min":1.502},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":22.178000000000001,"5min":22.178000000000001,"15min":44.040999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.675,"15min":1.3740000000000001},"min":{"1min":0.53600000000000003,"5min":0.45700000000000002,"15min":0.377},"max":{"1min":12.454000000000001,"5min":12.454000000000001,"15min":15.6},"last":0.83899999999999997},{"interface":"front","average":{"1min":2.7250000000000001,"5min":1.415,"15min":1.2749999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.40999999999999998},"max":{"1min":18.433,"5min":18.433,"15min":19.521000000000001},"last":0.59899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129548689,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148836,"kb_used_data":3340976,"kb_used_omap":7073,"kb_used_meta":1749662,"kb_avail":89223004,"statfs":{"total":96636764160,"available":91364356096,"internally_reserved":0,"allocated":3421159424,"data_stored":3414036307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7242918,"internal_metadata":1791654746},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":114,"apply_latency_ms":114,"commit_latency_ns":114000000,"apply_latency_ns":114000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.86199999999999999,"15min":1.331},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":7.4619999999999997,"5min":7.4619999999999997,"15min":62.073},"last":2.9329999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":1.296,"15min":1.746},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":4.149,"5min":10.6,"15min":54.779000000000003},"last":3.399}]},{"osd":2,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.3420000000000001,"15min":1.2150000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.219},"max":{"1min":4.3579999999999997,"5min":10.715,"15min":40.866},"last":27.382999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.151,"15min":1.286},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":5.3090000000000002,"5min":5.8449999999999998,"15min":73.090999999999994},"last":12.275}]},{"osd":3,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.343,"15min":1.8779999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.217},"max":{"1min":7.5510000000000002,"5min":7.5510000000000002,"15min":73.126999999999995},"last":12.327},{"interface":"front","average":{"1min":1.429,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.26000000000000001},"max":{"1min":7.3949999999999996,"5min":7.3949999999999996,"15min":8.0190000000000001},"last":17.102}]},{"osd":4,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.202,"15min":1.4450000000000001},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.29799999999999999},"max":{"1min":5.5549999999999997,"5min":5.9189999999999996,"15min":73.176000000000002},"last":2.8450000000000002},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.204,"15min":1.1519999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.4939999999999998,"5min":7.4939999999999998,"15min":20.803000000000001},"last":2.8759999999999999}]},{"osd":5,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.514,"15min":1.4359999999999999},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.30099999999999999},"max":{"1min":4.8289999999999997,"5min":10.682,"15min":40.402999999999999},"last":0.624},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3440000000000001,"15min":1.528},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":5.8259999999999996,"5min":5.9829999999999997,"15min":73.195999999999998},"last":2.899}]},{"osd":6,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.26,"15min":1.1699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39200000000000002},"max":{"1min":7.5279999999999996,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":24.265999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.367,"15min":1.71},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":5.5229999999999997,"5min":7.9569999999999999,"15min":73.153999999999996},"last":3.371}]},{"osd":7,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.304,"15min":1.2749999999999999},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.371},"max":{"1min":7.556,"5min":7.556,"15min":7.556},"last":12.739000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.7030000000000001,"15min":1.569},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":7.0030000000000001,"5min":10.645,"15min":40.444000000000003},"last":11.278}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T09:18:05.554 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-10T09:18:05.555 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T09:18:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.886+0000 7ff7dea49640 1 -- 172.21.15.84:0/1557169911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 msgr2=0x7ff7d80b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:05.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.886+0000 7ff7dea49640 1 --2- 172.21.15.84:0/1557169911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d80b0d80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff7d806d8e0 tx=0x7ff7cc01e5e0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.894+0000 7ff7dea49640 1 -- 172.21.15.84:0/1557169911 shutdown_connections 2023-09-10T09:18:05.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.894+0000 7ff7dea49640 1 --2- 172.21.15.84:0/1557169911 >> v2:172.21.15.84:3300/0 conn(0x7ff7d806fad0 0x7ff7d806ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.894+0000 7ff7dea49640 1 --2- 172.21.15.84:0/1557169911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d80b0d80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.904 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.894+0000 7ff7dea49640 1 -- 172.21.15.84:0/1557169911 >> 172.21.15.84:0/1557169911 conn(0x7ff7d80cc670 msgr2=0x7ff7d80cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.898+0000 7ff7dea49640 1 -- 172.21.15.84:0/1557169911 shutdown_connections 2023-09-10T09:18:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.898+0000 7ff7dea49640 1 -- 172.21.15.84:0/1557169911 wait complete. 2023-09-10T09:18:05.906 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.898+0000 7ff7dea49640 1 Processor -- start 2023-09-10T09:18:05.912 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 -- start start 2023-09-10T09:18:05.913 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 0x7ff7d80c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:05.914 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:05.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7d81579f0 0x7ff7d81584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:05.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c38e0 con 0x7ff7d806fad0 2023-09-10T09:18:05.915 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c3bc0 con 0x7ff7d80b08f0 2023-09-10T09:18:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dea49640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80c3ea0 con 0x7ff7d81579f0 2023-09-10T09:18:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 0x7ff7d80c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 0x7ff7d80c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49412/0 (socket says 172.21.15.84:49412) 2023-09-10T09:18:05.916 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d7fff640 1 -- 172.21.15.84:0/4096694 learned_addr learned my addr 172.21.15.84:0/4096694 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:05.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:05.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7dcfe6640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7d81579f0 0x7ff7d81584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:05.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 -- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7d81579f0 msgr2=0x7ff7d81584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:05.917 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7d81579f0 0x7ff7d81584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 -- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 msgr2=0x7ff7d80c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 0x7ff7d80c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:05.918 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 -- 172.21.15.84:0/4096694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0009820 con 0x7ff7d80b08f0 2023-09-10T09:18:05.919 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.906+0000 7ff7d77fe640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d8157f60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000ec20 tx=0x7ff7d000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.958+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0003b80 con 0x7ff7d80b08f0 2023-09-10T09:18:05.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.958+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff7d0003ce0 con 0x7ff7d80b08f0 2023-09-10T09:18:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.958+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc00d590 con 0x7ff7d80b08f0 2023-09-10T09:18:05.965 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.958+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d8154ef0 con 0x7ff7d80b08f0 2023-09-10T09:18:05.966 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.958+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0004280 con 0x7ff7d80b08f0 2023-09-10T09:18:05.968 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.962+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff7d00043e0 con 0x7ff7d80b08f0 2023-09-10T09:18:05.969 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.962+0000 7ff7d4ff9640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 0x7ff7bc068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:05.970 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.962+0000 7ff7d7fff640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 0x7ff7bc068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.962+0000 7ff7d7fff640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 0x7ff7bc068080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f70 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.962+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff7d0014070 con 0x7ff7d80b08f0 2023-09-10T09:18:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.974+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b4005260 con 0x7ff7d80b08f0 2023-09-10T09:18:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:05.990+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff7d00519b0 con 0x7ff7d80b08f0 2023-09-10T09:18:06.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.478+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7b4000bd0 con 0x7ff7bc065bc0 2023-09-10T09:18:06.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.482+0000 7ff7d4ff9640 1 -- 172.21.15.84:0/4096694 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48947 (secure 0 0 0) 0x7ff7b4000bd0 con 0x7ff7bc065bc0 2023-09-10T09:18:06.495 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:06.496 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T09:18:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 msgr2=0x7ff7bc068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 0x7ff7bc068080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f70 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2023-09-10T09:18:06.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 msgr2=0x7ff7d8157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:06.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d8157f60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000ec20 tx=0x7ff7d000c6a0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 shutdown_connections 2023-09-10T09:18:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff7bc065bc0 0x7ff7bc068080 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff7d81579f0 0x7ff7d81584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7d80b08f0 0x7ff7d8157f60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 --2- 172.21.15.84:0/4096694 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff7d806fad0 0x7ff7d80c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 >> 172.21.15.84:0/4096694 conn(0x7ff7d80cc670 msgr2=0x7ff7d80c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:06.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 shutdown_connections 2023-09-10T09:18:06.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.506+0000 7ff7dea49640 1 -- 172.21.15.84:0/4096694 wait complete. 2023-09-10T09:18:06.542 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16401,"stamp":"2023-09-10T09:18:05.405995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":60239680,"kb_used_data":46828212,"kb_used_omap":51188,"kb_used_meta":13188939,"kb_avail":694735040,"statfs":{"total":773094113280,"available":711408680960,"internally_reserved":0,"allocated":47952089088,"data_stored":47853089173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52416979,"internal_metadata":13505474093},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":446,"apply_latency_ms":446,"commit_latency_ns":446000000,"apply_latency_ns":446000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-59059716271,"num_objects":-48225,"num_object_clones":0,"num_object_copies":-96450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-48225,"num_whiteouts":0,"num_read":-1544033,"num_read_kb":-110454914,"num_write":-8384224,"num_write_kb":-165422613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002353"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-09-10T09:17:56.536944+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T09:17:56.536944+0000","last_peered":"2023-09-10T09:17:56.536944+0000","last_clean":"2023-09-10T09:17:56.536944+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T09:17:56.536944+0000","last_undegraded":"2023-09-10T09:17:56.536944+0000","last_fullsized":"2023-09-10T09:17:56.536944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424515990,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6759924,"kb_used_data":5099048,"kb_used_omap":3889,"kb_used_meta":1656974,"kb_avail":87611916,"statfs":{"total":96636764160,"available":89714601984,"internally_reserved":0,"allocated":5221425152,"data_stored":5210448510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3982558,"internal_metadata":1696742178},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":6.0670000000000002,"5min":1.7909999999999999,"15min":1.4099999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":101.46599999999999,"5min":101.46599999999999,"15min":101.46599999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":6.7859999999999996,"5min":2.145,"15min":1.635},"min":{"1min":0.28699999999999998,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":100.76900000000001,"5min":100.76900000000001,"15min":100.76900000000001},"last":0.626}]},{"osd":1,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":5.9370000000000003,"5min":3.6890000000000001,"15min":2.2810000000000001},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.246},"max":{"1min":100.916,"5min":122.065,"15min":122.065},"last":0.85399999999999998},{"interface":"front","average":{"1min":6.8520000000000003,"5min":3.871,"15min":2.4009999999999998},"min":{"1min":0.35699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":101.889,"5min":122.29300000000001,"15min":122.29300000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":8.3629999999999995,"5min":2.4649999999999999,"15min":3.2130000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":101.251,"5min":101.251,"15min":407.11200000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":6.5800000000000001,"5min":2.1600000000000001,"15min":3.3090000000000002},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":102.158,"5min":102.158,"15min":401.80399999999997},"last":0.89300000000000002}]},{"osd":3,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":4.3470000000000004,"5min":1.722,"15min":1.4470000000000001},"min":{"1min":0.35599999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"max":{"1min":35.219999999999999,"5min":35.219999999999999,"15min":35.219999999999999},"last":8.5129999999999999},{"interface":"front","average":{"1min":2.7210000000000001,"5min":1.3720000000000001,"15min":1.4610000000000001},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":34.845999999999997,"5min":34.845999999999997,"15min":34.845999999999997},"last":8.5419999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":0.83699999999999997,"15min":0.84399999999999997},"min":{"1min":0.32800000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":9.3919999999999995,"5min":9.3919999999999995,"15min":9.3919999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":2.504,"5min":1.1910000000000001,"15min":0.98899999999999999},"min":{"1min":0.309,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":28.582999999999998,"5min":28.582999999999998,"15min":28.582999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.96099999999999997,"15min":0.92900000000000005},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.9089999999999998,"5min":9.298,"15min":9.298},"last":4.4379999999999997},{"interface":"front","average":{"1min":2.601,"5min":1.1990000000000001,"15min":1.093},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":2.2629999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.0580000000000001,"15min":1.0760000000000001},"min":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":6.266,"5min":6.266,"15min":7.524},"last":3.4830000000000001},{"interface":"front","average":{"1min":4.2880000000000003,"5min":1.5,"15min":1.2350000000000001},"min":{"1min":0.42499999999999999,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":60.18,"5min":60.18,"15min":60.18},"last":3.625}]}]},{"osd":6,"up_from":15,"seq":64424515989,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8439780,"kb_used_data":6851260,"kb_used_omap":4585,"kb_used_meta":1532694,"kb_avail":85932060,"statfs":{"total":96636764160,"available":87994429440,"internally_reserved":0,"allocated":7015690240,"data_stored":7000890063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4695110,"internal_metadata":1569479610},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.83799999999999997,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23400000000000001},"max":{"1min":3.4380000000000002,"5min":4.9299999999999997,"15min":32.689999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.482,"15min":1.587},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.219},"max":{"1min":12.692,"5min":12.692,"15min":40.506999999999998},"last":1.0049999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.0740000000000001,"15min":1.0940000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":4.2489999999999997,"5min":9.2859999999999996,"15min":18.416},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":1.014,"15min":1.0840000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":3.4780000000000002,"5min":14.537000000000001,"15min":14.537000000000001},"last":1.2589999999999999}]},{"osd":2,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.3140000000000001,"15min":1.3759999999999999},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1280000000000001,"5min":9.1280000000000001,"15min":31.853000000000002},"last":19.606000000000002},{"interface":"front","average":{"1min":1.548,"5min":1.3859999999999999,"15min":1.5760000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.1690000000000005,"5min":14.693,"15min":31.811},"last":19.684000000000001}]},{"osd":3,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.2829999999999999,"15min":1.345},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":3.5299999999999998,"5min":5.7169999999999996,"15min":33.710000000000001},"last":1.413},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1509999999999998,"15min":1.895},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.276,"5min":12.276,"15min":25.001000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.27600000000000002},"max":{"1min":3.504,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":2.2869999999999999,"5min":1.492,"15min":1.228},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.26300000000000001},"max":{"1min":16.704999999999998,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.70399999999999996}]},{"osd":5,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.23,"15min":1.194},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":5.71,"5min":10.051,"15min":18.574999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":3.5550000000000002,"5min":4.984,"15min":11.757999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.6539999999999999,"15min":1.4399999999999999},"min":{"1min":0.50900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":13.103,"5min":13.103,"15min":15.888},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.115,"15min":1.115},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":13.057,"5min":13.057,"15min":18.524999999999999},"last":1.5669999999999999}]}]},{"osd":5,"up_from":15,"seq":64424515990,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8083044,"kb_used_data":6593900,"kb_used_omap":10125,"kb_used_meta":1410098,"kb_avail":86288796,"statfs":{"total":96636764160,"available":88359727104,"internally_reserved":0,"allocated":6752153600,"data_stored":6738520022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10368951,"internal_metadata":1443940425},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.2050000000000001,"5min":1.1619999999999999,"15min":1.0109999999999999},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":19.716000000000001,"5min":19.716000000000001,"15min":25.914999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":2.0590000000000002,"5min":1.3759999999999999,"15min":1.1639999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":19.927,"5min":19.927,"15min":23.588000000000001},"last":1.3009999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.2629999999999999,"15min":1.304},"min":{"1min":0.28499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":8.9830000000000005,"5min":9.4109999999999996,"15min":38.207999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.079,"5min":1.258,"15min":1.3939999999999999},"min":{"1min":0.32600000000000001,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":4.2450000000000001,"5min":6.766,"15min":38.604999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5069999999999999,"15min":2.0390000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27700000000000002},"max":{"1min":10.103,"5min":10.103,"15min":195.44999999999999},"last":5.266},{"interface":"front","average":{"1min":1.145,"5min":1.2170000000000001,"15min":1.988},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.9349999999999996,"5min":7.9349999999999996,"15min":196.434},"last":5.2060000000000004}]},{"osd":3,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":1.593,"15min":1.4419999999999999},"min":{"1min":0.36099999999999999,"5min":0.31900000000000001,"15min":0.29199999999999998},"max":{"1min":20.577999999999999,"5min":20.577999999999999,"15min":23.27},"last":5.2279999999999998},{"interface":"front","average":{"1min":3.4169999999999998,"5min":1.7070000000000001,"15min":1.47},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.30399999999999999},"max":{"1min":20.448,"5min":20.448,"15min":26.555},"last":5.157}]},{"osd":4,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.90000000000000002,"15min":0.86899999999999999},"min":{"1min":0.38700000000000001,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":4.0359999999999996,"5min":6.7910000000000004,"15min":6.7910000000000004},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.101,"15min":1.0209999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.24099999999999999},"max":{"1min":3.6259999999999999,"5min":6.9770000000000003,"15min":6.9770000000000003},"last":1.3380000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.05,"15min":1.165},"min":{"1min":0.379,"5min":0.252,"15min":0.252},"max":{"1min":9.5980000000000008,"5min":9.5980000000000008,"15min":26.523},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.052,"15min":1.0249999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.26100000000000001},"max":{"1min":4.9480000000000004,"5min":6.8150000000000004,"15min":8.0039999999999996},"last":0.60199999999999998}]},{"osd":7,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.22},"min":{"1min":0.38500000000000001,"5min":0.38400000000000001,"15min":0.33800000000000002},"max":{"1min":4.4649999999999999,"5min":7.1740000000000004,"15min":21.768999999999998},"last":2.2930000000000001},{"interface":"front","average":{"1min":1.2110000000000001,"5min":0.998,"15min":1.159},"min":{"1min":0.38500000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":7.9000000000000004,"5min":7.9000000000000004,"15min":26.585999999999999},"last":1.0409999999999999}]}]},{"osd":4,"up_from":15,"seq":64424515988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8280284,"kb_used_data":6501456,"kb_used_omap":10519,"kb_used_meta":1768296,"kb_avail":86091556,"statfs":{"total":96636764160,"available":88157753344,"internally_reserved":0,"allocated":6657490944,"data_stored":6643435634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10772002,"internal_metadata":1810735582},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":2.4060000000000001,"15min":1.536},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":8.0020000000000007,"5min":170.905,"15min":170.905},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.423,"15min":1.8009999999999999},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.8339999999999996,"5min":171.51599999999999,"15min":171.51599999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":2.661,"15min":2.5800000000000001},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.251},"max":{"1min":8.1880000000000006,"5min":171.24600000000001,"15min":171.24600000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4430000000000001,"15min":1.8440000000000001},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":8.3290000000000006,"5min":169.994,"15min":169.994},"last":0.77700000000000002}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":2.6680000000000001,"15min":1.8620000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.0370000000000008,"5min":170.63300000000001,"15min":170.63300000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.161,"5min":2.621,"15min":1.698},"min":{"1min":0.33900000000000002,"5min":0.318,"15min":0.29199999999999998},"max":{"1min":8.3599999999999994,"5min":170.95699999999999,"15min":170.95699999999999},"last":1.214}]},{"osd":3,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2150000000000001,"15min":1.5980000000000001},"min":{"1min":0.39400000000000002,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":50.055999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.74,"5min":1.3859999999999999,"15min":1.5529999999999999},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":8.1539999999999999,"5min":8.1539999999999999,"15min":39.930999999999997},"last":1.03}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":0.98599999999999999,"15min":1.042},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":8.2729999999999997,"5min":14.725,"15min":38.646999999999998},"last":1.323},{"interface":"front","average":{"1min":1.893,"5min":1.0329999999999999,"15min":1.1830000000000001},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.26900000000000002},"max":{"1min":15.965,"5min":15.965,"15min":29.584},"last":1.2649999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2770000000000001,"5min":1.238,"15min":1.109},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":14.502000000000001,"5min":14.502000000000001,"15min":14.502000000000001},"last":1.306},{"interface":"front","average":{"1min":1.9199999999999999,"5min":0.98799999999999999,"15min":0.89800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":1.381}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1949999999999998,"5min":1.4359999999999999,"15min":1.6060000000000001},"min":{"1min":0.379,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":16.007000000000001,"5min":16.007000000000001,"15min":76.921000000000006},"last":1.1000000000000001},{"interface":"front","average":{"1min":3.472,"5min":1.488,"15min":1.4490000000000001},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":24.486000000000001,"5min":24.486000000000001,"15min":40.084000000000003},"last":1.159}]}]},{"osd":3,"up_from":14,"seq":60129548684,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10410072,"kb_used_data":8673548,"kb_used_omap":3803,"kb_used_meta":1732708,"kb_avail":83961768,"statfs":{"total":96636764160,"available":85976850432,"internally_reserved":0,"allocated":8881713152,"data_stored":8864000611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894703,"internal_metadata":1774293585},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.98299999999999998,"15min":1.218},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":5.4569999999999999,"5min":11.276,"15min":33.093000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.2450000000000001},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":34.662999999999997},"last":0.83199999999999996}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.02,"15min":1.425},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":68.977000000000004},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.0649999999999999,"15min":1.3180000000000001},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.219},"max":{"1min":9.5099999999999998,"5min":9.5099999999999998,"15min":68.938999999999993},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.3120000000000001,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.251},"max":{"1min":17.533000000000001,"5min":17.533000000000001,"15min":47.039000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.1559999999999999,"15min":1.821},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":10.214,"5min":10.214,"15min":36.241999999999997},"last":0.48899999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.014,"15min":1.357},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.5819999999999999,"5min":6.8899999999999997,"15min":33.210999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":3.036,"5min":1.5589999999999999,"15min":1.4099999999999999},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":39.707000000000001,"5min":39.707000000000001,"15min":39.707000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8420000000000001,"5min":1.6719999999999999,"15min":1.387},"min":{"1min":0.371,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":55.744,"5min":55.744,"15min":55.744},"last":1.141},{"interface":"front","average":{"1min":3.992,"5min":1.7529999999999999,"15min":1.3759999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":55.767000000000003,"5min":55.767000000000003,"15min":55.767000000000003},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.355,"15min":1.2450000000000001},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":26.262},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.135,"5min":0.86599999999999999,"15min":1.4259999999999999},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.9020000000000001,"5min":4.4630000000000001,"15min":33.179000000000002},"last":0.68899999999999995}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.1379999999999999,"15min":1.653},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":16.73,"5min":16.73,"15min":33.148000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.992000000000001,"5min":16.992000000000001,"15min":35.390999999999998},"last":1.1910000000000001}]}]},{"osd":2,"up_from":14,"seq":60129548687,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5093972,"kb_used_data":3605068,"kb_used_omap":4998,"kb_used_meta":1483897,"kb_avail":89277868,"statfs":{"total":96636764160,"available":91420536832,"internally_reserved":0,"allocated":3691589632,"data_stored":3684157324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5118553,"internal_metadata":1519510951},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":75,"apply_latency_ms":75,"commit_latency_ns":75000000,"apply_latency_ns":75000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.101,"15min":1.8089999999999999},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.19600000000000001},"max":{"1min":8.3399999999999999,"5min":8.3399999999999999,"15min":65.355000000000004},"last":3.6040000000000001},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.3009999999999999,"15min":2.3220000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20599999999999999},"max":{"1min":4.6609999999999996,"5min":7.9240000000000004,"15min":224.83600000000001},"last":2.419}]},{"osd":1,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":1.6779999999999999,"15min":2.585},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":43.220999999999997,"5min":43.220999999999997,"15min":224.595},"last":4.2300000000000004},{"interface":"front","average":{"1min":3.7349999999999999,"5min":1.679,"15min":1.591},"min":{"1min":0.26900000000000002,"5min":0.23200000000000001,"15min":0.20699999999999999},"max":{"1min":43.308999999999997,"5min":43.308999999999997,"15min":56.338999999999999},"last":4.4109999999999996}]},{"osd":3,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.627,"15min":2.6339999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.219},"max":{"1min":19.939,"5min":19.939,"15min":105.649},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.284,"15min":2.8820000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.217},"max":{"1min":3.0289999999999999,"5min":11.375999999999999,"15min":224.50999999999999},"last":3.4209999999999998}]},{"osd":4,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.1699999999999999,"15min":1.2869999999999999},"min":{"1min":0.38800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.3419999999999996,"5min":6.0149999999999997,"15min":21.675000000000001},"last":3.4990000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.2849999999999999,"15min":1.3979999999999999},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":4.6539999999999999,"5min":6.149,"15min":21.744},"last":3.625}]},{"osd":5,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.4790000000000001,"15min":1.706},"min":{"1min":0.433,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":11.994,"5min":11.994,"15min":59.976999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.8939999999999999,"5min":1.2989999999999999,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":11.85,"5min":11.85,"15min":21.765000000000001},"last":3.4470000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.3300000000000001,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":4.7460000000000004,"5min":6.1050000000000004,"15min":59.996000000000002},"last":2.4540000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.2430000000000001,"15min":1.7470000000000001},"min":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2999999999999998,"5min":11.416,"15min":99.072000000000003},"last":3.4790000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.1619999999999999,"5min":1.6879999999999999,"15min":1.641},"min":{"1min":0.437,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":25.815000000000001,"5min":25.815000000000001,"15min":25.815000000000001},"last":3.5800000000000001},{"interface":"front","average":{"1min":4.0999999999999996,"5min":1.9339999999999999,"15min":1.8919999999999999},"min":{"1min":0.53300000000000003,"5min":0.379,"15min":0.379},"max":{"1min":26.306000000000001,"5min":26.306000000000001,"15min":59.938000000000002},"last":2.3799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129548689,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8023768,"kb_used_data":6162956,"kb_used_omap":6193,"kb_used_meta":1854606,"kb_avail":86348072,"statfs":{"total":96636764160,"available":88420425728,"internally_reserved":0,"allocated":6310866944,"data_stored":6297600702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6342184,"internal_metadata":1899117016},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":1.597,"15min":1.5740000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":38.545999999999999,"5min":38.545999999999999,"15min":60.738999999999997},"last":0.27500000000000002},{"interface":"front","average":{"1min":2.9350000000000001,"5min":1.4970000000000001,"15min":1.1259999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":21.262,"5min":21.262,"15min":21.262},"last":0.442}]},{"osd":2,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.149,"15min":2.4380000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":20.335000000000001,"5min":20.335000000000001,"15min":228.64500000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":1.627,"5min":1.2669999999999999,"15min":2.3580000000000001},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":225.03800000000001},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5110000000000001,"5min":1.4530000000000001,"15min":1.5369999999999999},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.23999999999999999},"max":{"1min":34.484999999999999,"5min":34.484999999999999,"15min":53.753},"last":0.373},{"interface":"front","average":{"1min":3.3929999999999998,"5min":1.6160000000000001,"15min":1.8009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":32.694000000000003,"5min":32.694000000000003,"15min":46.237000000000002},"last":0.495}]},{"osd":4,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.2050000000000001,"15min":1.2929999999999999},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"max":{"1min":20.431999999999999,"5min":20.431999999999999,"15min":44.07},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.998,"5min":1.2989999999999999,"15min":1.1220000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":10.868,"5min":10.868,"15min":10.868},"last":0.66700000000000004}]},{"osd":5,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":1.3600000000000001,"15min":1.1830000000000001},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.28000000000000003},"max":{"1min":14.874000000000001,"5min":14.874000000000001,"15min":14.874000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.133,"5min":0.92700000000000005,"15min":1.1060000000000001},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.32700000000000001},"max":{"1min":5.2800000000000002,"5min":6.2149999999999999,"15min":18.288},"last":0.624}]},{"osd":6,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.92400000000000004,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":6.5339999999999998,"5min":6.5339999999999998,"15min":6.5339999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.9609999999999999,"5min":1.5149999999999999,"15min":1.502},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":22.178000000000001,"5min":22.178000000000001,"15min":44.040999999999997},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.675,"15min":1.3740000000000001},"min":{"1min":0.53600000000000003,"5min":0.45700000000000002,"15min":0.377},"max":{"1min":12.454000000000001,"5min":12.454000000000001,"15min":15.6},"last":0.83899999999999997},{"interface":"front","average":{"1min":2.7250000000000001,"5min":1.415,"15min":1.2749999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.40999999999999998},"max":{"1min":18.433,"5min":18.433,"15min":19.521000000000001},"last":0.59899999999999998}]}]},{"osd":0,"up_from":14,"seq":60129548689,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5148836,"kb_used_data":3340976,"kb_used_omap":7073,"kb_used_meta":1749662,"kb_avail":89223004,"statfs":{"total":96636764160,"available":91364356096,"internally_reserved":0,"allocated":3421159424,"data_stored":3414036307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7242918,"internal_metadata":1791654746},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":114,"apply_latency_ms":114,"commit_latency_ns":114000000,"apply_latency_ns":114000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.86199999999999999,"15min":1.331},"min":{"1min":0.223,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":7.4619999999999997,"5min":7.4619999999999997,"15min":62.073},"last":2.9329999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":1.296,"15min":1.746},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":4.149,"5min":10.6,"15min":54.779000000000003},"last":3.399}]},{"osd":2,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":1.3420000000000001,"15min":1.2150000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.219},"max":{"1min":4.3579999999999997,"5min":10.715,"15min":40.866},"last":27.382999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":1.151,"15min":1.286},"min":{"1min":0.308,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":5.3090000000000002,"5min":5.8449999999999998,"15min":73.090999999999994},"last":12.275}]},{"osd":3,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.8779999999999999,"5min":1.343,"15min":1.8779999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.217},"max":{"1min":7.5510000000000002,"5min":7.5510000000000002,"15min":73.126999999999995},"last":12.327},{"interface":"front","average":{"1min":1.429,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.26000000000000001},"max":{"1min":7.3949999999999996,"5min":7.3949999999999996,"15min":8.0190000000000001},"last":17.102}]},{"osd":4,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.202,"15min":1.4450000000000001},"min":{"1min":0.34799999999999998,"5min":0.33100000000000002,"15min":0.29799999999999999},"max":{"1min":5.5549999999999997,"5min":5.9189999999999996,"15min":73.176000000000002},"last":2.8450000000000002},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.204,"15min":1.1519999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":7.4939999999999998,"5min":7.4939999999999998,"15min":20.803000000000001},"last":2.8759999999999999}]},{"osd":5,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.514,"15min":1.4359999999999999},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.30099999999999999},"max":{"1min":4.8289999999999997,"5min":10.682,"15min":40.402999999999999},"last":0.624},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3440000000000001,"15min":1.528},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":5.8259999999999996,"5min":5.9829999999999997,"15min":73.195999999999998},"last":2.899}]},{"osd":6,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.26,"15min":1.1699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39200000000000002},"max":{"1min":7.5279999999999996,"5min":8.0210000000000008,"15min":8.0210000000000008},"last":24.265999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.367,"15min":1.71},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.32000000000000001},"max":{"1min":5.5229999999999997,"5min":7.9569999999999999,"15min":73.153999999999996},"last":3.371}]},{"osd":7,"last update":"Sun Sep 10 09:17:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.304,"15min":1.2749999999999999},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.371},"max":{"1min":7.556,"5min":7.556,"15min":7.556},"last":12.739000000000001},{"interface":"front","average":{"1min":1.546,"5min":1.7030000000000001,"15min":1.569},"min":{"1min":0.39600000000000002,"5min":0.374,"15min":0.374},"max":{"1min":7.0030000000000001,"5min":10.645,"15min":40.444000000000003},"last":11.278}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T09:18:06.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-10T09:18:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 -- 172.21.15.84:0/799546967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 msgr2=0x7f7cc00ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 --2- 172.21.15.84:0/799546967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00ad970 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009840 tx=0x7f7cb401c690 comp rx=0 tx=0).stop 2023-09-10T09:18:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 -- 172.21.15.84:0/799546967 shutdown_connections 2023-09-10T09:18:06.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 --2- 172.21.15.84:0/799546967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00ad970 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 -- 172.21.15.84:0/799546967 >> 172.21.15.84:0/799546967 conn(0x7f7cc00cc670 msgr2=0x7f7cc00cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:06.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 -- 172.21.15.84:0/799546967 shutdown_connections 2023-09-10T09:18:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.870+0000 7f7cc557d640 1 -- 172.21.15.84:0/799546967 wait complete. 2023-09-10T09:18:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 Processor -- start 2023-09-10T09:18:06.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 -- start start 2023-09-10T09:18:06.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7cc00b1900 0x7f7cc00c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0155110 con 0x7f7cc006fad0 2023-09-10T09:18:06.883 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01f2f30 con 0x7f7cc01579f0 2023-09-10T09:18:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cc557d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01f3210 con 0x7f7cc00b1900 2023-09-10T09:18:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49416/0 (socket says 172.21.15.84:49416) 2023-09-10T09:18:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 -- 172.21.15.84:0/2277402483 learned_addr learned my addr 172.21.15.84:0/2277402483 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbf7fe640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbe7fc640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7cc00b1900 0x7f7cc00c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 -- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7cc00b1900 msgr2=0x7f7cc00c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7cc00b1900 0x7f7cc00c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 -- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 msgr2=0x7f7cc00c3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00c3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.874+0000 7f7cbeffd640 1 -- 172.21.15.84:0/2277402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb40094a0 con 0x7f7cc006fad0 2023-09-10T09:18:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.878+0000 7f7cbeffd640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40192a0 tx=0x7f7cb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.878+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40bc070 con 0x7f7cc006fad0 2023-09-10T09:18:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.878+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc01f34f0 con 0x7f7cc006fad0 2023-09-10T09:18:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.878+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00b2af0 con 0x7f7cc006fad0 2023-09-10T09:18:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.878+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7cb4005120 con 0x7f7cc006fad0 2023-09-10T09:18:06.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.882+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40052b0 con 0x7f7cc006fad0 2023-09-10T09:18:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.882+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7cb4005430 con 0x7f7cc006fad0 2023-09-10T09:18:06.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.882+0000 7f7ca77fe640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 0x7f7cac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.882+0000 7f7cbe7fc640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 0x7f7cac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.886+0000 7f7cbe7fc640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 0x7f7cac0680b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cbd30 tx=0x7f7cb8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:06.892 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.886+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7cb40aa070 con 0x7f7cc006fad0 2023-09-10T09:18:06.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.890+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca0005260 con 0x7f7cc006fad0 2023-09-10T09:18:06.905 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:06.898+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7cb40eaf90 con 0x7f7cc006fad0 2023-09-10T09:18:07.217 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.210+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca00057e0 con 0x7f7cc006fad0 2023-09-10T09:18:07.218 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.210+0000 7f7ca77fe640 1 -- 172.21.15.84:0/2277402483 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13179 (secure 0 0 0) 0x7f7cb40ee5b0 con 0x7f7cc006fad0 2023-09-10T09:18:07.221 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:07.221 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":45,"fsid":"af9d6115-2022-4a0a-92c0-a49edd021b51","created":"2023-09-10T00:12:16.489611+0000","modified":"2023-09-10T09:17:58.994666+0000","last_up_change":"2023-09-10T00:12:28.391973+0000","last_in_change":"2023-09-10T00:12:19.618289+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-10T00:12:27.877151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54294e9c-0ce2-4e55-af3e-97c5939775bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6818","nonce":3601459291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6819","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6821","nonce":3601459291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6828","nonce":3601459291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6823","nonce":3601459291},{"type":"v1","addr":"172.21.15.84:6824","nonce":3601459291}]},"public_addr":"172.21.15.84:6818/3601459291","cluster_addr":"172.21.15.84:6821/3601459291","heartbeat_back_addr":"172.21.15.84:6828/3601459291","heartbeat_front_addr":"172.21.15.84:6824/3601459291","state":["exists","up"]},{"osd":1,"uuid":"0e7a0d6b-4ef7-4e08-8a41-ae791297f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6801","nonce":680462698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6803","nonce":680462698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6807","nonce":680462698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":680462698},{"type":"v1","addr":"172.21.15.84:6805","nonce":680462698}]},"public_addr":"172.21.15.84:6801/680462698","cluster_addr":"172.21.15.84:6803/680462698","heartbeat_back_addr":"172.21.15.84:6807/680462698","heartbeat_front_addr":"172.21.15.84:6805/680462698","state":["exists","up"]},{"osd":2,"uuid":"d46f2396-f2a2-48f5-b32d-98e2fe989b88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6817","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6820","nonce":1006742702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6825","nonce":1006742702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6831","nonce":1006742702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6827","nonce":1006742702},{"type":"v1","addr":"172.21.15.84:6829","nonce":1006742702}]},"public_addr":"172.21.15.84:6820/1006742702","cluster_addr":"172.21.15.84:6825/1006742702","heartbeat_back_addr":"172.21.15.84:6831/1006742702","heartbeat_front_addr":"172.21.15.84:6829/1006742702","state":["exists","up"]},{"osd":3,"uuid":"2ab391fd-5b6e-47cd-a59b-b6121a10314d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6809","nonce":2125649625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6811","nonce":2125649625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6815","nonce":2125649625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2125649625},{"type":"v1","addr":"172.21.15.84:6813","nonce":2125649625}]},"public_addr":"172.21.15.84:6809/2125649625","cluster_addr":"172.21.15.84:6811/2125649625","heartbeat_back_addr":"172.21.15.84:6815/2125649625","heartbeat_front_addr":"172.21.15.84:6813/2125649625","state":["exists","up"]},{"osd":4,"uuid":"b095c2f5-192f-4770-a9f8-375c50d12319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6801","nonce":2271215042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6803","nonce":2271215042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6807","nonce":2271215042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2271215042},{"type":"v1","addr":"172.21.15.100:6805","nonce":2271215042}]},"public_addr":"172.21.15.100:6801/2271215042","cluster_addr":"172.21.15.100:6803/2271215042","heartbeat_back_addr":"172.21.15.100:6807/2271215042","heartbeat_front_addr":"172.21.15.100:6805/2271215042","state":["exists","up"]},{"osd":5,"uuid":"a31746f7-c2f3-4724-874d-bd0b45fc6e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6812","nonce":3847761032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6815","nonce":3847761032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6822","nonce":3847761032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":3847761032},{"type":"v1","addr":"172.21.15.100:6819","nonce":3847761032}]},"public_addr":"172.21.15.100:6812/3847761032","cluster_addr":"172.21.15.100:6815/3847761032","heartbeat_back_addr":"172.21.15.100:6822/3847761032","heartbeat_front_addr":"172.21.15.100:6819/3847761032","state":["exists","up"]},{"osd":6,"uuid":"fbb9c470-b216-4f33-bf20-aac08393d96c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6825","nonce":133961389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6827","nonce":133961389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6831","nonce":133961389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":133961389},{"type":"v1","addr":"172.21.15.100:6829","nonce":133961389}]},"public_addr":"172.21.15.100:6825/133961389","cluster_addr":"172.21.15.100:6827/133961389","heartbeat_back_addr":"172.21.15.100:6831/133961389","heartbeat_front_addr":"172.21.15.100:6829/133961389","state":["exists","up"]},{"osd":7,"uuid":"fef13f9d-3f80-410f-b6cb-be2e4db71a79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6809","nonce":2524383320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6814","nonce":2524383320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6823","nonce":2524383320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2524383320},{"type":"v1","addr":"172.21.15.100:6818","nonce":2524383320}]},"public_addr":"172.21.15.100:6809/2524383320","cluster_addr":"172.21.15.100:6814/2524383320","heartbeat_back_addr":"172.21.15.100:6823/2524383320","heartbeat_front_addr":"172.21.15.100:6818/2524383320","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.190845+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.452249+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:24.637588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.020806+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.046059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.156374+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.184118+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-10T00:12:25.218912+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6836/2849085608":"2023-09-11T09:17:55.414387+0000","172.21.15.84:6834/2849085608":"2023-09-11T09:17:55.414387+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-10T09:18:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.214+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 msgr2=0x7f7cac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:07.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.214+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 0x7f7cac0680b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cbd30 tx=0x7f7cb8009040 comp rx=0 tx=0).stop 2023-09-10T09:18:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.214+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 msgr2=0x7f7cc0154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:07.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.214+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40192a0 tx=0x7f7cb4004270 comp rx=0 tx=0).stop 2023-09-10T09:18:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 shutdown_connections 2023-09-10T09:18:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7cac065bf0 0x7f7cac0680b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:07.228 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc01579f0 0x7f7cc00c3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:07.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7cc00b1900 0x7f7cc00c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:07.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 --2- 172.21.15.84:0/2277402483 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cc006fad0 0x7f7cc0154bd0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:07.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 >> 172.21.15.84:0/2277402483 conn(0x7f7cc00cc670 msgr2=0x7f7cc00c7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:07.229 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 shutdown_connections 2023-09-10T09:18:07.230 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:07.222+0000 7f7cc557d640 1 -- 172.21.15.84:0/2277402483 wait complete. 2023-09-10T09:18:08.251 INFO:tasks.ceph:Scrubbing osd.0 2023-09-10T09:18:08.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- 172.21.15.84:0/1052369369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 msgr2=0x7f917c0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 --2- 172.21.15.84:0/1052369369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c0add00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f9174009bc0 tx=0x7f917401cac0 comp rx=0 tx=0).stop 2023-09-10T09:18:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- 172.21.15.84:0/1052369369 shutdown_connections 2023-09-10T09:18:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 --2- 172.21.15.84:0/1052369369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c0add00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:08.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- 172.21.15.84:0/1052369369 >> 172.21.15.84:0/1052369369 conn(0x7f917c0cc720 msgr2=0x7f917c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:08.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- 172.21.15.84:0/1052369369 shutdown_connections 2023-09-10T09:18:08.454 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- 172.21.15.84:0/1052369369 wait complete. 2023-09-10T09:18:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 Processor -- start 2023-09-10T09:18:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- start start 2023-09-10T09:18:08.455 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917c070110 0x7f917c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f917c0afdf0 0x7f917c146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14c2c0 con 0x7f917c070110 2023-09-10T09:18:08.456 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c14d5c0 con 0x7f917c06fd30 2023-09-10T09:18:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.442+0000 7f9180c2d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c13bd60 con 0x7f917c0afdf0 2023-09-10T09:18:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f917a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f917a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c14bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.84:59970/0 (socket says 172.21.15.84:59970) 2023-09-10T09:18:08.457 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f9179d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917c070110 0x7f917c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:08.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f917a59c640 1 -- 172.21.15.84:0/4004225601 learned_addr learned my addr 172.21.15.84:0/4004225601 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:08.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f917ad9d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f917c0afdf0 0x7f917c146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:08.458 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.446+0000 7f917a59c640 1 -- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f917c0afdf0 msgr2=0x7f917c146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:08.460 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917a59c640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f917c0afdf0 0x7f917c146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917a59c640 1 -- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917c070110 msgr2=0x7f917c14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917a59c640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917c070110 0x7f917c14f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:08.461 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917a59c640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174009820 con 0x7f917c06fd30 2023-09-10T09:18:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9179d9b640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917c070110 0x7f917c14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T09:18:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917ad9d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f917c0afdf0 0x7f917c146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-10T09:18:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917a59c640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c14bd80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f91740b0040 tx=0x7f91740a5990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:08.462 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174004200 con 0x7f917c06fd30 2023-09-10T09:18:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91740a5b80 con 0x7f917c06fd30 2023-09-10T09:18:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740046d0 con 0x7f917c06fd30 2023-09-10T09:18:08.463 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c13c040 con 0x7f917c06fd30 2023-09-10T09:18:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c14f700 con 0x7f917c06fd30 2023-09-10T09:18:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f917c16d410 con 0x7f917c06fd30 2023-09-10T09:18:08.464 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f91740b4040 con 0x7f917c06fd30 2023-09-10T09:18:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f915c065b20 0x7f915c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f917411dc80 con 0x7f917c06fd30 2023-09-10T09:18:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f915c06be20 0x7f915c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:08.465 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f915c06e930 con 0x7f915c06be20 2023-09-10T09:18:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9174120340 con 0x7f917c06fd30 2023-09-10T09:18:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9179d9b640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f915c065b20 0x7f915c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917ad9d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f915c06be20 0x7f915c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:08.466 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f917ad9d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f915c06be20 0x7f915c06e260 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:08.467 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:08.450+0000 7f9179d9b640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f915c065b20 0x7f915c067fe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f917c06b170 tx=0x7f9170009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:09.777 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.770+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== osd.0 v2:172.21.15.84:6816/3601459291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f915c06e930 con 0x7f915c06be20 2023-09-10T09:18:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.786+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 --> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f917c14d700 con 0x7f915c06be20 2023-09-10T09:18:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f916affd640 1 -- 172.21.15.84:0/4004225601 <== osd.0 v2:172.21.15.84:6816/3601459291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f917c14d700 con 0x7f915c06be20 2023-09-10T09:18:09.883 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:09.883 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:09.883 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f915c06be20 msgr2=0x7f915c06e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6816/3601459291,v1:172.21.15.84:6818/3601459291] conn(0x7f915c06be20 0x7f915c06e260 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f915c065b20 msgr2=0x7f915c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f915c065b20 0x7f915c067fe0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f917c06b170 tx=0x7f9170009040 comp rx=0 tx=0).stop 2023-09-10T09:18:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 msgr2=0x7f917c14bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 --2- 172.21.15.84:0/4004225601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f917c06fd30 0x7f917c14bd80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f91740b0040 tx=0x7f91740a5990 comp rx=0 tx=0).stop 2023-09-10T09:18:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f917ad9d640 1 -- 172.21.15.84:0/4004225601 reap_dead start 2023-09-10T09:18:09.886 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 shutdown_connections 2023-09-10T09:18:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.874+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 >> 172.21.15.84:0/4004225601 conn(0x7f917c0cc720 msgr2=0x7f917c15e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.878+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 shutdown_connections 2023-09-10T09:18:09.887 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:09.878+0000 7f9180c2d640 1 -- 172.21.15.84:0/4004225601 wait complete. 2023-09-10T09:18:09.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-10T09:18:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- 172.21.15.84:0/4254229923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560806cec0 msgr2=0x7f560806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 --2- 172.21.15.84:0/4254229923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560806cec0 0x7f560806d370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5600009bc0 tx=0x7f560001cb50 comp rx=0 tx=0).stop 2023-09-10T09:18:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- 172.21.15.84:0/4254229923 shutdown_connections 2023-09-10T09:18:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 --2- 172.21.15.84:0/4254229923 >> v2:172.21.15.100:3300/0 conn(0x7f560815c5f0 0x7f56080cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 --2- 172.21.15.84:0/4254229923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560806cec0 0x7f560806d370 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- 172.21.15.84:0/4254229923 >> 172.21.15.84:0/4254229923 conn(0x7f56080ca240 msgr2=0x7f56080ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- 172.21.15.84:0/4254229923 shutdown_connections 2023-09-10T09:18:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- 172.21.15.84:0/4254229923 wait complete. 2023-09-10T09:18:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 Processor -- start 2023-09-10T09:18:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.038+0000 7f560e869640 1 -- start start 2023-09-10T09:18:10.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f560806cec0 0x7f56081583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:10.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560815c210 0x7f5608153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:10.051 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56081f4f50 con 0x7f560815c5f0 2023-09-10T09:18:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56081f5ad0 con 0x7f560806cec0 2023-09-10T09:18:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56081f51a0 con 0x7f560815c210 2023-09-10T09:18:10.052 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34386/0 (socket says 172.21.15.84:34386) 2023-09-10T09:18:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 -- 172.21.15.84:0/1273248492 learned_addr learned my addr 172.21.15.84:0/1273248492 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f56077fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560815c210 0x7f5608153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f5607fff640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f560806cec0 0x7f56081583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 -- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560815c210 msgr2=0x7f5608153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560815c210 0x7f5608153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 -- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f560806cec0 msgr2=0x7f56081583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f560806cec0 0x7f56081583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 -- 172.21.15.84:0/1273248492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009820 con 0x7f560815c5f0 2023-09-10T09:18:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560ce06640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f560001b200 tx=0x7f56000a5a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:10.055 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600003b80 con 0x7f560815c5f0 2023-09-10T09:18:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56000a5c10 con 0x7f560815c5f0 2023-09-10T09:18:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600004030 con 0x7f560815c5f0 2023-09-10T09:18:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56081f5480 con 0x7f560815c5f0 2023-09-10T09:18:10.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608154530 con 0x7f560815c5f0 2023-09-10T09:18:10.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608073390 con 0x7f560815c5f0 2023-09-10T09:18:10.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.042+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f56000b4040 con 0x7f560815c5f0 2023-09-10T09:18:10.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.046+0000 7f5604ff9640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 0x7f55e8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:10.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.046+0000 7f5607fff640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 0x7f55e8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:10.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.046+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f560011dc00 con 0x7f560815c5f0 2023-09-10T09:18:10.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.046+0000 7f5607fff640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 0x7f55e8068010 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f56080af2c0 tx=0x7f55f0007cd0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:10.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.050+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5600124080 con 0x7f560815c5f0 2023-09-10T09:18:10.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.194+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f56081f5c10 con 0x7f55e8065b50 2023-09-10T09:18:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.950+0000 7f5604ff9640 1 -- 172.21.15.84:0/1273248492 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f56081f5c10 con 0x7f55e8065b50 2023-09-10T09:18:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 0 to deep-scrub 2023-09-10T09:18:10.960 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 msgr2=0x7f55e8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:10.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 0x7f55e8068010 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f56080af2c0 tx=0x7f55f0007cd0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 msgr2=0x7f560814f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:10.961 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f560001b200 tx=0x7f56000a5a20 comp rx=0 tx=0).stop 2023-09-10T09:18:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 shutdown_connections 2023-09-10T09:18:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f55e8065b50 0x7f55e8068010 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f560815c5f0 0x7f560814f4b0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.962 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f560815c210 0x7f5608153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 --2- 172.21.15.84:0/1273248492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f560806cec0 0x7f56081583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 >> 172.21.15.84:0/1273248492 conn(0x7f56080ca240 msgr2=0x7f5608152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:10.963 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 shutdown_connections 2023-09-10T09:18:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:10.954+0000 7f560e869640 1 -- 172.21.15.84:0/1273248492 wait complete. 2023-09-10T09:18:10.982 INFO:tasks.ceph:Scrubbing osd.1 2023-09-10T09:18:10.983 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:11.123 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 -- 172.21.15.84:0/1162696824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400b2150 msgr2=0x7efd400c87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 --2- 172.21.15.84:0/1162696824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400b2150 0x7efd400c87d0 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7efd38009c80 tx=0x7efd3801cd40 comp rx=0 tx=0).stop 2023-09-10T09:18:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 -- 172.21.15.84:0/1162696824 shutdown_connections 2023-09-10T09:18:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 --2- 172.21.15.84:0/1162696824 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400b2150 0x7efd400c87d0 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 --2- 172.21.15.84:0/1162696824 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd40156720 0x7efd4006bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 -- 172.21.15.84:0/1162696824 >> 172.21.15.84:0/1162696824 conn(0x7efd400c91a0 msgr2=0x7efd400c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 -- 172.21.15.84:0/1162696824 shutdown_connections 2023-09-10T09:18:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.114+0000 7efd45f8e640 1 -- 172.21.15.84:0/1162696824 wait complete. 2023-09-10T09:18:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 Processor -- start 2023-09-10T09:18:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- start start 2023-09-10T09:18:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd400b2150 0x7efd40147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 0x7efd400cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40156720 0x7efd4014b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:11.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd401479a0 con 0x7efd400c8350 2023-09-10T09:18:11.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd40155c20 con 0x7efd40156720 2023-09-10T09:18:11.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd40155f00 con 0x7efd400b2150 2023-09-10T09:18:11.129 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 0x7efd400cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:11.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 0x7efd400cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34414/0 (socket says 172.21.15.84:34414) 2023-09-10T09:18:11.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 -- 172.21.15.84:0/3822585132 learned_addr learned my addr 172.21.15.84:0/3822585132 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:11.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3f7fe640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd400b2150 0x7efd40147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:11.130 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3ffff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40156720 0x7efd4014b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:11.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 -- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd400b2150 msgr2=0x7efd40147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:11.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd400b2150 0x7efd40147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:11.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 -- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40156720 msgr2=0x7efd4014b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:11.131 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40156720 0x7efd4014b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:11.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380098e0 con 0x7efd400c8350 2023-09-10T09:18:11.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3ffff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd40156720 0x7efd4014b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:18:11.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd3effd640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 0x7efd400cab90 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efd3400c450 tx=0x7efd3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:11.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34012830 con 0x7efd400c8350 2023-09-10T09:18:11.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efd34012aa0 con 0x7efd400c8350 2023-09-10T09:18:11.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd40156ca0 con 0x7efd400c8350 2023-09-10T09:18:11.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34011380 con 0x7efd400c8350 2023-09-10T09:18:11.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd40157260 con 0x7efd400c8350 2023-09-10T09:18:11.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.118+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd4006ae90 con 0x7efd400c8350 2023-09-10T09:18:11.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7efd340114e0 con 0x7efd400c8350 2023-09-10T09:18:11.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7efd2c065b20 0x7efd2c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:11.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7efd34083ca0 con 0x7efd400c8350 2023-09-10T09:18:11.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd3f7fe640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7efd2c065b20 0x7efd2c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:11.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7efd2c06be20 0x7efd2c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:11.136 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd2c06e930 con 0x7efd2c06be20 2023-09-10T09:18:11.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd340840f0 con 0x7efd400c8350 2023-09-10T09:18:11.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd3ffff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7efd2c06be20 0x7efd2c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:11.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd3f7fe640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7efd2c065b20 0x7efd2c067fe0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efd30005fd0 tx=0x7efd30005d10 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:11.137 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.122+0000 7efd3ffff640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7efd2c06be20 0x7efd2c06e260 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:11.893 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.886+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== osd.1 v2:172.21.15.84:6800/680462698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd2c06e930 con 0x7efd2c06be20 2023-09-10T09:18:11.911 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:11.902+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 --> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd4004d8c0 con 0x7efd2c06be20 2023-09-10T09:18:12.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd27fff640 1 -- 172.21.15.84:0/3822585132 <== osd.1 v2:172.21.15.84:6800/680462698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efd4004d8c0 con 0x7efd2c06be20 2023-09-10T09:18:12.059 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:12.059 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:12.060 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7efd2c06be20 msgr2=0x7efd2c06e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6800/680462698,v1:172.21.15.84:6801/680462698] conn(0x7efd2c06be20 0x7efd2c06e260 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.061 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7efd2c065b20 msgr2=0x7efd2c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7efd2c065b20 0x7efd2c067fe0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efd30005fd0 tx=0x7efd30005d10 comp rx=0 tx=0).stop 2023-09-10T09:18:12.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 msgr2=0x7efd400cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 --2- 172.21.15.84:0/3822585132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd400c8350 0x7efd400cab90 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7efd3400c450 tx=0x7efd3400c910 comp rx=0 tx=0).stop 2023-09-10T09:18:12.062 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd3ffff640 1 -- 172.21.15.84:0/3822585132 reap_dead start 2023-09-10T09:18:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 shutdown_connections 2023-09-10T09:18:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 >> 172.21.15.84:0/3822585132 conn(0x7efd400c91a0 msgr2=0x7efd401629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:12.063 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 shutdown_connections 2023-09-10T09:18:12.064 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.050+0000 7efd45f8e640 1 -- 172.21.15.84:0/3822585132 wait complete. 2023-09-10T09:18:12.082 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-10T09:18:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- 172.21.15.84:0/380180451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 msgr2=0x7f42980cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- 172.21.15.84:0/380180451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f42980cd0d0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f42980c7da0 tx=0x7f429001cd30 comp rx=0 tx=0).stop 2023-09-10T09:18:12.214 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- 172.21.15.84:0/380180451 shutdown_connections 2023-09-10T09:18:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- 172.21.15.84:0/380180451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980c94b0 0x7f42980c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- 172.21.15.84:0/380180451 >> v2:172.21.15.100:3300/0 conn(0x7f42980b33b0 0x7f42980cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- 172.21.15.84:0/380180451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f42980cd0d0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.215 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- 172.21.15.84:0/380180451 >> 172.21.15.84:0/380180451 conn(0x7f42980ca240 msgr2=0x7f42980ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- 172.21.15.84:0/380180451 shutdown_connections 2023-09-10T09:18:12.216 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- 172.21.15.84:0/380180451 wait complete. 2023-09-10T09:18:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 Processor -- start 2023-09-10T09:18:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- start start 2023-09-10T09:18:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.219 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980b33b0 0x7f42980b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 0x7f42980b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42981565c0 con 0x7f429806d8c0 2023-09-10T09:18:12.220 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4298150220 con 0x7f42980c94b0 2023-09-10T09:18:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f429e64d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4298155940 con 0x7f42980b33b0 2023-09-10T09:18:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f4297fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.206+0000 7f4297fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34428/0 (socket says 172.21.15.84:34428) 2023-09-10T09:18:12.221 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 -- 172.21.15.84:0/1723307172 learned_addr learned my addr 172.21.15.84:0/1723307172 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f42977fe640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980b33b0 0x7f42980b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f429cbea640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 0x7f42980b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 -- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980b33b0 msgr2=0x7f42980b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.222 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980b33b0 0x7f42980b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 -- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 msgr2=0x7f42980b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 0x7f42980b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.223 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 -- 172.21.15.84:0/1723307172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900098e0 con 0x7f429806d8c0 2023-09-10T09:18:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f429cbea640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 0x7f42980b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4297fff640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f4290009bd0 tx=0x7f4290003b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290004e60 con 0x7f429806d8c0 2023-09-10T09:18:12.224 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f42900ad790 con 0x7f429806d8c0 2023-09-10T09:18:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4298155c20 con 0x7f429806d8c0 2023-09-10T09:18:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900adba0 con 0x7f429806d8c0 2023-09-10T09:18:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42981561e0 con 0x7f429806d8c0 2023-09-10T09:18:12.225 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4298073390 con 0x7f429806d8c0 2023-09-10T09:18:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f42900b4040 con 0x7f429806d8c0 2023-09-10T09:18:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 0x7f4278067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.226 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f429011d4f0 con 0x7f429806d8c0 2023-09-10T09:18:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f42977fe640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 0x7f4278067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.210+0000 7f42977fe640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 0x7f4278067fe0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4298154300 tx=0x7f428000b310 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:12.227 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.214+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f42900eb000 con 0x7f429806d8c0 2023-09-10T09:18:12.379 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.370+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f42980c3e20 con 0x7f4278065b20 2023-09-10T09:18:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f4294ff9640 1 -- 172.21.15.84:0/1723307172 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f42980c3e20 con 0x7f4278065b20 2023-09-10T09:18:12.430 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 1 to deep-scrub 2023-09-10T09:18:12.433 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 msgr2=0x7f4278067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 0x7f4278067fe0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4298154300 tx=0x7f428000b310 comp rx=0 tx=0).stop 2023-09-10T09:18:12.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 msgr2=0x7f429814fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.434 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f4290009bd0 tx=0x7f4290003b40 comp rx=0 tx=0).stop 2023-09-10T09:18:12.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 shutdown_connections 2023-09-10T09:18:12.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4278065b20 0x7f4278067fe0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42980c94b0 0x7f42980b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.435 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f42980b33b0 0x7f42980b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 --2- 172.21.15.84:0/1723307172 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f429806d8c0 0x7f429814fce0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 >> 172.21.15.84:0/1723307172 conn(0x7f42980ca240 msgr2=0x7f429815a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:12.436 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 shutdown_connections 2023-09-10T09:18:12.437 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.426+0000 7f429e64d640 1 -- 172.21.15.84:0/1723307172 wait complete. 2023-09-10T09:18:12.453 INFO:tasks.ceph:Scrubbing osd.2 2023-09-10T09:18:12.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:12.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- 172.21.15.84:0/222781727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec0b1f80 msgr2=0x7fcaec06a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/222781727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec0b1f80 0x7fcaec06a2c0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7fcaec066130 tx=0x7fcae401cd30 comp rx=0 tx=0).stop 2023-09-10T09:18:12.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- 172.21.15.84:0/222781727 shutdown_connections 2023-09-10T09:18:12.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/222781727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec0b1f80 0x7fcaec06a2c0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/222781727 >> v2:172.21.15.100:3300/0 conn(0x7fcaec06bb80 0x7fcaec0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- 172.21.15.84:0/222781727 >> 172.21.15.84:0/222781727 conn(0x7fcaec0c91a0 msgr2=0x7fcaec0c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:12.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- 172.21.15.84:0/222781727 shutdown_connections 2023-09-10T09:18:12.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- 172.21.15.84:0/222781727 wait complete. 2023-09-10T09:18:12.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 Processor -- start 2023-09-10T09:18:12.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 -- start start 2023-09-10T09:18:12.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.582+0000 7fcaf2b18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaec06bb80 0x7fcaec161450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcaec0b1f80 0x7fcaec14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 0x7fcaec161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec151640 con 0x7fcaec156720 2023-09-10T09:18:12.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec160690 con 0x7fcaec06bb80 2023-09-10T09:18:12.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec160970 con 0x7fcaec0b1f80 2023-09-10T09:18:12.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 0x7fcaec161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 0x7fcaec161cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34454/0 (socket says 172.21.15.84:34454) 2023-09-10T09:18:12.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 -- 172.21.15.84:0/3883838071 learned_addr learned my addr 172.21.15.84:0/3883838071 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:12.596 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf08b4640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaec06bb80 0x7fcaec161450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaebfff640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcaec0b1f80 0x7fcaec14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 -- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcaec0b1f80 msgr2=0x7fcaec14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcaec0b1f80 0x7fcaec14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 -- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaec06bb80 msgr2=0x7fcaec161450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:12.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaec06bb80 0x7fcaec161450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:12.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40098e0 con 0x7fcaec156720 2023-09-10T09:18:12.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaebfff640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcaec0b1f80 0x7fcaec14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:12.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf10b5640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 0x7fcaec161cd0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009bd0 tx=0x7fcae4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:12.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004140 con 0x7fcaec156720 2023-09-10T09:18:12.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcae4004390 con 0x7fcaec156720 2023-09-10T09:18:12.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec0c8be0 con 0x7fcaec156720 2023-09-10T09:18:12.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004740 con 0x7fcaec156720 2023-09-10T09:18:12.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec160f30 con 0x7fcaec156720 2023-09-10T09:18:12.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcaec165760 con 0x7fcaec156720 2023-09-10T09:18:12.601 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fcae40b4040 con 0x7fcaec156720 2023-09-10T09:18:12.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcad8065b20 0x7fcad8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fcae411d960 con 0x7fcaec156720 2023-09-10T09:18:12.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf08b4640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcad8065b20 0x7fcad8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.602 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7fcad806be20 0x7fcad806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:12.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcad806e930 con 0x7fcad806be20 2023-09-10T09:18:12.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae411ddb0 con 0x7fcaec156720 2023-09-10T09:18:12.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaebfff640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7fcad806be20 0x7fcad806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:12.603 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaf08b4640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcad8065b20 0x7fcad8067fe0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcaec15dd90 tx=0x7fcadc009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:12.604 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:12.586+0000 7fcaebfff640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7fcad806be20 0x7fcad806e260 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:13.268 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.262+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== osd.2 v2:172.21.15.84:6817/1006742702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcad806e930 con 0x7fcad806be20 2023-09-10T09:18:13.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.278+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 --> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcaec04d8c0 con 0x7fcad806be20 2023-09-10T09:18:13.511 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.502+0000 7fcae97fa640 1 -- 172.21.15.84:0/3883838071 <== osd.2 v2:172.21.15.84:6817/1006742702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcaec04d8c0 con 0x7fcad806be20 2023-09-10T09:18:13.511 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:13.512 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:13.512 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:13.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.502+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7fcad806be20 msgr2=0x7fcad806e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.502+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6817/1006742702,v1:172.21.15.84:6820/1006742702] conn(0x7fcad806be20 0x7fcad806e260 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.513 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcad8065b20 msgr2=0x7fcad8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fcad8065b20 0x7fcad8067fe0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fcaec15dd90 tx=0x7fcadc009040 comp rx=0 tx=0).stop 2023-09-10T09:18:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 msgr2=0x7fcaec161cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.514 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 --2- 172.21.15.84:0/3883838071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcaec156720 0x7fcaec161cd0 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009bd0 tx=0x7fcae4009300 comp rx=0 tx=0).stop 2023-09-10T09:18:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf10b5640 1 -- 172.21.15.84:0/3883838071 reap_dead start 2023-09-10T09:18:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 shutdown_connections 2023-09-10T09:18:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 >> 172.21.15.84:0/3883838071 conn(0x7fcaec0c91a0 msgr2=0x7fcaec1533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:13.515 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 shutdown_connections 2023-09-10T09:18:13.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.506+0000 7fcaf2b18640 1 -- 172.21.15.84:0/3883838071 wait complete. 2023-09-10T09:18:13.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-10T09:18:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 -- 172.21.15.84:0/3151724441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000c88b0 msgr2=0x7feb000c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 --2- 172.21.15.84:0/3151724441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000c88b0 0x7feb000c7090 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009840 tx=0x7feaf001c6b0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 -- 172.21.15.84:0/3151724441 shutdown_connections 2023-09-10T09:18:13.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 --2- 172.21.15.84:0/3151724441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c75d0 0x7feb000c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 --2- 172.21.15.84:0/3151724441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000c88b0 0x7feb000c7090 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 -- 172.21.15.84:0/3151724441 >> 172.21.15.84:0/3151724441 conn(0x7feb000c9500 msgr2=0x7feb000c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:13.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 -- 172.21.15.84:0/3151724441 shutdown_connections 2023-09-10T09:18:13.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.662+0000 7feb07e15640 1 -- 172.21.15.84:0/3151724441 wait complete. 2023-09-10T09:18:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 Processor -- start 2023-09-10T09:18:13.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- start start 2023-09-10T09:18:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb000c75d0 0x7feb000c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 0x7feb0014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00149d40 con 0x7feb000af4d0 2023-09-10T09:18:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c5400 con 0x7feb000c75d0 2023-09-10T09:18:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c56a0 con 0x7feb000c88b0 2023-09-10T09:18:13.677 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34464/0 (socket says 172.21.15.84:34464) 2023-09-10T09:18:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 -- 172.21.15.84:0/2411144128 learned_addr learned my addr 172.21.15.84:0/2411144128 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb063b2640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 0x7feb0014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb053b0640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb000c75d0 0x7feb000c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 -- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 msgr2=0x7feb0014a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 0x7feb0014a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 -- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb000c75d0 msgr2=0x7feb000c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.679 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb000c75d0 0x7feb000c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 -- 172.21.15.84:0/2411144128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00094a0 con 0x7feb000af4d0 2023-09-10T09:18:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb063b2640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 0x7feb0014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:13.680 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb05bb1640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c420 tx=0x7feafc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc004230 con 0x7feb000af4d0 2023-09-10T09:18:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feafc0044a0 con 0x7feb000af4d0 2023-09-10T09:18:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb000c5980 con 0x7feb000af4d0 2023-09-10T09:18:13.681 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc005260 con 0x7feb000af4d0 2023-09-10T09:18:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000c2730 con 0x7feb000af4d0 2023-09-10T09:18:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00073390 con 0x7feb000af4d0 2023-09-10T09:18:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.666+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7feafc0053c0 con 0x7feb000af4d0 2023-09-10T09:18:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.670+0000 7feaf67fc640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 0x7feae4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.670+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7feafc082740 con 0x7feb000af4d0 2023-09-10T09:18:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.670+0000 7feb053b0640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 0x7feae4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.670+0000 7feb053b0640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 0x7feae4067fe0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af000 tx=0x7feaf001aef0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.674+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7feafc050250 con 0x7feb000af4d0 2023-09-10T09:18:13.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.830+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0006bba0 con 0x7feae4065b20 2023-09-10T09:18:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.830+0000 7feaf67fc640 1 -- 172.21.15.84:0/2411144128 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feaf00a5b30 con 0x7feae4065b20 2023-09-10T09:18:13.839 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 2 to deep-scrub 2023-09-10T09:18:13.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 msgr2=0x7feae4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 0x7feae4067fe0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7feaf00af000 tx=0x7feaf001aef0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.841 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 msgr2=0x7feb000c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c420 tx=0x7feafc00c8e0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 shutdown_connections 2023-09-10T09:18:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7feae4065b20 0x7feae4067fe0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.842 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feb000c88b0 0x7feb0014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb000c75d0 0x7feb000c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 --2- 172.21.15.84:0/2411144128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb000af4d0 0x7feb000c4ec0 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.843 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 >> 172.21.15.84:0/2411144128 conn(0x7feb000c9500 msgr2=0x7feb000c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:13.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 shutdown_connections 2023-09-10T09:18:13.844 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.834+0000 7feb07e15640 1 -- 172.21.15.84:0/2411144128 wait complete. 2023-09-10T09:18:13.858 INFO:tasks.ceph:Scrubbing osd.3 2023-09-10T09:18:13.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:13.983 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 -- 172.21.15.84:0/4233378696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c1571a0 msgr2=0x7f457c06c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 --2- 172.21.15.84:0/4233378696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c1571a0 0x7f457c06c360 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7f457c070380 tx=0x7f456c01db10 comp rx=0 tx=0).stop 2023-09-10T09:18:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 -- 172.21.15.84:0/4233378696 shutdown_connections 2023-09-10T09:18:13.984 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 --2- 172.21.15.84:0/4233378696 >> v2:172.21.15.100:3300/0 conn(0x7f457c0cb4f0 0x7f457c15abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 --2- 172.21.15.84:0/4233378696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c1571a0 0x7f457c06c360 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 -- 172.21.15.84:0/4233378696 >> 172.21.15.84:0/4233378696 conn(0x7f457c0aea00 msgr2=0x7f457c0aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:13.985 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 -- 172.21.15.84:0/4233378696 shutdown_connections 2023-09-10T09:18:13.986 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.974+0000 7f45826dd640 1 -- 172.21.15.84:0/4233378696 wait complete. 2023-09-10T09:18:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 Processor -- start 2023-09-10T09:18:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- start start 2023-09-10T09:18:13.989 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f457c0cb4f0 0x7f457c0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457c1571a0 0x7f457c1f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 0x7f457c1f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c1a40 con 0x7f457c15b120 2023-09-10T09:18:13.990 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c4850 con 0x7f457c0cb4f0 2023-09-10T09:18:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c4b30 con 0x7f457c1571a0 2023-09-10T09:18:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 0x7f457c1f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 0x7f457c1f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34482/0 (socket says 172.21.15.84:34482) 2023-09-10T09:18:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 -- 172.21.15.84:0/495187810 learned_addr learned my addr 172.21.15.84:0/495187810 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f457b7fe640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457c1571a0 0x7f457c1f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f457bfff640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f457c0cb4f0 0x7f457c0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.992 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 -- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457c1571a0 msgr2=0x7f457c1f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f457c1571a0 0x7f457c1f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 -- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f457c0cb4f0 msgr2=0x7f457c0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:13.993 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f457c0cb4f0 0x7f457c0c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c00a670 con 0x7f457c15b120 2023-09-10T09:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4580c7a640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 0x7f457c1f1c60 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f457400c730 tx=0x7f457400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574003b80 con 0x7f457c15b120 2023-09-10T09:18:13.994 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4574003ce0 con 0x7f457c15b120 2023-09-10T09:18:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c0c4e10 con 0x7f457c15b120 2023-09-10T09:18:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400aa50 con 0x7f457c15b120 2023-09-10T09:18:13.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c151d70 con 0x7f457c15b120 2023-09-10T09:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f457c0722f0 con 0x7f457c15b120 2023-09-10T09:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.978+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f457400abb0 con 0x7f457c15b120 2023-09-10T09:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f4578ff9640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4568065b50 0x7f4568068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4574083a20 con 0x7f457c15b120 2023-09-10T09:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f457bfff640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4568065b50 0x7f4568068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f4578ff9640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f456806be50 0x7f456806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:13.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f456806e960 con 0x7f456806be50 2023-09-10T09:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4574083e70 con 0x7f457c15b120 2023-09-10T09:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f457b7fe640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f456806be50 0x7f456806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f457bfff640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4568065b50 0x7f4568068010 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f456c0b0000 tx=0x7f456c01c350 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:13.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:13.982+0000 7f457b7fe640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f456806be50 0x7f456806e290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.650+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== osd.3 v2:172.21.15.84:6808/2125649625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f456806e960 con 0x7f456806be50 2023-09-10T09:18:14.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.666+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 --> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f457c0c1b80 con 0x7f456806be50 2023-09-10T09:18:14.875 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.866+0000 7f4578ff9640 1 -- 172.21.15.84:0/495187810 <== osd.3 v2:172.21.15.84:6808/2125649625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f457c0c1b80 con 0x7f456806be50 2023-09-10T09:18:14.876 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:14.876 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:14.876 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:14.877 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f456806be50 msgr2=0x7f456806e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6808/2125649625,v1:172.21.15.84:6809/2125649625] conn(0x7f456806be50 0x7f456806e290 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4568065b50 msgr2=0x7f4568068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f4568065b50 0x7f4568068010 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f456c0b0000 tx=0x7f456c01c350 comp rx=0 tx=0).stop 2023-09-10T09:18:14.878 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 msgr2=0x7f457c1f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:14.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 --2- 172.21.15.84:0/495187810 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f457c15b120 0x7f457c1f1c60 secure :-1 s=READY pgs=2348 cs=0 l=1 rev1=1 crypto rx=0x7f457400c730 tx=0x7f457400cbf0 comp rx=0 tx=0).stop 2023-09-10T09:18:14.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f4580c7a640 1 -- 172.21.15.84:0/495187810 reap_dead start 2023-09-10T09:18:14.879 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 shutdown_connections 2023-09-10T09:18:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 >> 172.21.15.84:0/495187810 conn(0x7f457c0aea00 msgr2=0x7f457c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 shutdown_connections 2023-09-10T09:18:14.880 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:14.870+0000 7f45826dd640 1 -- 172.21.15.84:0/495187810 wait complete. 2023-09-10T09:18:14.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-10T09:18:15.030 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- 172.21.15.84:0/2005709457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff150158bd0 msgr2=0x7ff15006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 --2- 172.21.15.84:0/2005709457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff150158bd0 0x7ff15006d2a0 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7ff1500aefd0 tx=0x7ff14801cca0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- 172.21.15.84:0/2005709457 shutdown_connections 2023-09-10T09:18:15.031 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 --2- 172.21.15.84:0/2005709457 >> v2:172.21.15.100:3300/0 conn(0x7ff1500b06f0 0x7ff1500b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 --2- 172.21.15.84:0/2005709457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff1500afe90 0x7ff1500c01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 --2- 172.21.15.84:0/2005709457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff150158bd0 0x7ff15006d2a0 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- 172.21.15.84:0/2005709457 >> 172.21.15.84:0/2005709457 conn(0x7ff1500c9500 msgr2=0x7ff1500c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.032 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- 172.21.15.84:0/2005709457 shutdown_connections 2023-09-10T09:18:15.033 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- 172.21.15.84:0/2005709457 wait complete. 2023-09-10T09:18:15.035 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 Processor -- start 2023-09-10T09:18:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.022+0000 7ff156efa640 1 -- start start 2023-09-10T09:18:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 0x7ff1501592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff150158bd0 0x7ff15014d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150156ee0 con 0x7ff1500b06f0 2023-09-10T09:18:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1501568b0 con 0x7ff1500afe90 2023-09-10T09:18:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15014d770 con 0x7ff150158bd0 2023-09-10T09:18:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34488/0 (socket says 172.21.15.84:34488) 2023-09-10T09:18:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 -- 172.21.15.84:0/2093580744 learned_addr learned my addr 172.21.15.84:0/2093580744 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff154c96640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 0x7ff1501592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff155497640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff150158bd0 0x7ff15014d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 -- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff150158bd0 msgr2=0x7ff15014d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.039 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff150158bd0 0x7ff15014d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 -- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 msgr2=0x7ff1501592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 0x7ff1501592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.040 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 -- 172.21.15.84:0/2093580744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1480098e0 con 0x7ff1500b06f0 2023-09-10T09:18:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff154c96640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 0x7ff1501592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14ffff640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d750 tx=0x7ff13800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138009c30 con 0x7ff1500b06f0 2023-09-10T09:18:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff138009e80 con 0x7ff1500b06f0 2023-09-10T09:18:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1500c08d0 con 0x7ff1500b06f0 2023-09-10T09:18:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138004260 con 0x7ff1500b06f0 2023-09-10T09:18:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15014dd00 con 0x7ff1500b06f0 2023-09-10T09:18:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff150157150 con 0x7ff1500b06f0 2023-09-10T09:18:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7ff138005020 con 0x7ff1500b06f0 2023-09-10T09:18:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 0x7ff130067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff138083690 con 0x7ff1500b06f0 2023-09-10T09:18:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff154c96640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 0x7ff130067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.026+0000 7ff154c96640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 0x7ff130067fe0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff1480af000 tx=0x7ff14801b4e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.030+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7ff138051110 con 0x7ff1500b06f0 2023-09-10T09:18:15.192 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff15015c580 con 0x7ff130065b20 2023-09-10T09:18:15.193 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff14d7fa640 1 -- 172.21.15.84:0/2093580744 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff148004a50 con 0x7ff130065b20 2023-09-10T09:18:15.194 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 3 to deep-scrub 2023-09-10T09:18:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 msgr2=0x7ff130067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 0x7ff130067fe0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff1480af000 tx=0x7ff14801b4e0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.195 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 msgr2=0x7ff15014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d750 tx=0x7ff13800dc10 comp rx=0 tx=0).stop 2023-09-10T09:18:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 shutdown_connections 2023-09-10T09:18:15.196 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7ff130065b20 0x7ff130067fe0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff150158bd0 0x7ff15014d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1500b06f0 0x7ff15014ccf0 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 --2- 172.21.15.84:0/2093580744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1500afe90 0x7ff1501592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 >> 172.21.15.84:0/2093580744 conn(0x7ff1500c9500 msgr2=0x7ff1500cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 shutdown_connections 2023-09-10T09:18:15.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.186+0000 7ff156efa640 1 -- 172.21.15.84:0/2093580744 wait complete. 2023-09-10T09:18:15.211 INFO:tasks.ceph:Scrubbing osd.4 2023-09-10T09:18:15.211 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:15.341 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- 172.21.15.84:0/227938304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 msgr2=0x7f82980b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- 172.21.15.84:0/227938304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f82980b0b90 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f82980b1a00 tx=0x7f828001c870 comp rx=0 tx=0).stop 2023-09-10T09:18:15.342 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- 172.21.15.84:0/227938304 shutdown_connections 2023-09-10T09:18:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- 172.21.15.84:0/227938304 >> v2:172.21.15.100:3300/0 conn(0x7f8298069a00 0x7f82980b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- 172.21.15.84:0/227938304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f82980b0b90 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- 172.21.15.84:0/227938304 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82981414a0 0x7f829806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.343 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- 172.21.15.84:0/227938304 >> 172.21.15.84:0/227938304 conn(0x7f82980c91a0 msgr2=0x7f82980c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- 172.21.15.84:0/227938304 shutdown_connections 2023-09-10T09:18:15.344 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- 172.21.15.84:0/227938304 wait complete. 2023-09-10T09:18:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 Processor -- start 2023-09-10T09:18:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- start start 2023-09-10T09:18:15.347 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8298069a00 0x7f82980c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f8298157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82981414a0 0x7f8298157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82981f72a0 con 0x7f829806ca80 2023-09-10T09:18:15.348 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298157b80 con 0x7f8298069a00 2023-09-10T09:18:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f829dede640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829815a110 con 0x7f82981414a0 2023-09-10T09:18:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f8296ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f8298157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f8296ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f8298157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34506/0 (socket says 172.21.15.84:34506) 2023-09-10T09:18:15.349 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.334+0000 7f8296ffd640 1 -- 172.21.15.84:0/2267817737 learned_addr learned my addr 172.21.15.84:0/2267817737 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:15.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f82977fe640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8298069a00 0x7f82980c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8297fff640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82981414a0 0x7f8298157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.350 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 -- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82981414a0 msgr2=0x7f8298157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f82981414a0 0x7f8298157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 -- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8298069a00 msgr2=0x7f82980c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.351 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8298069a00 0x7f82980c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009560 con 0x7f829806ca80 2023-09-10T09:18:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8296ffd640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f8298157100 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f82800b0040 tx=0x7f82800a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280005230 con 0x7f829806ca80 2023-09-10T09:18:15.352 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8280005480 con 0x7f829806ca80 2023-09-10T09:18:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82981f74f0 con 0x7f829806ca80 2023-09-10T09:18:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280004930 con 0x7f829806ca80 2023-09-10T09:18:15.353 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82981f7ab0 con 0x7f829806ca80 2023-09-10T09:18:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f829804d8c0 con 0x7f829806ca80 2023-09-10T09:18:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f82800b4070 con 0x7f829806ca80 2023-09-10T09:18:15.354 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8278065b20 0x7f8278067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f828011dab0 con 0x7f829806ca80 2023-09-10T09:18:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f82977fe640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8278065b20 0x7f8278067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f827806be20 0x7f827806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.355 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f827806e930 con 0x7f827806be20 2023-09-10T09:18:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828011df00 con 0x7f829806ca80 2023-09-10T09:18:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f82977fe640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8278065b20 0x7f8278067fe0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8290005fd0 tx=0x7f8290005ea0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8297fff640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f827806be20 0x7f827806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.338+0000 7f8297fff640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f827806be20 0x7f827806e260 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.453 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.446+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== osd.4 v2:172.21.15.100:6800/2271215042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f827806e930 con 0x7f827806be20 2023-09-10T09:18:15.468 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.462+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 --> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f82981f7ca0 con 0x7f827806be20 2023-09-10T09:18:15.504 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f828ffff640 1 -- 172.21.15.84:0/2267817737 <== osd.4 v2:172.21.15.100:6800/2271215042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f82981f7ca0 con 0x7f827806be20 2023-09-10T09:18:15.505 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:15.505 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:15.505 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:15.506 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f827806be20 msgr2=0x7f827806e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.100:6800/2271215042,v1:172.21.15.100:6801/2271215042] conn(0x7f827806be20 0x7f827806e260 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8278065b20 msgr2=0x7f8278067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8278065b20 0x7f8278067fe0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8290005fd0 tx=0x7f8290005ea0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.507 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 msgr2=0x7f8298157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 --2- 172.21.15.84:0/2267817737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829806ca80 0x7f8298157100 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f82800b0040 tx=0x7f82800a56b0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f8297fff640 1 -- 172.21.15.84:0/2267817737 reap_dead start 2023-09-10T09:18:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 shutdown_connections 2023-09-10T09:18:15.508 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 >> 172.21.15.84:0/2267817737 conn(0x7f82980c91a0 msgr2=0x7f82980653d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 shutdown_connections 2023-09-10T09:18:15.509 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.498+0000 7f829dede640 1 -- 172.21.15.84:0/2267817737 wait complete. 2023-09-10T09:18:15.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-10T09:18:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/1326698005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 msgr2=0x7f99080b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- 172.21.15.84:0/1326698005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f99080b0b40 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f99080c8fd0 tx=0x7f990001c7e0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/1326698005 shutdown_connections 2023-09-10T09:18:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- 172.21.15.84:0/1326698005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f99080b0b40 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- 172.21.15.84:0/1326698005 >> v2:172.21.15.100:3300/0 conn(0x7f9908158bd0 0x7f990806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/1326698005 >> 172.21.15.84:0/1326698005 conn(0x7f99080c9500 msgr2=0x7f99080c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/1326698005 shutdown_connections 2023-09-10T09:18:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/1326698005 wait complete. 2023-09-10T09:18:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 Processor -- start 2023-09-10T09:18:15.666 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- start start 2023-09-10T09:18:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99080afe90 0x7f9908157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.667 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 0x7f99080c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080c4ba0 con 0x7f99080b06f0 2023-09-10T09:18:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99080c4e40 con 0x7f99080afe90 2023-09-10T09:18:15.668 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99080c5120 con 0x7f9908158bd0 2023-09-10T09:18:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34532/0 (socket says 172.21.15.84:34532) 2023-09-10T09:18:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 -- 172.21.15.84:0/3700296668 learned_addr learned my addr 172.21.15.84:0/3700296668 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:15.669 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f9906d9d640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99080afe90 0x7f9908157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990759e640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 0x7f99080c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.670 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 -- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 msgr2=0x7f99080c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 0x7f99080c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 -- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99080afe90 msgr2=0x7f9908157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99080afe90 0x7f9908157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.671 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 -- 172.21.15.84:0/3700296668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900009560 con 0x7f99080b06f0 2023-09-10T09:18:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990759e640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 0x7f99080c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:18:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990659c640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c420 tx=0x7f98f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.672 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f80052d0 con 0x7f99080b06f0 2023-09-10T09:18:15.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98f8007020 con 0x7f99080b06f0 2023-09-10T09:18:15.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99080c5400 con 0x7f99080b06f0 2023-09-10T09:18:15.673 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.654+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8007430 con 0x7f99080b06f0 2023-09-10T09:18:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990814c070 con 0x7f99080b06f0 2023-09-10T09:18:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990806bdd0 con 0x7f99080b06f0 2023-09-10T09:18:15.674 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f98f80067e0 con 0x7f99080b06f0 2023-09-10T09:18:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f98ef7fe640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 0x7f98f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f9906d9d640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 0x7f98f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:15.675 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f98f8082570 con 0x7f99080b06f0 2023-09-10T09:18:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.658+0000 7f9906d9d640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 0x7f98f4067fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f98fc005c50 tx=0x7f98fc005be0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:15.676 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.662+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f98f8050110 con 0x7f99080b06f0 2023-09-10T09:18:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.818+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f99081658e0 con 0x7f98f4065b20 2023-09-10T09:18:15.846 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.838+0000 7f98ef7fe640 1 -- 172.21.15.84:0/3700296668 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98fc009a70 con 0x7f98f4065b20 2023-09-10T09:18:15.846 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 4 to deep-scrub 2023-09-10T09:18:15.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 msgr2=0x7f98f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 0x7f98f4067fe0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f98fc005c50 tx=0x7f98fc005be0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.849 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 msgr2=0x7f990815b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c420 tx=0x7f98f800c8e0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 shutdown_connections 2023-09-10T09:18:15.850 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f98f4065b20 0x7f98f4067fe0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9908158bd0 0x7f99080c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99080b06f0 0x7f990815b050 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 --2- 172.21.15.84:0/3700296668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99080afe90 0x7f9908157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.851 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 >> 172.21.15.84:0/3700296668 conn(0x7f99080c9500 msgr2=0x7f99080c0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 shutdown_connections 2023-09-10T09:18:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.842+0000 7f990d06f640 1 -- 172.21.15.84:0/3700296668 wait complete. 2023-09-10T09:18:15.866 INFO:tasks.ceph:Scrubbing osd.5 2023-09-10T09:18:15.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:15.995 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 -- 172.21.15.84:0/3615728567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c600b1f80 msgr2=0x7f8c6006a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:15.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 --2- 172.21.15.84:0/3615728567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c600b1f80 0x7f8c6006a2c0 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009bc0 tx=0x7f8c5801cb50 comp rx=0 tx=0).stop 2023-09-10T09:18:15.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 -- 172.21.15.84:0/3615728567 shutdown_connections 2023-09-10T09:18:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 --2- 172.21.15.84:0/3615728567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c600b1f80 0x7f8c6006a2c0 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 --2- 172.21.15.84:0/3615728567 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c6006bb80 0x7f8c600b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:15.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 -- 172.21.15.84:0/3615728567 >> 172.21.15.84:0/3615728567 conn(0x7f8c600c91a0 msgr2=0x7f8c600c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 -- 172.21.15.84:0/3615728567 shutdown_connections 2023-09-10T09:18:15.998 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.986+0000 7f8c65088640 1 -- 172.21.15.84:0/3615728567 wait complete. 2023-09-10T09:18:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 Processor -- start 2023-09-10T09:18:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- start start 2023-09-10T09:18:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c6006bb80 0x7f8c6015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c600b1f80 0x7f8c600ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 0x7f8c600ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60140d40 con 0x7f8c60156720 2023-09-10T09:18:16.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6015ee30 con 0x7f8c600b1f80 2023-09-10T09:18:16.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6015f110 con 0x7f8c6006bb80 2023-09-10T09:18:16.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 0x7f8c600ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 0x7f8c600ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34554/0 (socket says 172.21.15.84:34554) 2023-09-10T09:18:16.003 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 -- 172.21.15.84:0/2690320511 learned_addr learned my addr 172.21.15.84:0/2690320511 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:16.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5ed9d640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c6006bb80 0x7f8c6015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5e59c640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c600b1f80 0x7f8c600ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.004 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 -- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c6006bb80 msgr2=0x7f8c6015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c6006bb80 0x7f8c6015e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 -- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c600b1f80 msgr2=0x7f8c600ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c600b1f80 0x7f8c600ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.005 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009820 con 0x7f8c60156720 2023-09-10T09:18:16.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c5f59e640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 0x7f8c600ca7d0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f8c5801c5c0 tx=0x7f8c580a5aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003b80 con 0x7f8c60156720 2023-09-10T09:18:16.006 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c58003dd0 con 0x7f8c60156720 2023-09-10T09:18:16.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c600c8be0 con 0x7f8c60156720 2023-09-10T09:18:16.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58004230 con 0x7f8c60156720 2023-09-10T09:18:16.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6015f6d0 con 0x7f8c60156720 2023-09-10T09:18:16.007 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.990+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c600c8a60 con 0x7f8c60156720 2023-09-10T09:18:16.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f8c580a5d50 con 0x7f8c60156720 2023-09-10T09:18:16.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c40065b20 0x7f8c40067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.008 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8c5811e590 con 0x7f8c60156720 2023-09-10T09:18:16.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c5ed9d640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c40065b20 0x7f8c40067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f8c4006be20 0x7f8c4006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c4006e930 con 0x7f8c4006be20 2023-09-10T09:18:16.009 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5811e9e0 con 0x7f8c60156720 2023-09-10T09:18:16.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c5e59c640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f8c4006be20 0x7f8c4006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.010 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c5ed9d640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c40065b20 0x7f8c40067fe0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000f70 tx=0x7f8c50009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.011 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:15.994+0000 7f8c5e59c640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f8c4006be20 0x7f8c4006e260 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.099 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.094+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== osd.5 v2:172.21.15.100:6810/3847761032 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8c4006e930 con 0x7f8c4006be20 2023-09-10T09:18:16.113 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.106+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 --> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8c6015fb00 con 0x7f8c4006be20 2023-09-10T09:18:16.117 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c577fe640 1 -- 172.21.15.84:0/2690320511 <== osd.5 v2:172.21.15.100:6810/3847761032 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8c6015fb00 con 0x7f8c4006be20 2023-09-10T09:18:16.117 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:16.117 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:16.118 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:16.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f8c4006be20 msgr2=0x7f8c4006e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.100:6810/3847761032,v1:172.21.15.100:6812/3847761032] conn(0x7f8c4006be20 0x7f8c4006e260 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.119 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c40065b20 msgr2=0x7f8c40067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f8c40065b20 0x7f8c40067fe0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000f70 tx=0x7f8c50009040 comp rx=0 tx=0).stop 2023-09-10T09:18:16.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 msgr2=0x7f8c600ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.120 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 --2- 172.21.15.84:0/2690320511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8c60156720 0x7f8c600ca7d0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f8c5801c5c0 tx=0x7f8c580a5aa0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c5f59e640 1 -- 172.21.15.84:0/2690320511 reap_dead start 2023-09-10T09:18:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 shutdown_connections 2023-09-10T09:18:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 >> 172.21.15.84:0/2690320511 conn(0x7f8c600c91a0 msgr2=0x7f8c6015aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:16.121 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 shutdown_connections 2023-09-10T09:18:16.122 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.110+0000 7f8c65088640 1 -- 172.21.15.84:0/2690320511 wait complete. 2023-09-10T09:18:16.140 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-10T09:18:16.275 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 -- 172.21.15.84:0/2931836045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380c94b0 msgr2=0x7f31380c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 --2- 172.21.15.84:0/2931836045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380c94b0 0x7f31380c98e0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f31380c7da0 tx=0x7f313001cd30 comp rx=0 tx=0).stop 2023-09-10T09:18:16.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 -- 172.21.15.84:0/2931836045 shutdown_connections 2023-09-10T09:18:16.276 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 --2- 172.21.15.84:0/2931836045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380c94b0 0x7f31380c98e0 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 --2- 172.21.15.84:0/2931836045 >> v2:172.21.15.100:3300/0 conn(0x7f31380b33b0 0x7f31380cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 -- 172.21.15.84:0/2931836045 >> 172.21.15.84:0/2931836045 conn(0x7f31380ca240 msgr2=0x7f31380ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:16.277 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 -- 172.21.15.84:0/2931836045 shutdown_connections 2023-09-10T09:18:16.278 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.266+0000 7f313fb49640 1 -- 172.21.15.84:0/2931836045 wait complete. 2023-09-10T09:18:16.280 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 Processor -- start 2023-09-10T09:18:16.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- start start 2023-09-10T09:18:16.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 0x7f313814fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.281 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31380c94b0 0x7f31380c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138161900 con 0x7f31380b33b0 2023-09-10T09:18:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3138150140 con 0x7f313806d8c0 2023-09-10T09:18:16.282 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31380c63e0 con 0x7f31380c94b0 2023-09-10T09:18:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34562/0 (socket says 172.21.15.84:34562) 2023-09-10T09:18:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 -- 172.21.15.84:0/1871757500 learned_addr learned my addr 172.21.15.84:0/1871757500 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:16.283 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313e0e6640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31380c94b0 0x7f31380c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d8e5640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 0x7f313814fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 -- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31380c94b0 msgr2=0x7f31380c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.284 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31380c94b0 0x7f31380c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 -- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 msgr2=0x7f313814fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 0x7f313814fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 -- 172.21.15.84:0/1871757500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300098e0 con 0x7f31380b33b0 2023-09-10T09:18:16.285 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d8e5640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 0x7f313814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:18:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313d0e4640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9f0 tx=0x7f313400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340096f0 con 0x7f31380b33b0 2023-09-10T09:18:16.286 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f313400cda0 con 0x7f31380b33b0 2023-09-10T09:18:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3138158630 con 0x7f31380b33b0 2023-09-10T09:18:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134004290 con 0x7f31380b33b0 2023-09-10T09:18:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3138158bf0 con 0x7f31380b33b0 2023-09-10T09:18:16.287 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.270+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31380b2ce0 con 0x7f31380b33b0 2023-09-10T09:18:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.274+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f3134003600 con 0x7f31380b33b0 2023-09-10T09:18:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.274+0000 7f312e7fc640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 0x7f311c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.288 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.274+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3134014070 con 0x7f31380b33b0 2023-09-10T09:18:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.274+0000 7f313d8e5640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 0x7f311c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.289 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.274+0000 7f313d8e5640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 0x7f311c067fe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3128000f70 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.290 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.278+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f31340517a0 con 0x7f31380b33b0 2023-09-10T09:18:16.441 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f3138073390 con 0x7f311c065b20 2023-09-10T09:18:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f312e7fc640 1 -- 172.21.15.84:0/1871757500 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3138073390 con 0x7f311c065b20 2023-09-10T09:18:16.442 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 5 to deep-scrub 2023-09-10T09:18:16.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 msgr2=0x7f311c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.444 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 0x7f311c067fe0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f3128000f70 tx=0x7f3128009040 comp rx=0 tx=0).stop 2023-09-10T09:18:16.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 msgr2=0x7f31380c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f313400e9f0 tx=0x7f313400eeb0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 shutdown_connections 2023-09-10T09:18:16.445 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f311c065b20 0x7f311c067fe0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f31380c94b0 0x7f31380c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31380b33b0 0x7f31380c5960 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.446 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 --2- 172.21.15.84:0/1871757500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313806d8c0 0x7f313814fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.434+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 >> 172.21.15.84:0/1871757500 conn(0x7f31380ca240 msgr2=0x7f3138069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:16.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.438+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 shutdown_connections 2023-09-10T09:18:16.447 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.438+0000 7f313fb49640 1 -- 172.21.15.84:0/1871757500 wait complete. 2023-09-10T09:18:16.459 INFO:tasks.ceph:Scrubbing osd.6 2023-09-10T09:18:16.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:16.583 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 -- 172.21.15.84:0/22073801 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006a770 msgr2=0x7f63d00b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/22073801 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006a770 0x7f63d00b2020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009900 tx=0x7f63c401c830 comp rx=0 tx=0).stop 2023-09-10T09:18:16.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 -- 172.21.15.84:0/22073801 shutdown_connections 2023-09-10T09:18:16.584 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/22073801 >> v2:172.21.15.100:3300/0 conn(0x7f63d006c670 0x7f63d00ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/22073801 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006a770 0x7f63d00b2020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 -- 172.21.15.84:0/22073801 >> 172.21.15.84:0/22073801 conn(0x7f63d00c91a0 msgr2=0x7f63d00c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:16.585 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 -- 172.21.15.84:0/22073801 shutdown_connections 2023-09-10T09:18:16.586 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.574+0000 7f63d5cfd640 1 -- 172.21.15.84:0/22073801 wait complete. 2023-09-10T09:18:16.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 Processor -- start 2023-09-10T09:18:16.588 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- start start 2023-09-10T09:18:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d006a770 0x7f63d014eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 0x7f63d0155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.589 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006c670 0x7f63d01433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0142f90 con 0x7f63d006bb80 2023-09-10T09:18:16.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d014f400 con 0x7f63d006a770 2023-09-10T09:18:16.590 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d014f120 con 0x7f63d006c670 2023-09-10T09:18:16.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 0x7f63d0155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 0x7f63d0155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34578/0 (socket says 172.21.15.84:34578) 2023-09-10T09:18:16.591 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 -- 172.21.15.84:0/3781866294 learned_addr learned my addr 172.21.15.84:0/3781866294 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:16.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63cffff640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006c670 0x7f63d01433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d006a770 0x7f63d014eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 -- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006c670 msgr2=0x7f63d01433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.592 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63d006c670 0x7f63d01433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 -- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d006a770 msgr2=0x7f63d014eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:16.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d006a770 0x7f63d014eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:16.593 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4009560 con 0x7f63d006bb80 2023-09-10T09:18:16.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63ceffd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 0x7f63d0155b70 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f63c401a460 tx=0x7f63c40a6580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4004240 con 0x7f63d006bb80 2023-09-10T09:18:16.594 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f63c40b9070 con 0x7f63d006bb80 2023-09-10T09:18:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d01428d0 con 0x7f63d006bb80 2023-09-10T09:18:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005020 con 0x7f63d006bb80 2023-09-10T09:18:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d0150bf0 con 0x7f63d006bb80 2023-09-10T09:18:16.595 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.578+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63d004d8c0 con 0x7f63d006bb80 2023-09-10T09:18:16.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f63c4005180 con 0x7f63d006bb80 2023-09-10T09:18:16.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f63bc065b20 0x7f63bc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.597 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f63c40aa070 con 0x7f63d006bb80 2023-09-10T09:18:16.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f63bc065b20 0x7f63bc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f63bc06be20 0x7f63bc06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:16.598 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63bc06e930 con 0x7f63bc06be20 2023-09-10T09:18:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c4120a00 con 0x7f63d006bb80 2023-09-10T09:18:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63cf7fe640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f63bc065b20 0x7f63bc067fe0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007fd0 tx=0x7f63c8009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:16.599 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63cffff640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f63bc06be20 0x7f63bc06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:16.600 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:16.582+0000 7f63cffff640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f63bc06be20 0x7f63bc06e260 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:17.082 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.078+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== osd.6 v2:172.21.15.100:6824/133961389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f63bc06e930 con 0x7f63bc06be20 2023-09-10T09:18:17.097 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.090+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 --> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f63d01430d0 con 0x7f63bc06be20 2023-09-10T09:18:17.306 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63b7fff640 1 -- 172.21.15.84:0/3781866294 <== osd.6 v2:172.21.15.100:6824/133961389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f63d01430d0 con 0x7f63bc06be20 2023-09-10T09:18:17.307 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:17.307 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:17.308 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f63bc06be20 msgr2=0x7f63bc06e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.100:6824/133961389,v1:172.21.15.100:6825/133961389] conn(0x7f63bc06be20 0x7f63bc06e260 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.309 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f63bc065b20 msgr2=0x7f63bc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f63bc065b20 0x7f63bc067fe0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007fd0 tx=0x7f63c8009040 comp rx=0 tx=0).stop 2023-09-10T09:18:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 msgr2=0x7f63d0155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 --2- 172.21.15.84:0/3781866294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d006bb80 0x7f63d0155b70 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f63c401a460 tx=0x7f63c40a6580 comp rx=0 tx=0).stop 2023-09-10T09:18:17.310 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63cffff640 1 -- 172.21.15.84:0/3781866294 reap_dead start 2023-09-10T09:18:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 shutdown_connections 2023-09-10T09:18:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.298+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 >> 172.21.15.84:0/3781866294 conn(0x7f63d00c91a0 msgr2=0x7f63d006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:17.311 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.302+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 shutdown_connections 2023-09-10T09:18:17.312 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.302+0000 7f63d5cfd640 1 -- 172.21.15.84:0/3781866294 wait complete. 2023-09-10T09:18:17.335 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-10T09:18:17.477 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- 172.21.15.84:0/2960291350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100b06f0 msgr2=0x7f46100b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- 172.21.15.84:0/2960291350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100b06f0 0x7f46100b0b80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4608009bc0 tx=0x7f460801cac0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.478 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- 172.21.15.84:0/2960291350 shutdown_connections 2023-09-10T09:18:17.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- 172.21.15.84:0/2960291350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100b06f0 0x7f46100b0b80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- 172.21.15.84:0/2960291350 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4610158bd0 0x7f461006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.479 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- 172.21.15.84:0/2960291350 >> 172.21.15.84:0/2960291350 conn(0x7f46100c9500 msgr2=0x7f46100c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:17.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- 172.21.15.84:0/2960291350 shutdown_connections 2023-09-10T09:18:17.480 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- 172.21.15.84:0/2960291350 wait complete. 2023-09-10T09:18:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 Processor -- start 2023-09-10T09:18:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- start start 2023-09-10T09:18:17.483 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 0x7f461014cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46100b06f0 0x7f461014e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c8d30 con 0x7f4610158bd0 2023-09-10T09:18:17.484 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461014d4a0 con 0x7f46100afe90 2023-09-10T09:18:17.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f461560b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46100c8120 con 0x7f46100b06f0 2023-09-10T09:18:17.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f460f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.485 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f460f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34580/0 (socket says 172.21.15.84:34580) 2023-09-10T09:18:17.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.470+0000 7f460f7fe640 1 -- 172.21.15.84:0/40120636 learned_addr learned my addr 172.21.15.84:0/40120636 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:17.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460e7fc640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46100b06f0 0x7f461014e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.486 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460effd640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 0x7f461014cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 -- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46100b06f0 msgr2=0x7f461014e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46100b06f0 0x7f461014e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 -- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 msgr2=0x7f461014cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.487 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 0x7f461014cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 -- 172.21.15.84:0/40120636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4608009820 con 0x7f4610158bd0 2023-09-10T09:18:17.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460effd640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 0x7f461014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:17.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460f7fe640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f4608009b10 tx=0x7f4608009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:17.488 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46080ba070 con 0x7f4610158bd0 2023-09-10T09:18:17.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46100c8400 con 0x7f4610158bd0 2023-09-10T09:18:17.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4608004a50 con 0x7f4610158bd0 2023-09-10T09:18:17.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608004e00 con 0x7f4610158bd0 2023-09-10T09:18:17.489 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46100c89c0 con 0x7f4610158bd0 2023-09-10T09:18:17.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461006bdd0 con 0x7f4610158bd0 2023-09-10T09:18:17.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f46080b4040 con 0x7f4610158bd0 2023-09-10T09:18:17.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 0x7f45fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.490 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f460811d690 con 0x7f4610158bd0 2023-09-10T09:18:17.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460effd640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 0x7f45fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.474+0000 7f460effd640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 0x7f45fc067fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4600009b90 tx=0x7f46000091e0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:17.491 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.478+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f46080eb120 con 0x7f4610158bd0 2023-09-10T09:18:17.641 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.634+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f461006ae10 con 0x7f45fc065b20 2023-09-10T09:18:17.642 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.634+0000 7f45f77fe640 1 -- 172.21.15.84:0/40120636 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4600011be0 con 0x7f45fc065b20 2023-09-10T09:18:17.642 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 6 to deep-scrub 2023-09-10T09:18:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.634+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 msgr2=0x7f45fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.644 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 0x7f45fc067fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f4600009b90 tx=0x7f46000091e0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 msgr2=0x7f461014ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f4608009b10 tx=0x7f4608009300 comp rx=0 tx=0).stop 2023-09-10T09:18:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 shutdown_connections 2023-09-10T09:18:17.645 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f45fc065b20 0x7f45fc067fe0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4610158bd0 0x7f461014ed00 unknown :-1 s=CLOSED pgs=2362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f46100b06f0 0x7f461014e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.646 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 --2- 172.21.15.84:0/40120636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46100afe90 0x7f461014cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 >> 172.21.15.84:0/40120636 conn(0x7f46100c9500 msgr2=0x7f46100c98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:17.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 shutdown_connections 2023-09-10T09:18:17.647 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.638+0000 7f461560b640 1 -- 172.21.15.84:0/40120636 wait complete. 2023-09-10T09:18:17.660 INFO:tasks.ceph:Scrubbing osd.7 2023-09-10T09:18:17.661 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-10T09:18:17.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- 172.21.15.84:0/1938003826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe414005150 msgr2=0x7fe41400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.782 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 --2- 172.21.15.84:0/1938003826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe414005150 0x7fe41400b990 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c290 tx=0x7fe42401d000 comp rx=0 tx=0).stop 2023-09-10T09:18:17.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe431281640 1 -- 172.21.15.84:0/1938003826 reap_dead start 2023-09-10T09:18:17.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- 172.21.15.84:0/1938003826 shutdown_connections 2023-09-10T09:18:17.783 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- 172.21.15.84:0/1938003826 >> 172.21.15.84:0/1938003826 conn(0x7fe42c0b25b0 msgr2=0x7fe42c0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- 172.21.15.84:0/1938003826 shutdown_connections 2023-09-10T09:18:17.784 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- 172.21.15.84:0/1938003826 wait complete. 2023-09-10T09:18:17.787 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 Processor -- start 2023-09-10T09:18:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.774+0000 7fe432ce4640 1 -- start start 2023-09-10T09:18:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe42c0c6a50 0x7fe42c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c0b5ca0 0x7fe42c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.788 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 0x7fe42c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c151d80 con 0x7fe42c1518f0 2023-09-10T09:18:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c15bea0 con 0x7fe42c0b5ca0 2023-09-10T09:18:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0c6e30 con 0x7fe42c0c6a50 2023-09-10T09:18:17.789 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 0x7fe42c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 0x7fe42c1532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34602/0 (socket says 172.21.15.84:34602) 2023-09-10T09:18:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 -- 172.21.15.84:0/103677445 learned_addr learned my addr 172.21.15.84:0/103677445 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe430a80640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe42c0c6a50 0x7fe42c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.790 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe42bfff640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c0b5ca0 0x7fe42c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 -- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe42c0c6a50 msgr2=0x7fe42c0c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe42c0c6a50 0x7fe42c0c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 -- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c0b5ca0 msgr2=0x7fe42c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:17.791 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c0b5ca0 0x7fe42c1513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:17.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0ca520 con 0x7fe42c1518f0 2023-09-10T09:18:17.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe42bfff640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42c0b5ca0 0x7fe42c1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:17.792 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe430a80640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe42c0c6a50 0x7fe42c0c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-10T09:18:17.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe431281640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 0x7fe42c1532c0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c290 tx=0x7fe424006520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:17.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240b4040 con 0x7fe42c1518f0 2023-09-10T09:18:17.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe424001120 con 0x7fe42c1518f0 2023-09-10T09:18:17.793 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240017f0 con 0x7fe42c1518f0 2023-09-10T09:18:17.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0c9f60 con 0x7fe42c1518f0 2023-09-10T09:18:17.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c15bb30 con 0x7fe42c1518f0 2023-09-10T09:18:17.794 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe42c06ad10 con 0x7fe42c1518f0 2023-09-10T09:18:17.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe4240036e0 con 0x7fe42c1518f0 2023-09-10T09:18:17.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe418065b20 0x7fe418067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.795 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe42411d060 con 0x7fe42c1518f0 2023-09-10T09:18:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe430a80640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe418065b20 0x7fe418067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7fe41806be20 0x7fe41806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe41806e930 con 0x7fe41806be20 2023-09-10T09:18:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe42411d4b0 con 0x7fe42c1518f0 2023-09-10T09:18:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe42bfff640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7fe41806be20 0x7fe41806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe430a80640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe418065b20 0x7fe418067fe0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009f50 tx=0x7fe41c009500 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:17.797 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:17.778+0000 7fe42bfff640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7fe41806be20 0x7fe41806e260 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.630+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== osd.7 v2:172.21.15.100:6808/2524383320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe41806e930 con 0x7fe41806be20 2023-09-10T09:18:18.652 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.646+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 --> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe42c069f50 con 0x7fe41806be20 2023-09-10T09:18:18.729 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe4297fa640 1 -- 172.21.15.84:0/103677445 <== osd.7 v2:172.21.15.100:6808/2524383320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe42c069f50 con 0x7fe41806be20 2023-09-10T09:18:18.729 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2023-09-10T09:18:18.730 INFO:teuthology.orchestra.run.smithi084.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-10T09:18:18.730 INFO:teuthology.orchestra.run.smithi084.stdout:} 2023-09-10T09:18:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7fe41806be20 msgr2=0x7fe41806e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.731 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.100:6808/2524383320,v1:172.21.15.100:6809/2524383320] conn(0x7fe41806be20 0x7fe41806e260 crc :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe418065b20 msgr2=0x7fe418067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe418065b20 0x7fe418067fe0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe41c009f50 tx=0x7fe41c009500 comp rx=0 tx=0).stop 2023-09-10T09:18:18.732 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 msgr2=0x7fe42c1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 --2- 172.21.15.84:0/103677445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe42c1518f0 0x7fe42c1532c0 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7fe42400c290 tx=0x7fe424006520 comp rx=0 tx=0).stop 2023-09-10T09:18:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe431281640 1 -- 172.21.15.84:0/103677445 reap_dead start 2023-09-10T09:18:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 shutdown_connections 2023-09-10T09:18:18.733 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 >> 172.21.15.84:0/103677445 conn(0x7fe42c0b25b0 msgr2=0x7fe42c0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 shutdown_connections 2023-09-10T09:18:18.734 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.722+0000 7fe432ce4640 1 -- 172.21.15.84:0/103677445 wait complete. 2023-09-10T09:18:18.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-10T09:18:18.889 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- 172.21.15.84:0/3502846674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa44006bba0 msgr2=0x7fa440158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 --2- 172.21.15.84:0/3502846674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa44006bba0 0x7fa440158620 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fa434009900 tx=0x7fa43401c7c0 comp rx=0 tx=0).stop 2023-09-10T09:18:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- 172.21.15.84:0/3502846674 shutdown_connections 2023-09-10T09:18:18.890 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 --2- 172.21.15.84:0/3502846674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa44006bba0 0x7fa440158620 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- 172.21.15.84:0/3502846674 >> 172.21.15.84:0/3502846674 conn(0x7fa4400c9500 msgr2=0x7fa4400c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- 172.21.15.84:0/3502846674 shutdown_connections 2023-09-10T09:18:18.891 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- 172.21.15.84:0/3502846674 wait complete. 2023-09-10T09:18:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 Processor -- start 2023-09-10T09:18:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.882+0000 7fa446ae4640 1 -- start start 2023-09-10T09:18:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa44006bba0 0x7fa4401f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:18.894 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa440158b60 0x7fa44006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401f5940 con 0x7fa4400af4d0 2023-09-10T09:18:18.895 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa440142760 con 0x7fa44006bba0 2023-09-10T09:18:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44014d870 con 0x7fa440158b60 2023-09-10T09:18:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34622/0 (socket says 172.21.15.84:34622) 2023-09-10T09:18:18.896 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 -- 172.21.15.84:0/373530274 learned_addr learned my addr 172.21.15.84:0/373530274 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa444880640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa44006bba0 0x7fa4401f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa445081640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa440158b60 0x7fa44006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:18.897 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 -- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa440158b60 msgr2=0x7fa44006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa440158b60 0x7fa44006cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 -- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa44006bba0 msgr2=0x7fa4401f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa44006bba0 0x7fa4401f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:18.898 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 -- 172.21.15.84:0/373530274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009560 con 0x7fa4400af4d0 2023-09-10T09:18:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43ffff640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fa4340193d0 tx=0x7fa434004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434005030 con 0x7fa4400af4d0 2023-09-10T09:18:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa434005190 con 0x7fa4400af4d0 2023-09-10T09:18:18.899 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa440159110 con 0x7fa4400af4d0 2023-09-10T09:18:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434005580 con 0x7fa4400af4d0 2023-09-10T09:18:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4401596d0 con 0x7fa4400af4d0 2023-09-10T09:18:18.900 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa440073390 con 0x7fa4400af4d0 2023-09-10T09:18:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fa4340b4070 con 0x7fa4400af4d0 2023-09-10T09:18:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 0x7fa42c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa43411d470 con 0x7fa4400af4d0 2023-09-10T09:18:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa444880640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 0x7fa42c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.886+0000 7fa444880640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 0x7fa42c067fe0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa430000f70 tx=0x7fa430009040 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:18.890+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fa4340eaf70 con 0x7fa4400af4d0 2023-09-10T09:18:19.053 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa440158f90 con 0x7fa42c065b20 2023-09-10T09:18:19.054 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa43d7fa640 1 -- 172.21.15.84:0/373530274 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa430001d00 con 0x7fa42c065b20 2023-09-10T09:18:19.054 INFO:teuthology.orchestra.run.smithi084.stderr:instructed osd(s) 7 to deep-scrub 2023-09-10T09:18:19.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 msgr2=0x7fa42c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 0x7fa42c067fe0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa430000f70 tx=0x7fa430009040 comp rx=0 tx=0).stop 2023-09-10T09:18:19.056 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 msgr2=0x7fa44006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.046+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fa4340193d0 tx=0x7fa434004150 comp rx=0 tx=0).stop 2023-09-10T09:18:19.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 shutdown_connections 2023-09-10T09:18:19.057 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fa42c065b20 0x7fa42c067fe0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa440158b60 0x7fa44006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4400af4d0 0x7fa44006c800 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 --2- 172.21.15.84:0/373530274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa44006bba0 0x7fa4401f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.058 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 >> 172.21.15.84:0/373530274 conn(0x7fa4400c9500 msgr2=0x7fa4400cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:19.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 shutdown_connections 2023-09-10T09:18:19.059 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.050+0000 7fa446ae4640 1 -- 172.21.15.84:0/373530274 wait complete. 2023-09-10T09:18:19.073 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T09:18:19.197 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3855731248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 msgr2=0x7f5fe80aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3855731248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe80aea50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009bf0 tx=0x7f5fe001ca70 comp rx=0 tx=0).stop 2023-09-10T09:18:19.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3855731248 shutdown_connections 2023-09-10T09:18:19.198 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3855731248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe80aea50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3855731248 >> 172.21.15.84:0/3855731248 conn(0x7f5fe80b0320 msgr2=0x7f5fe80b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:19.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3855731248 shutdown_connections 2023-09-10T09:18:19.199 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3855731248 wait complete. 2023-09-10T09:18:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 Processor -- start 2023-09-10T09:18:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- start start 2023-09-10T09:18:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe81f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fe8158aa0 0x7f5fe80c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81553c0 con 0x7f5fe80c8e80 2023-09-10T09:18:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe814f560 con 0x7f5fe8158aa0 2023-09-10T09:18:19.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fed0ea640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe814f840 con 0x7f5fe80c9310 2023-09-10T09:18:19.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fe6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:19.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fe6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34630/0 (socket says 172.21.15.84:34630) 2023-09-10T09:18:19.204 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fe6d9d640 1 -- 172.21.15.84:0/3598498833 learned_addr learned my addr 172.21.15.84:0/3598498833 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:19.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.190+0000 7f5fdffff640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe81f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:19.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe759e640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fe8158aa0 0x7f5fe80c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:19.205 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 -- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 msgr2=0x7f5fe81f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe81f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 -- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fe8158aa0 msgr2=0x7f5fe80c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fe8158aa0 0x7f5fe80c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.206 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 -- 172.21.15.84:0/3598498833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009820 con 0x7f5fe80c8e80 2023-09-10T09:18:19.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fe6d9d640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c430 tx=0x7f5fd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:19.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80052d0 con 0x7f5fe80c8e80 2023-09-10T09:18:19.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5fd8003600 con 0x7f5fe80c8e80 2023-09-10T09:18:19.207 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8003a10 con 0x7f5fe80c8e80 2023-09-10T09:18:19.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe814fb20 con 0x7f5fe80c8e80 2023-09-10T09:18:19.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe81475d0 con 0x7f5fe80c8e80 2023-09-10T09:18:19.208 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8147850 con 0x7f5fe80c8e80 2023-09-10T09:18:19.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f5fd8003b70 con 0x7f5fe80c8e80 2023-09-10T09:18:19.209 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:19.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdffff640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:19.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5fd8082830 con 0x7f5fe80c8e80 2023-09-10T09:18:19.210 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.194+0000 7f5fdffff640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 0x7f5fc8067fe0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80b4340 tx=0x7f5fd0007d30 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:19.211 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.198+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f5fd8050480 con 0x7f5fe80c8e80 2023-09-10T09:18:19.361 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.354+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fe80b4730 con 0x7f5fc8065b20 2023-09-10T09:18:19.364 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fdf7fe640 1 -- 172.21.15.84:0/3598498833 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48552 (secure 0 0 0) 0x7f5fd00014e0 con 0x7f5fc8065b20 2023-09-10T09:18:19.365 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:19.365 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T09:18:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 msgr2=0x7f5fc8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 0x7f5fc8067fe0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80b4340 tx=0x7f5fd0007d30 comp rx=0 tx=0).stop 2023-09-10T09:18:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 msgr2=0x7f5fe81f79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:19.367 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800c430 tx=0x7f5fd800c8f0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 shutdown_connections 2023-09-10T09:18:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f5fc8065b20 0x7f5fc8067fe0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5fe8158aa0 0x7f5fe80c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.368 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5fe80c9310 0x7f5fe81f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 --2- 172.21.15.84:0/3598498833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5fe80c8e80 0x7f5fe81f79d0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 >> 172.21.15.84:0/3598498833 conn(0x7f5fe80b0320 msgr2=0x7f5fe80b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:19.369 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 shutdown_connections 2023-09-10T09:18:19.370 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:19.358+0000 7f5fed0ea640 1 -- 172.21.15.84:0/3598498833 wait complete. 2023-09-10T09:18:19.384 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16407,"stamp":"2023-09-10T09:18:17.408970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":13403720,"kb_used_data":5256,"kb_used_omap":51188,"kb_used_meta":13347211,"kb_avail":741571000,"statfs":{"total":773094113280,"available":759368704000,"internally_reserved":0,"allocated":5382144,"data_stored":3013808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52416979,"internal_metadata":13667544621},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2341,"apply_latency_ms":2341,"commit_latency_ns":2341000000,"apply_latency_ns":2341000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002974"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-09-10T09:17:56.536944+0000","last_change":"2023-09-10T00:12:29.422369+0000","last_active":"2023-09-10T09:17:56.536944+0000","last_peered":"2023-09-10T09:17:56.536944+0000","last_clean":"2023-09-10T09:17:56.536944+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T09:17:56.536944+0000","last_undegraded":"2023-09-10T09:17:56.536944+0000","last_fullsized":"2023-09-10T09:17:56.536944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-10T00:12:28.391973+0000","last_clean_scrub_stamp":"2023-09-10T00:12:28.391973+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T10:03:12.195677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424515992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1680012,"kb_used_data":1092,"kb_used_omap":3889,"kb_used_meta":1675022,"kb_avail":92691828,"statfs":{"total":96636764160,"available":94916431872,"internally_reserved":0,"allocated":1118208,"data_stored":819502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3982558,"internal_metadata":1715223330},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3050000000000002,"5min":2.0870000000000002,"15min":1.51},"min":{"1min":0.26500000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":22.122,"5min":101.46599999999999,"15min":101.46599999999999},"last":1.008},{"interface":"front","average":{"1min":3.395,"5min":2.5859999999999999,"15min":1.786},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":22.385000000000002,"5min":100.76900000000001,"15min":100.76900000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":2.3029999999999999,"15min":2.3809999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":22.199999999999999,"5min":100.916,"15min":122.065},"last":0.90700000000000003},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.738,"15min":2.536},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":22.695,"5min":101.889,"15min":122.29300000000001},"last":1.151}]},{"osd":2,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.7730000000000001,"15min":1.9339999999999999},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":22.795000000000002,"5min":101.251,"15min":101.251},"last":1.04},{"interface":"front","average":{"1min":2.5139999999999998,"5min":2.3999999999999999,"15min":2.0619999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":31.631,"5min":102.158,"15min":102.158},"last":1.0860000000000001}]},{"osd":3,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.9279999999999999,"5min":2.3570000000000002,"15min":1.653},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.621000000000002,"5min":35.219999999999999,"15min":35.219999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":2.6789999999999998,"5min":1.746,"15min":1.5780000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":24.298999999999999,"5min":34.845999999999997,"15min":34.845999999999997},"last":1.179}]},{"osd":4,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":1.323,"15min":0.95599999999999996},"min":{"1min":0.29699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":24.276,"5min":24.276,"15min":24.276},"last":0.875},{"interface":"front","average":{"1min":2.3039999999999998,"5min":1.532,"15min":1.071},"min":{"1min":0.29899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":24.323,"5min":28.582999999999998,"15min":28.582999999999998},"last":1.125}]},{"osd":5,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.367,"15min":1.038},"min":{"1min":0.34100000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":25.811,"5min":25.811,"15min":25.811},"last":0.69899999999999995},{"interface":"front","average":{"1min":3.089,"5min":1.7130000000000001,"15min":1.2170000000000001},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.02,"5min":1.5609999999999999,"15min":1.1899999999999999},"min":{"1min":0.503,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":22.658000000000001,"5min":22.658000000000001,"15min":22.658000000000001},"last":1.212},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.8100000000000001,"15min":1.3089999999999999},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":22.831,"5min":60.18,"15min":60.18},"last":0.95199999999999996}]}]},{"osd":6,"up_from":15,"seq":64424515992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1521160,"kb_used_data":512,"kb_used_omap":4585,"kb_used_meta":1516054,"kb_avail":92850680,"statfs":{"total":96636764160,"available":95079096320,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4695110,"internal_metadata":1552440250},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.83799999999999997,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23400000000000001},"max":{"1min":3.4380000000000002,"5min":4.9299999999999997,"15min":32.689999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.482,"15min":1.587},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.219},"max":{"1min":12.692,"5min":12.692,"15min":40.506999999999998},"last":1.0880000000000001}]},{"osd":1,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":1.0740000000000001,"15min":1.0940000000000001},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.25900000000000001},"max":{"1min":4.2489999999999997,"5min":9.2859999999999996,"15min":18.416},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":1.014,"15min":1.0840000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":3.4780000000000002,"5min":14.537000000000001,"15min":14.537000000000001},"last":1.0529999999999999}]},{"osd":2,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.3140000000000001,"15min":1.3759999999999999},"min":{"1min":0.31,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":9.1280000000000001,"5min":9.1280000000000001,"15min":31.853000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.548,"5min":1.3859999999999999,"15min":1.5760000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":8.1690000000000005,"5min":14.693,"15min":31.811},"last":0.93200000000000005}]},{"osd":3,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":1.2829999999999999,"15min":1.345},"min":{"1min":0.34000000000000002,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":3.5299999999999998,"5min":5.7169999999999996,"15min":33.710000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":2.2309999999999999,"5min":2.1509999999999998,"15min":1.895},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":12.276,"5min":12.276,"15min":25.001000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.83899999999999997,"15min":0.81699999999999995},"min":{"1min":0.314,"5min":0.30499999999999999,"15min":0.27600000000000002},"max":{"1min":3.504,"5min":6.7549999999999999,"15min":6.7549999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":2.2869999999999999,"5min":1.492,"15min":1.228},"min":{"1min":0.376,"5min":0.29599999999999999,"15min":0.26300000000000001},"max":{"1min":16.704999999999998,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.99299999999999999}]},{"osd":5,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.23,"15min":1.194},"min":{"1min":0.377,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":5.71,"5min":10.051,"15min":18.574999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.008,"15min":1.008},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":3.5550000000000002,"5min":4.984,"15min":11.757999999999999},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Sep 10 09:17:19 2023","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":1.6539999999999999,"15min":1.4399999999999999},"min":{"1min":0.50900000000000001,"5min":0.372,"15min":0.372},"max":{"1min":13.103,"5min":13.103,"15min":15.888},"last":1.167},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.115,"15min":1.115},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":13.057,"5min":13.057,"15min":18.524999999999999},"last":1.0269999999999999}]}]},{"osd":5,"up_from":15,"seq":64424515992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1479048,"kb_used_data":512,"kb_used_omap":10125,"kb_used_meta":1468402,"kb_avail":92892792,"statfs":{"total":96636764160,"available":95122219008,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10368951,"internal_metadata":1503643721},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":1.3919999999999999,"15min":1.0940000000000001},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":10.276999999999999,"5min":19.716000000000001,"15min":25.914999999999999},"last":0.75},{"interface":"front","average":{"1min":3.5760000000000001,"5min":1.8300000000000001,"15min":1.345},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":56.628999999999998,"5min":56.628999999999998,"15min":56.628999999999998},"last":0.59499999999999997}]},{"osd":1,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.276,"15min":1.3200000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.4630000000000001,"5min":9.4109999999999996,"15min":38.207999999999998},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3169999999999999,"15min":1.419},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.28399999999999997},"max":{"1min":4.4459999999999997,"5min":6.766,"15min":38.604999999999997},"last":0.64900000000000002}]},{"osd":2,"last update":"Sun Sep 10 09:17:09 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5069999999999999,"15min":2.0390000000000001},"min":{"1min":0.313,"5min":0.29399999999999998,"15min":0.27700000000000002},"max":{"1min":10.103,"5min":10.103,"15min":195.44999999999999},"last":0.872},{"interface":"front","average":{"1min":1.145,"5min":1.2170000000000001,"15min":1.988},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":7.9349999999999996,"5min":7.9349999999999996,"15min":196.434},"last":0.84099999999999997}]},{"osd":3,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.9910000000000001,"5min":2.0419999999999998,"15min":1.6200000000000001},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.29199999999999998},"max":{"1min":56.656999999999996,"5min":56.656999999999996,"15min":56.656999999999996},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.486,"5min":1.754,"15min":1.4910000000000001},"min":{"1min":0.377,"5min":0.312,"15min":0.30399999999999999},"max":{"1min":7.4980000000000002,"5min":20.448,"15min":26.555},"last":0.96299999999999997}]},{"osd":4,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.091,"15min":0.90100000000000002},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":10.99,"5min":10.99,"15min":10.99},"last":0.94599999999999995},{"interface":"front","average":{"1min":4.1580000000000004,"5min":1.6879999999999999,"15min":1.212},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.24099999999999999},"max":{"1min":56.554000000000002,"5min":56.554000000000002,"15min":56.554000000000002},"last":1.151}]},{"osd":6,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":1.415,"15min":1.2529999999999999},"min":{"1min":0.375,"5min":0.316,"15min":0.252},"max":{"1min":23.843,"5min":23.843,"15min":26.523},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.698,"5min":1.4510000000000001,"15min":1.1299999999999999},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.26100000000000001},"max":{"1min":33.350000000000001,"5min":33.350000000000001,"15min":33.350000000000001},"last":0.98799999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":4.5830000000000002,"5min":1.9079999999999999,"15min":1.4299999999999999},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.33800000000000002},"max":{"1min":56.682000000000002,"5min":56.682000000000002,"15min":56.682000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.236,"15min":1.1779999999999999},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.28799999999999998},"max":{"1min":17.475000000000001,"5min":17.475000000000001,"15min":26.585999999999999},"last":1.042}]}]},{"osd":4,"up_from":15,"seq":64424515990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1797384,"kb_used_data":512,"kb_used_omap":10519,"kb_used_meta":1786344,"kb_avail":92574456,"statfs":{"total":96636764160,"available":94796242944,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10772002,"internal_metadata":1829216734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":428,"apply_latency_ms":428,"commit_latency_ns":428000000,"apply_latency_ns":428000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":2.4060000000000001,"15min":1.536},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":8.0020000000000007,"5min":170.905,"15min":170.905},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.423,"15min":1.8009999999999999},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.8339999999999996,"5min":171.51599999999999,"15min":171.51599999999999},"last":1.0369999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":2.661,"15min":2.5800000000000001},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.251},"max":{"1min":8.1880000000000006,"5min":171.24600000000001,"15min":171.24600000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4430000000000001,"15min":1.8440000000000001},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":8.3290000000000006,"5min":169.994,"15min":169.994},"last":0.84599999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":2.6680000000000001,"15min":1.8620000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.0370000000000008,"5min":170.63300000000001,"15min":170.63300000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.161,"5min":2.621,"15min":1.698},"min":{"1min":0.33900000000000002,"5min":0.318,"15min":0.29199999999999998},"max":{"1min":8.3599999999999994,"5min":170.95699999999999,"15min":170.95699999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2150000000000001,"15min":1.5980000000000001},"min":{"1min":0.39400000000000002,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":50.055999999999997},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.74,"5min":1.3859999999999999,"15min":1.5529999999999999},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":8.1539999999999999,"5min":8.1539999999999999,"15min":39.930999999999997},"last":1.262}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":0.98599999999999999,"15min":1.042},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":8.2729999999999997,"5min":14.725,"15min":38.646999999999998},"last":1.177},{"interface":"front","average":{"1min":1.893,"5min":1.0329999999999999,"15min":1.1830000000000001},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.26900000000000002},"max":{"1min":15.965,"5min":15.965,"15min":29.584},"last":1.2290000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2770000000000001,"5min":1.238,"15min":1.109},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":14.502000000000001,"5min":14.502000000000001,"15min":14.502000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.9199999999999999,"5min":0.98799999999999999,"15min":0.89800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":1.0920000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1949999999999998,"5min":1.4359999999999999,"15min":1.6060000000000001},"min":{"1min":0.379,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":16.007000000000001,"5min":16.007000000000001,"15min":76.921000000000006},"last":1.1220000000000001},{"interface":"front","average":{"1min":3.472,"5min":1.488,"15min":1.4490000000000001},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":24.486000000000001,"5min":24.486000000000001,"15min":40.084000000000003},"last":1.3169999999999999}]}]},{"osd":3,"up_from":14,"seq":60129548686,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1759240,"kb_used_data":512,"kb_used_omap":3803,"kb_used_meta":1754916,"kb_avail":92612600,"statfs":{"total":96636764160,"available":94835302400,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894703,"internal_metadata":1797034577},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":617,"apply_latency_ms":617,"commit_latency_ns":617000000,"apply_latency_ns":617000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.98299999999999998,"15min":1.218},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":5.4569999999999999,"5min":11.276,"15min":33.093000000000004},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.2450000000000001},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":34.662999999999997},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.02,"15min":1.425},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":68.977000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.0649999999999999,"15min":1.3180000000000001},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.219},"max":{"1min":9.5099999999999998,"5min":9.5099999999999998,"15min":68.938999999999993},"last":0.98099999999999998}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.3120000000000001,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.251},"max":{"1min":17.533000000000001,"5min":17.533000000000001,"15min":47.039000000000001},"last":1.095},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.1559999999999999,"15min":1.821},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":10.214,"5min":10.214,"15min":36.241999999999997},"last":1.03}]},{"osd":4,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.014,"15min":1.357},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.5819999999999999,"5min":6.8899999999999997,"15min":33.210999999999999},"last":1.2250000000000001},{"interface":"front","average":{"1min":3.036,"5min":1.5589999999999999,"15min":1.4099999999999999},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":39.707000000000001,"5min":39.707000000000001,"15min":39.707000000000001},"last":1.5389999999999999}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8420000000000001,"5min":1.6719999999999999,"15min":1.387},"min":{"1min":0.371,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":55.744,"5min":55.744,"15min":55.744},"last":1.4650000000000001},{"interface":"front","average":{"1min":3.992,"5min":1.7529999999999999,"15min":1.3759999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":55.767000000000003,"5min":55.767000000000003,"15min":55.767000000000003},"last":1.2569999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.355,"15min":1.2450000000000001},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":26.262},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.135,"5min":0.86599999999999999,"15min":1.4259999999999999},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.9020000000000001,"5min":4.4630000000000001,"15min":33.179000000000002},"last":1.3999999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.1379999999999999,"15min":1.653},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":16.73,"5min":16.73,"15min":33.148000000000003},"last":1.4990000000000001},{"interface":"front","average":{"1min":2.5350000000000001,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.992000000000001,"5min":16.992000000000001,"15min":35.390999999999998},"last":1.597}]}]},{"osd":2,"up_from":14,"seq":60129548689,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1507464,"kb_used_data":512,"kb_used_omap":4998,"kb_used_meta":1501945,"kb_avail":92864376,"statfs":{"total":96636764160,"available":95093121024,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5118553,"internal_metadata":1537992103},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":849,"apply_latency_ms":849,"commit_latency_ns":849000000,"apply_latency_ns":849000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.101,"15min":1.8089999999999999},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.19600000000000001},"max":{"1min":8.3399999999999999,"5min":8.3399999999999999,"15min":65.355000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.3009999999999999,"15min":2.3220000000000001},"min":{"1min":0.223,"5min":0.223,"15min":0.20599999999999999},"max":{"1min":4.6609999999999996,"5min":7.9240000000000004,"15min":224.83600000000001},"last":0.88400000000000001}]},{"osd":1,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":1.6779999999999999,"15min":2.585},"min":{"1min":0.24299999999999999,"5min":0.216,"15min":0.216},"max":{"1min":43.220999999999997,"5min":43.220999999999997,"15min":224.595},"last":0.63300000000000001},{"interface":"front","average":{"1min":3.7349999999999999,"5min":1.679,"15min":1.591},"min":{"1min":0.26900000000000002,"5min":0.23200000000000001,"15min":0.20699999999999999},"max":{"1min":43.308999999999997,"5min":43.308999999999997,"15min":56.338999999999999},"last":1.0469999999999999}]},{"osd":3,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.627,"15min":2.6339999999999999},"min":{"1min":0.221,"5min":0.221,"15min":0.219},"max":{"1min":19.939,"5min":19.939,"15min":105.649},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.284,"15min":2.8820000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.217},"max":{"1min":3.0289999999999999,"5min":11.375999999999999,"15min":224.50999999999999},"last":0.92400000000000004}]},{"osd":4,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.1699999999999999,"15min":1.2869999999999999},"min":{"1min":0.38800000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":4.3419999999999996,"5min":6.0149999999999997,"15min":21.675000000000001},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.2849999999999999,"15min":1.3979999999999999},"min":{"1min":0.45700000000000002,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":4.6539999999999999,"5min":6.149,"15min":21.744},"last":0.97399999999999998}]},{"osd":5,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.4790000000000001,"15min":1.706},"min":{"1min":0.433,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":11.994,"5min":11.994,"15min":59.976999999999997},"last":1.008},{"interface":"front","average":{"1min":1.8939999999999999,"5min":1.2989999999999999,"15min":1.3620000000000001},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":11.85,"5min":11.85,"15min":21.765000000000001},"last":1.2390000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.3300000000000001,"15min":1.637},"min":{"1min":0.48799999999999999,"5min":0.379,"15min":0.35499999999999998},"max":{"1min":4.7460000000000004,"5min":6.1050000000000004,"15min":59.996000000000002},"last":1.089},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.2430000000000001,"15min":1.7470000000000001},"min":{"1min":0.41399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.2999999999999998,"5min":11.416,"15min":99.072000000000003},"last":1.1140000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:17:31 2023","interfaces":[{"interface":"back","average":{"1min":3.1619999999999999,"5min":1.6879999999999999,"15min":1.641},"min":{"1min":0.437,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":25.815000000000001,"5min":25.815000000000001,"15min":25.815000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":4.0999999999999996,"5min":1.9339999999999999,"15min":1.8919999999999999},"min":{"1min":0.53300000000000003,"5min":0.379,"15min":0.379},"max":{"1min":26.306000000000001,"5min":26.306000000000001,"15min":59.938000000000002},"last":1.141}]}]},{"osd":1,"up_from":14,"seq":60129548692,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883528,"kb_used_data":512,"kb_used_omap":6193,"kb_used_meta":1876814,"kb_avail":92488312,"statfs":{"total":96636764160,"available":94708031488,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6342184,"internal_metadata":1921858008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":1.597,"15min":1.5740000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":38.545999999999999,"5min":38.545999999999999,"15min":60.738999999999997},"last":0.90100000000000002},{"interface":"front","average":{"1min":2.9350000000000001,"5min":1.4970000000000001,"15min":1.1259999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":21.262,"5min":21.262,"15min":21.262},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.149,"15min":2.4380000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":20.335000000000001,"5min":20.335000000000001,"15min":228.64500000000001},"last":0.755},{"interface":"front","average":{"1min":1.627,"5min":1.2669999999999999,"15min":2.3580000000000001},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":225.03800000000001},"last":0.85699999999999998}]},{"osd":3,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5110000000000001,"5min":1.4530000000000001,"15min":1.5369999999999999},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.23999999999999999},"max":{"1min":34.484999999999999,"5min":34.484999999999999,"15min":53.753},"last":1.0469999999999999},{"interface":"front","average":{"1min":3.3929999999999998,"5min":1.6160000000000001,"15min":1.8009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":32.694000000000003,"5min":32.694000000000003,"15min":46.237000000000002},"last":1.0920000000000001}]},{"osd":4,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.2050000000000001,"15min":1.2929999999999999},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"max":{"1min":20.431999999999999,"5min":20.431999999999999,"15min":44.07},"last":1.212},{"interface":"front","average":{"1min":1.998,"5min":1.2989999999999999,"15min":1.1220000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":10.868,"5min":10.868,"15min":10.868},"last":1.175}]},{"osd":5,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":1.3600000000000001,"15min":1.1830000000000001},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.28000000000000003},"max":{"1min":14.874000000000001,"5min":14.874000000000001,"15min":14.874000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.133,"5min":0.92700000000000005,"15min":1.1060000000000001},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.32700000000000001},"max":{"1min":5.2800000000000002,"5min":6.2149999999999999,"15min":18.288},"last":1.288}]},{"osd":6,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.92400000000000004,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":6.5339999999999998,"5min":6.5339999999999998,"15min":6.5339999999999998},"last":1.3799999999999999},{"interface":"front","average":{"1min":2.9609999999999999,"5min":1.5149999999999999,"15min":1.502},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":22.178000000000001,"5min":22.178000000000001,"15min":44.040999999999997},"last":1.345}]},{"osd":7,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.675,"15min":1.3740000000000001},"min":{"1min":0.53600000000000003,"5min":0.45700000000000002,"15min":0.377},"max":{"1min":12.454000000000001,"5min":12.454000000000001,"15min":15.6},"last":1.2529999999999999},{"interface":"front","average":{"1min":2.7250000000000001,"5min":1.415,"15min":1.2749999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.40999999999999998},"max":{"1min":18.433,"5min":18.433,"15min":19.521000000000001},"last":1.1439999999999999}]}]},{"osd":0,"up_from":14,"seq":60129548691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775884,"kb_used_data":1092,"kb_used_omap":7073,"kb_used_meta":1767710,"kb_avail":92595956,"statfs":{"total":96636764160,"available":94818258944,"internally_reserved":0,"allocated":1118208,"data_stored":819502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7242918,"internal_metadata":1810135898},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":447,"apply_latency_ms":447,"commit_latency_ns":447000000,"apply_latency_ns":447000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6829999999999998,"5min":1.25,"15min":1.476},"min":{"1min":0.21199999999999999,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":28.989000000000001,"5min":28.989000000000001,"15min":62.073},"last":0.59899999999999998},{"interface":"front","average":{"1min":2.7469999999999999,"5min":1.599,"15min":1.8939999999999999},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.19},"max":{"1min":28.602,"5min":28.602,"15min":54.779000000000003},"last":1.1060000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":4.8369999999999997,"5min":2.0030000000000001,"15min":1.4930000000000001},"min":{"1min":0.27500000000000002,"5min":0.22,"15min":0.219},"max":{"1min":37.030000000000001,"5min":37.030000000000001,"15min":40.866},"last":0.77100000000000002},{"interface":"front","average":{"1min":2.266,"5min":1.3029999999999999,"15min":1.385},"min":{"1min":0.377,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":12.275,"5min":12.275,"15min":73.090999999999994},"last":1.228}]},{"osd":3,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":1.4710000000000001,"15min":1.9750000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":16.908999999999999,"5min":16.908999999999999,"15min":73.126999999999995},"last":1},{"interface":"front","average":{"1min":2.0419999999999998,"5min":1.3120000000000001,"15min":1.149},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":17.102,"5min":17.102,"15min":17.102},"last":1.0649999999999999}]},{"osd":4,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.234,"15min":1.492},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29799999999999999},"max":{"1min":11.300000000000001,"5min":11.300000000000001,"15min":73.176000000000002},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.125,"15min":1.173},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":4.2800000000000002,"5min":7.4939999999999998,"15min":20.803000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.506,"15min":1.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":11.323,"5min":11.323,"15min":40.402999999999999},"last":1.202},{"interface":"front","average":{"1min":1.708,"5min":1.3420000000000001,"15min":1.5800000000000001},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":11.657,"5min":11.657,"15min":73.195999999999998},"last":1.3280000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":1.4119999999999999,"15min":1.2569999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":24.265999999999998,"5min":24.265999999999998,"15min":24.265999999999998},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.4139999999999999,"15min":1.7649999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":11.747,"5min":11.747,"15min":73.153999999999996},"last":1.397}]},{"osd":7,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":1.5509999999999999,"15min":1.375},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.371},"max":{"1min":12.739000000000001,"5min":12.739000000000001,"15min":12.739000000000001},"last":1.286},{"interface":"front","average":{"1min":1.9119999999999999,"5min":1.7569999999999999,"15min":1.6419999999999999},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":11.278,"5min":11.278,"15min":40.444000000000003},"last":1.26}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T09:18:19.387 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-10T00:12:28.391973+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=10, tm_hour=0, tm_min=12, tm_sec=28, tm_wday=6, tm_yday=253, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=10, tm_hour=9, tm_min=18, tm_sec=7, tm_wday=6, tm_yday=253, tm_isdst=0) 2023-09-10T09:18:19.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-10T09:18:39.389 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-10T09:18:39.516 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3432131373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e14005040 msgr2=0x7f7e140058e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3432131373 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e14005040 0x7f7e140058e0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f7e18006fb0 tx=0x7f7e1801f700 comp rx=0 tx=0).stop 2023-09-10T09:18:39.517 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2df42640 1 -- 172.21.15.84:0/3432131373 reap_dead start 2023-09-10T09:18:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3432131373 shutdown_connections 2023-09-10T09:18:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3432131373 >> 172.21.15.84:0/3432131373 conn(0x7f7e280cd0e0 msgr2=0x7f7e280cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3432131373 shutdown_connections 2023-09-10T09:18:39.518 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3432131373 wait complete. 2023-09-10T09:18:39.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 Processor -- start 2023-09-10T09:18:39.521 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- start start 2023-09-10T09:18:39.522 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e14005040 0x7f7e28154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e2806ce00 0x7f7e2809c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.523 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28153b90 con 0x7f7e281516b0 2023-09-10T09:18:39.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2806e240 con 0x7f7e14005040 2023-09-10T09:18:39.524 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2806e520 con 0x7f7e2806ce00 2023-09-10T09:18:39.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.525 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39272/0 (socket says 172.21.15.84:39272) 2023-09-10T09:18:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 -- 172.21.15.84:0/3435304300 learned_addr learned my addr 172.21.15.84:0/3435304300 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2d741640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e14005040 0x7f7e28154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.526 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2df42640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e2806ce00 0x7f7e2809c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 -- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e2806ce00 msgr2=0x7f7e2809c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e2806ce00 0x7f7e2809c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 -- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e14005040 msgr2=0x7f7e28154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.527 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e14005040 0x7f7e28154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 -- 172.21.15.84:0/3435304300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28153e30 con 0x7f7e281516b0 2023-09-10T09:18:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2cf40640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f7e1801f530 tx=0x7f7e180065e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18001800 con 0x7f7e281516b0 2023-09-10T09:18:39.528 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e180036f0 con 0x7f7e281516b0 2023-09-10T09:18:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e28154110 con 0x7f7e281516b0 2023-09-10T09:18:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18003ae0 con 0x7f7e281516b0 2023-09-10T09:18:39.529 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.509+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e28151b30 con 0x7f7e281516b0 2023-09-10T09:18:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e28072b50 con 0x7f7e281516b0 2023-09-10T09:18:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f7e18003c40 con 0x7f7e281516b0 2023-09-10T09:18:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e1dffb640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 0x7f7e0c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.530 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7e180ab070 con 0x7f7e281516b0 2023-09-10T09:18:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e2d741640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 0x7f7e0c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.531 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.513+0000 7f7e2d741640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 0x7f7e0c068010 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c10 tx=0x7f7e24006d40 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:39.532 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.517+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f7e180ef520 con 0x7f7e281516b0 2023-09-10T09:18:39.678 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.669+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 --> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e280695b0 con 0x7f7e0c065b50 2023-09-10T09:18:39.683 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e1dffb640 1 -- 172.21.15.84:0/3435304300 <== mgr.4212 v2:172.21.15.84:6832/670516398 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48524 (secure 0 0 0) 0x7f7e24015070 con 0x7f7e0c065b50 2023-09-10T09:18:39.685 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:39.685 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2023-09-10T09:18:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 msgr2=0x7f7e0c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.686 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 0x7f7e0c068010 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c10 tx=0x7f7e24006d40 comp rx=0 tx=0).stop 2023-09-10T09:18:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 msgr2=0x7f7e2806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f7e1801f530 tx=0x7f7e180065e0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.687 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 shutdown_connections 2023-09-10T09:18:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f7e0c065b50 0x7f7e0c068010 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e2806ce00 0x7f7e2809c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7e281516b0 0x7f7e2806c8c0 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.688 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 --2- 172.21.15.84:0/3435304300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e14005040 0x7f7e28154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 >> 172.21.15.84:0/3435304300 conn(0x7f7e280cd0e0 msgr2=0x7f7e28159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 shutdown_connections 2023-09-10T09:18:39.689 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.677+0000 7f7e2f9a5640 1 -- 172.21.15.84:0/3435304300 wait complete. 2023-09-10T09:18:39.702 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":16418,"stamp":"2023-09-10T09:18:39.414682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":13403720,"kb_used_data":5256,"kb_used_omap":51188,"kb_used_meta":13347211,"kb_avail":741571000,"statfs":{"total":773094113280,"available":759368704000,"internally_reserved":0,"allocated":5382144,"data_stored":3013808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":52416979,"internal_metadata":13667544621},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003323"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":467,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-09-10T09:18:22.685886+0000","last_change":"2023-09-10T09:18:22.685976+0000","last_active":"2023-09-10T09:18:22.685886+0000","last_peered":"2023-09-10T09:18:22.685886+0000","last_clean":"2023-09-10T09:18:22.685886+0000","last_became_active":"2023-09-10T00:12:29.420391+0000","last_became_peered":"2023-09-10T00:12:29.420391+0000","last_unstale":"2023-09-10T09:18:22.685886+0000","last_undegraded":"2023-09-10T09:18:22.685886+0000","last_fullsized":"2023-09-10T09:18:22.685886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2023-09-10T09:18:22.685781+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2023-09-10T09:18:22.685781+0000","last_clean_scrub_stamp":"2023-09-10T09:18:22.685781+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":3,"scrub_schedule":"periodic scrub scheduled @ 2023-09-11T14:16:09.392822+0000","scrub_duration":2.4197031899999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424515997,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1680012,"kb_used_data":1092,"kb_used_omap":3889,"kb_used_meta":1675022,"kb_avail":92691828,"statfs":{"total":96636764160,"available":94916431872,"internally_reserved":0,"allocated":1118208,"data_stored":819502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3982558,"internal_metadata":1715223330},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3050000000000002,"5min":2.0870000000000002,"15min":1.51},"min":{"1min":0.26500000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":22.122,"5min":101.46599999999999,"15min":101.46599999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":3.395,"5min":2.5859999999999999,"15min":1.786},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.255},"max":{"1min":22.385000000000002,"5min":100.76900000000001,"15min":100.76900000000001},"last":1.0649999999999999}]},{"osd":1,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":2.3029999999999999,"15min":2.3809999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":22.199999999999999,"5min":100.916,"15min":122.065},"last":0.81499999999999995},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.738,"15min":2.536},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":22.695,"5min":101.889,"15min":122.29300000000001},"last":0.95199999999999996}]},{"osd":2,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.7730000000000001,"15min":1.9339999999999999},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.29899999999999999},"max":{"1min":22.795000000000002,"5min":101.251,"15min":101.251},"last":1.0369999999999999},{"interface":"front","average":{"1min":2.5139999999999998,"5min":2.3999999999999999,"15min":2.0619999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.28599999999999998},"max":{"1min":31.631,"5min":102.158,"15min":102.158},"last":1.0920000000000001}]},{"osd":3,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.9279999999999999,"5min":2.3570000000000002,"15min":1.653},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.32800000000000001},"max":{"1min":34.621000000000002,"5min":35.219999999999999,"15min":35.219999999999999},"last":0.871},{"interface":"front","average":{"1min":2.6789999999999998,"5min":1.746,"15min":1.5780000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":24.298999999999999,"5min":34.845999999999997,"15min":34.845999999999997},"last":0.58499999999999996}]},{"osd":4,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":1.323,"15min":0.95599999999999996},"min":{"1min":0.29699999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":24.276,"5min":24.276,"15min":24.276},"last":1.1499999999999999},{"interface":"front","average":{"1min":2.3039999999999998,"5min":1.532,"15min":1.071},"min":{"1min":0.29899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":24.323,"5min":28.582999999999998,"15min":28.582999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.6440000000000001,"5min":1.367,"15min":1.038},"min":{"1min":0.34100000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":25.811,"5min":25.811,"15min":25.811},"last":1.179},{"interface":"front","average":{"1min":3.089,"5min":1.7130000000000001,"15min":1.2170000000000001},"min":{"1min":0.47499999999999998,"5min":0.36099999999999999,"15min":0.29299999999999998},"max":{"1min":25.783000000000001,"5min":25.783000000000001,"15min":25.783000000000001},"last":0.753}]},{"osd":6,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.02,"5min":1.5609999999999999,"15min":1.1899999999999999},"min":{"1min":0.503,"5min":0.34399999999999997,"15min":0.31},"max":{"1min":22.658000000000001,"5min":22.658000000000001,"15min":22.658000000000001},"last":1.208},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.8100000000000001,"15min":1.3089999999999999},"min":{"1min":0.436,"5min":0.39000000000000001,"15min":0.34399999999999997},"max":{"1min":22.831,"5min":60.18,"15min":60.18},"last":1.1240000000000001}]}]},{"osd":6,"up_from":15,"seq":64424515996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1521160,"kb_used_data":512,"kb_used_omap":4585,"kb_used_meta":1516054,"kb_avail":92850680,"statfs":{"total":96636764160,"available":95079096320,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4695110,"internal_metadata":1552440250},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:37 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.83799999999999997,"15min":1.069},"min":{"1min":0.27900000000000003,"5min":0.25900000000000001,"15min":0.23400000000000001},"max":{"1min":3.4380000000000002,"5min":4.9299999999999997,"15min":32.689999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.482,"15min":1.587},"min":{"1min":0.34399999999999997,"5min":0.27900000000000003,"15min":0.219},"max":{"1min":12.692,"5min":12.692,"15min":40.506999999999998},"last":0.95299999999999996}]},{"osd":1,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.1699999999999999,"15min":1.0900000000000001},"min":{"1min":0.32700000000000001,"5min":0.28199999999999997,"15min":0.25900000000000001},"max":{"1min":11.483000000000001,"5min":11.483000000000001,"15min":18.416},"last":0.77700000000000002},{"interface":"front","average":{"1min":2.2130000000000001,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.34899999999999998,"5min":0.28199999999999997,"15min":0.25600000000000001},"max":{"1min":10.068,"5min":10.068,"15min":14.537000000000001},"last":0.84199999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.4570000000000001,"15min":1.4099999999999999},"min":{"1min":0.376,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":19.606000000000002,"5min":19.606000000000002,"15min":31.853000000000002},"last":1.006},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.3959999999999999,"15min":1.579},"min":{"1min":0.35999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":19.684000000000001,"5min":19.684000000000001,"15min":31.811},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.2749999999999999,"15min":1.3580000000000001},"min":{"1min":0.45400000000000001,"5min":0.314,"15min":0.29999999999999999},"max":{"1min":10.128,"5min":10.128,"15min":33.710000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":3.3029999999999999,"5min":2.4119999999999999,"15min":1.994},"min":{"1min":0.46000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":33.052999999999997,"5min":33.052999999999997,"15min":33.052999999999997},"last":0.80900000000000005}]},{"osd":4,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.8320000000000001,"5min":0.97899999999999998,"15min":0.88600000000000001},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.27600000000000002},"max":{"1min":9.9939999999999998,"5min":9.9939999999999998,"15min":9.9939999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":2.5569999999999999,"5min":1.7769999999999999,"15min":1.339},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.26300000000000001},"max":{"1min":15.869,"5min":16.704999999999998,"15min":16.704999999999998},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.2649999999999999,"15min":1.1970000000000001},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.30199999999999999},"max":{"1min":7.8810000000000002,"5min":7.8810000000000002,"15min":18.574999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":3.5030000000000001,"5min":1.4430000000000001,"15min":1.1819999999999999},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":31.518000000000001,"5min":31.518000000000001,"15min":31.518000000000001},"last":1.1240000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.6399999999999999,"15min":1.4670000000000001},"min":{"1min":0.5,"5min":0.372,"15min":0.372},"max":{"1min":5.327,"5min":13.103,"15min":15.888},"last":1.048},{"interface":"front","average":{"1min":0.72799999999999998,"5min":1.135,"15min":1.107},"min":{"1min":0.41499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.5669999999999999,"5min":13.057,"15min":18.524999999999999},"last":1.0249999999999999}]}]},{"osd":5,"up_from":15,"seq":64424515997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1479048,"kb_used_data":512,"kb_used_omap":10125,"kb_used_meta":1468402,"kb_avail":92892792,"statfs":{"total":96636764160,"available":95122219008,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10368951,"internal_metadata":1503643721},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.1949999999999998,"5min":1.3919999999999999,"15min":1.0940000000000001},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":10.276999999999999,"5min":19.716000000000001,"15min":25.914999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":3.5760000000000001,"5min":1.8300000000000001,"15min":1.345},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":56.628999999999998,"5min":56.628999999999998,"15min":56.628999999999998},"last":1.048}]},{"osd":1,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.276,"15min":1.3200000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.4630000000000001,"5min":9.4109999999999996,"15min":38.207999999999998},"last":1.093},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3169999999999999,"15min":1.419},"min":{"1min":0.35899999999999999,"5min":0.308,"15min":0.28399999999999997},"max":{"1min":4.4459999999999997,"5min":6.766,"15min":38.604999999999997},"last":0.98699999999999999}]},{"osd":2,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":4.9720000000000004,"5min":2.165,"15min":2.2759999999999998},"min":{"1min":0.315,"5min":0.29399999999999998,"15min":0.27700000000000002},"max":{"1min":56.594000000000001,"5min":56.594000000000001,"15min":195.44999999999999},"last":0.497},{"interface":"front","average":{"1min":4.6260000000000003,"5min":1.901,"15min":2.2290000000000001},"min":{"1min":0.35199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":49.973999999999997,"5min":49.973999999999997,"15min":196.434},"last":0.85199999999999998}]},{"osd":3,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":3.9910000000000001,"5min":2.0419999999999998,"15min":1.6200000000000001},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.29199999999999998},"max":{"1min":56.656999999999996,"5min":56.656999999999996,"15min":56.656999999999996},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.486,"5min":1.754,"15min":1.4910000000000001},"min":{"1min":0.377,"5min":0.312,"15min":0.30399999999999999},"max":{"1min":7.4980000000000002,"5min":20.448,"15min":26.555},"last":0.94299999999999995}]},{"osd":4,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.091,"15min":0.90100000000000002},"min":{"1min":0.309,"5min":0.29099999999999998,"15min":0.25900000000000001},"max":{"1min":10.99,"5min":10.99,"15min":10.99},"last":0.58699999999999997},{"interface":"front","average":{"1min":4.1580000000000004,"5min":1.6879999999999999,"15min":1.212},"min":{"1min":0.29899999999999999,"5min":0.29799999999999999,"15min":0.24099999999999999},"max":{"1min":56.554000000000002,"5min":56.554000000000002,"15min":56.554000000000002},"last":0.92000000000000004}]},{"osd":6,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":1.415,"15min":1.2529999999999999},"min":{"1min":0.375,"5min":0.316,"15min":0.252},"max":{"1min":23.843,"5min":23.843,"15min":26.523},"last":1.0309999999999999},{"interface":"front","average":{"1min":2.698,"5min":1.4510000000000001,"15min":1.1299999999999999},"min":{"1min":0.39100000000000001,"5min":0.34899999999999998,"15min":0.26100000000000001},"max":{"1min":33.350000000000001,"5min":33.350000000000001,"15min":33.350000000000001},"last":1.0640000000000001}]},{"osd":7,"last update":"Sun Sep 10 09:18:13 2023","interfaces":[{"interface":"back","average":{"1min":4.5830000000000002,"5min":1.9079999999999999,"15min":1.4299999999999999},"min":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.33800000000000002},"max":{"1min":56.682000000000002,"5min":56.682000000000002,"15min":56.682000000000002},"last":1.012},{"interface":"front","average":{"1min":1.9039999999999999,"5min":1.236,"15min":1.1779999999999999},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.28799999999999998},"max":{"1min":17.475000000000001,"5min":17.475000000000001,"15min":26.585999999999999},"last":1.145}]}]},{"osd":4,"up_from":15,"seq":64424515995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1797384,"kb_used_data":512,"kb_used_omap":10519,"kb_used_meta":1786344,"kb_avail":92574456,"statfs":{"total":96636764160,"available":94796242944,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10772002,"internal_metadata":1829216734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":2.4060000000000001,"15min":1.536},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.22600000000000001},"max":{"1min":8.0020000000000007,"5min":170.905,"15min":170.905},"last":1.121},{"interface":"front","average":{"1min":0.93500000000000005,"5min":2.423,"15min":1.8009999999999999},"min":{"1min":0.30499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.8339999999999996,"5min":171.51599999999999,"15min":171.51599999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.456,"5min":2.661,"15min":2.5800000000000001},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.251},"max":{"1min":8.1880000000000006,"5min":171.24600000000001,"15min":171.24600000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.2989999999999999,"5min":2.4430000000000001,"15min":1.8440000000000001},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.25700000000000001},"max":{"1min":8.3290000000000006,"5min":169.994,"15min":169.994},"last":0.80000000000000004}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":2.6680000000000001,"15min":1.8620000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":8.0370000000000008,"5min":170.63300000000001,"15min":170.63300000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.161,"5min":2.621,"15min":1.698},"min":{"1min":0.33900000000000002,"5min":0.318,"15min":0.29199999999999998},"max":{"1min":8.3599999999999994,"5min":170.95699999999999,"15min":170.95699999999999},"last":1.073}]},{"osd":3,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.2150000000000001,"15min":1.5980000000000001},"min":{"1min":0.39400000000000002,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":50.055999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.74,"5min":1.3859999999999999,"15min":1.5529999999999999},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.32800000000000001},"max":{"1min":8.1539999999999999,"5min":8.1539999999999999,"15min":39.930999999999997},"last":0.71999999999999997}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":0.98599999999999999,"15min":1.042},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":8.2729999999999997,"5min":14.725,"15min":38.646999999999998},"last":1.016},{"interface":"front","average":{"1min":1.893,"5min":1.0329999999999999,"15min":1.1830000000000001},"min":{"1min":0.32300000000000001,"5min":0.309,"15min":0.26900000000000002},"max":{"1min":15.965,"5min":15.965,"15min":29.584},"last":1}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2770000000000001,"5min":1.238,"15min":1.109},"min":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.28799999999999998},"max":{"1min":14.502000000000001,"5min":14.502000000000001,"15min":14.502000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.9199999999999999,"5min":0.98799999999999999,"15min":0.89800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38100000000000001,"15min":0.32100000000000001},"max":{"1min":13.645,"5min":13.645,"15min":13.645},"last":0.92300000000000004}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.1949999999999998,"5min":1.4359999999999999,"15min":1.6060000000000001},"min":{"1min":0.379,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":16.007000000000001,"5min":16.007000000000001,"15min":76.921000000000006},"last":0.95099999999999996},{"interface":"front","average":{"1min":3.472,"5min":1.488,"15min":1.4490000000000001},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.375},"max":{"1min":24.486000000000001,"5min":24.486000000000001,"15min":40.084000000000003},"last":1.034}]}]},{"osd":3,"up_from":14,"seq":60129548691,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1759240,"kb_used_data":512,"kb_used_omap":3803,"kb_used_meta":1754916,"kb_avail":92612600,"statfs":{"total":96636764160,"available":94835302400,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3894703,"internal_metadata":1797034577},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":0.98299999999999998,"15min":1.218},"min":{"1min":0.23000000000000001,"5min":0.189,"15min":0.189},"max":{"1min":5.4569999999999999,"5min":11.276,"15min":33.093000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0069999999999999,"15min":1.2450000000000001},"min":{"1min":0.246,"5min":0.22600000000000001,"15min":0.20200000000000001},"max":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":34.662999999999997},"last":0.95899999999999996}]},{"osd":1,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.02,"15min":1.425},"min":{"1min":0.25,"5min":0.23400000000000001,"15min":0.223},"max":{"1min":6.3899999999999997,"5min":6.3899999999999997,"15min":68.977000000000004},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.0649999999999999,"15min":1.3180000000000001},"min":{"1min":0.26200000000000001,"5min":0.253,"15min":0.219},"max":{"1min":9.5099999999999998,"5min":9.5099999999999998,"15min":68.938999999999993},"last":0.71799999999999997}]},{"osd":2,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.2559999999999998,"5min":1.3120000000000001,"15min":1.548},"min":{"1min":0.29499999999999998,"5min":0.28699999999999998,"15min":0.251},"max":{"1min":17.533000000000001,"5min":17.533000000000001,"15min":47.039000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.6719999999999999,"5min":1.1559999999999999,"15min":1.821},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.247},"max":{"1min":10.214,"5min":10.214,"15min":36.241999999999997},"last":0.81399999999999995}]},{"osd":4,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.014,"15min":1.357},"min":{"1min":0.34100000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":5.5819999999999999,"5min":6.8899999999999997,"15min":33.210999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":3.036,"5min":1.5589999999999999,"15min":1.4099999999999999},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":39.707000000000001,"5min":39.707000000000001,"15min":39.707000000000001},"last":1.107}]},{"osd":5,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":3.8420000000000001,"5min":1.6719999999999999,"15min":1.387},"min":{"1min":0.371,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":55.744,"5min":55.744,"15min":55.744},"last":1.0549999999999999},{"interface":"front","average":{"1min":3.992,"5min":1.7529999999999999,"15min":1.3759999999999999},"min":{"1min":0.40899999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":55.767000000000003,"5min":55.767000000000003,"15min":55.767000000000003},"last":1.0249999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":2.0680000000000001,"5min":1.355,"15min":1.2450000000000001},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":9.6590000000000007,"5min":9.6590000000000007,"15min":26.262},"last":1.204},{"interface":"front","average":{"1min":1.135,"5min":0.86599999999999999,"15min":1.4259999999999999},"min":{"1min":0.42799999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":3.9020000000000001,"5min":4.4630000000000001,"15min":33.179000000000002},"last":1.014}]},{"osd":7,"last update":"Sun Sep 10 09:17:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.1379999999999999,"15min":1.653},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":16.73,"5min":16.73,"15min":33.148000000000003},"last":1.1799999999999999},{"interface":"front","average":{"1min":2.5350000000000001,"5min":1.506,"15min":1.5329999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":16.992000000000001,"5min":16.992000000000001,"15min":35.390999999999998},"last":1.2350000000000001}]}]},{"osd":2,"up_from":14,"seq":60129548694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1507464,"kb_used_data":512,"kb_used_omap":4998,"kb_used_meta":1501945,"kb_avail":92864376,"statfs":{"total":96636764160,"available":95093121024,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5118553,"internal_metadata":1537992103},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.155,"15min":1.534},"min":{"1min":0.215,"5min":0.20000000000000001,"15min":0.19600000000000001},"max":{"1min":11.071999999999999,"5min":11.071999999999999,"15min":65.355000000000004},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.407,"15min":2.274},"min":{"1min":0.23899999999999999,"5min":0.223,"15min":0.20599999999999999},"max":{"1min":12.185,"5min":12.185,"15min":224.83600000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.573,"15min":2.5339999999999998},"min":{"1min":0.26700000000000002,"5min":0.22600000000000001,"15min":0.216},"max":{"1min":4.2300000000000004,"5min":43.220999999999997,"15min":224.595},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.86099999999999999,"5min":1.6499999999999999,"15min":1.4830000000000001},"min":{"1min":0.28499999999999998,"5min":0.23200000000000001,"15min":0.20699999999999999},"max":{"1min":4.4109999999999996,"5min":43.308999999999997,"15min":56.338999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":1.516,"15min":2.54},"min":{"1min":0.24399999999999999,"5min":0.221,"15min":0.219},"max":{"1min":3.948,"5min":19.939,"15min":105.649},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.753,"5min":1.163,"15min":2.8809999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.23400000000000001},"max":{"1min":3.4209999999999998,"5min":11.375999999999999,"15min":224.50999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.1459999999999999,"15min":1.222},"min":{"1min":0.45900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":3.4990000000000001,"5min":6.0149999999999997,"15min":21.675000000000001},"last":0.995},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.2450000000000001,"15min":1.3129999999999999},"min":{"1min":0.379,"5min":0.33600000000000002,"15min":0.30499999999999999},"max":{"1min":3.625,"5min":6.149,"15min":21.744},"last":1.042}]},{"osd":5,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.5269999999999999,"15min":1.607},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":4.5350000000000001,"5min":11.994,"15min":59.976999999999997},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.2949999999999999,"15min":1.2869999999999999},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.32200000000000001},"max":{"1min":3.4470000000000001,"5min":11.85,"15min":21.765000000000001},"last":1.1020000000000001}]},{"osd":6,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.373,"15min":1.5369999999999999},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.35499999999999998},"max":{"1min":4.0179999999999998,"5min":6.1050000000000004,"15min":59.996000000000002},"last":1.151},{"interface":"front","average":{"1min":0.94799999999999995,"5min":1.292,"15min":1.726},"min":{"1min":0.40799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":3.4790000000000001,"5min":11.416,"15min":99.072000000000003},"last":1.03}]},{"osd":7,"last update":"Sun Sep 10 09:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.627,"15min":1.571},"min":{"1min":0.49099999999999999,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":3.5800000000000001,"5min":25.815000000000001,"15min":25.815000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.9550000000000001,"15min":1.78},"min":{"1min":0.48399999999999999,"5min":0.379,"15min":0.379},"max":{"1min":4.0380000000000003,"5min":26.306000000000001,"15min":59.938000000000002},"last":1.236}]}]},{"osd":1,"up_from":14,"seq":60129548696,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883528,"kb_used_data":512,"kb_used_omap":6193,"kb_used_meta":1876814,"kb_avail":92488312,"statfs":{"total":96636764160,"available":94708031488,"internally_reserved":0,"allocated":524288,"data_stored":229134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6342184,"internal_metadata":1921858008},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.9889999999999999,"5min":1.597,"15min":1.5740000000000001},"min":{"1min":0.216,"5min":0.21299999999999999,"15min":0.20000000000000001},"max":{"1min":38.545999999999999,"5min":38.545999999999999,"15min":60.738999999999997},"last":0.871},{"interface":"front","average":{"1min":2.9350000000000001,"5min":1.4970000000000001,"15min":1.1259999999999999},"min":{"1min":0.23899999999999999,"5min":0.224,"15min":0.20000000000000001},"max":{"1min":21.262,"5min":21.262,"15min":21.262},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.149,"15min":2.4380000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.217},"max":{"1min":20.335000000000001,"5min":20.335000000000001,"15min":228.64500000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.627,"5min":1.2669999999999999,"15min":2.3580000000000001},"min":{"1min":0.27200000000000002,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":10.763999999999999,"5min":10.763999999999999,"15min":225.03800000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5110000000000001,"5min":1.4530000000000001,"15min":1.5369999999999999},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.23999999999999999},"max":{"1min":34.484999999999999,"5min":34.484999999999999,"15min":53.753},"last":0.76600000000000001},{"interface":"front","average":{"1min":3.3929999999999998,"5min":1.6160000000000001,"15min":1.8009999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":32.694000000000003,"5min":32.694000000000003,"15min":46.237000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.8160000000000001,"5min":1.2050000000000001,"15min":1.2929999999999999},"min":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"max":{"1min":20.431999999999999,"5min":20.431999999999999,"15min":44.07},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.998,"5min":1.2989999999999999,"15min":1.1220000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.29799999999999999},"max":{"1min":10.868,"5min":10.868,"15min":10.868},"last":1.0760000000000001}]},{"osd":5,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":2.7690000000000001,"5min":1.3600000000000001,"15min":1.1830000000000001},"min":{"1min":0.36699999999999999,"5min":0.35999999999999999,"15min":0.28000000000000003},"max":{"1min":14.874000000000001,"5min":14.874000000000001,"15min":14.874000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.133,"5min":0.92700000000000005,"15min":1.1060000000000001},"min":{"1min":0.40999999999999998,"5min":0.34200000000000003,"15min":0.32700000000000001},"max":{"1min":5.2800000000000002,"5min":6.2149999999999999,"15min":18.288},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":0.92400000000000004,"15min":1.0409999999999999},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.32200000000000001},"max":{"1min":6.5339999999999998,"5min":6.5339999999999998,"15min":6.5339999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":2.9609999999999999,"5min":1.5149999999999999,"15min":1.502},"min":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.34899999999999998},"max":{"1min":22.178000000000001,"5min":22.178000000000001,"15min":44.040999999999997},"last":1.097}]},{"osd":7,"last update":"Sun Sep 10 09:17:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2210000000000001,"5min":1.675,"15min":1.3740000000000001},"min":{"1min":0.53600000000000003,"5min":0.45700000000000002,"15min":0.377},"max":{"1min":12.454000000000001,"5min":12.454000000000001,"15min":15.6},"last":1.1140000000000001},{"interface":"front","average":{"1min":2.7250000000000001,"5min":1.415,"15min":1.2749999999999999},"min":{"1min":0.45600000000000002,"5min":0.42299999999999999,"15min":0.40999999999999998},"max":{"1min":18.433,"5min":18.433,"15min":19.521000000000001},"last":0.89400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129548695,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1775884,"kb_used_data":1092,"kb_used_omap":7073,"kb_used_meta":1767710,"kb_avail":92595956,"statfs":{"total":96636764160,"available":94818258944,"internally_reserved":0,"allocated":1118208,"data_stored":819502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7242918,"internal_metadata":1810135898},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.6829999999999998,"5min":1.25,"15min":1.476},"min":{"1min":0.21199999999999999,"5min":0.20000000000000001,"15min":0.17399999999999999},"max":{"1min":28.989000000000001,"5min":28.989000000000001,"15min":62.073},"last":0.97299999999999998},{"interface":"front","average":{"1min":2.7469999999999999,"5min":1.599,"15min":1.8939999999999999},"min":{"1min":0.245,"5min":0.23300000000000001,"15min":0.19},"max":{"1min":28.602,"5min":28.602,"15min":54.779000000000003},"last":0.94499999999999995}]},{"osd":2,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":4.8369999999999997,"5min":2.0030000000000001,"15min":1.4930000000000001},"min":{"1min":0.27500000000000002,"5min":0.22,"15min":0.219},"max":{"1min":37.030000000000001,"5min":37.030000000000001,"15min":40.866},"last":0.59799999999999998},{"interface":"front","average":{"1min":2.266,"5min":1.3029999999999999,"15min":1.385},"min":{"1min":0.377,"5min":0.24399999999999999,"15min":0.23799999999999999},"max":{"1min":12.275,"5min":12.275,"15min":73.090999999999994},"last":0.70299999999999996}]},{"osd":3,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.2480000000000002,"5min":1.4710000000000001,"15min":1.9750000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.217},"max":{"1min":16.908999999999999,"5min":16.908999999999999,"15min":73.126999999999995},"last":0.83699999999999997},{"interface":"front","average":{"1min":2.0419999999999998,"5min":1.3120000000000001,"15min":1.149},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26000000000000001},"max":{"1min":17.102,"5min":17.102,"15min":17.102},"last":0.65800000000000003}]},{"osd":4,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.234,"15min":1.492},"min":{"1min":0.37,"5min":0.33100000000000002,"15min":0.29799999999999999},"max":{"1min":11.300000000000001,"5min":11.300000000000001,"15min":73.176000000000002},"last":1.099},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.125,"15min":1.173},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":4.2800000000000002,"5min":7.4939999999999998,"15min":20.803000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.506,"15min":1.496},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":11.323,"5min":11.323,"15min":40.402999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.708,"5min":1.3420000000000001,"15min":1.5800000000000001},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.32700000000000001},"max":{"1min":11.657,"5min":11.657,"15min":73.195999999999998},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":1.4119999999999999,"15min":1.2569999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":24.265999999999998,"5min":24.265999999999998,"15min":24.265999999999998},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.956,"5min":1.4139999999999999,"15min":1.7649999999999999},"min":{"1min":0.44800000000000001,"5min":0.432,"15min":0.32000000000000001},"max":{"1min":11.747,"5min":11.747,"15min":73.153999999999996},"last":1.0109999999999999}]},{"osd":7,"last update":"Sun Sep 10 09:18:05 2023","interfaces":[{"interface":"back","average":{"1min":2.302,"5min":1.5509999999999999,"15min":1.375},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.371},"max":{"1min":12.739000000000001,"5min":12.739000000000001,"15min":12.739000000000001},"last":1.151},{"interface":"front","average":{"1min":1.9119999999999999,"5min":1.7569999999999999,"15min":1.6419999999999999},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.374},"max":{"1min":11.278,"5min":11.278,"15min":40.444000000000003},"last":1.127}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-10T09:18:39.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-10T09:18:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- 172.21.15.84:0/1529642375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c180047d0 msgr2=0x7f1c18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 --2- 172.21.15.84:0/1529642375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c180047d0 0x7f1c18004c50 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f1c240016b0 tx=0x7f1c2401c770 comp rx=0 tx=0).stop 2023-09-10T09:18:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c34ad8640 1 -- 172.21.15.84:0/1529642375 reap_dead start 2023-09-10T09:18:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- 172.21.15.84:0/1529642375 shutdown_connections 2023-09-10T09:18:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- 172.21.15.84:0/1529642375 >> 172.21.15.84:0/1529642375 conn(0x7f1c300c9a00 msgr2=0x7f1c300c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- 172.21.15.84:0/1529642375 shutdown_connections 2023-09-10T09:18:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- 172.21.15.84:0/1529642375 wait complete. 2023-09-10T09:18:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 Processor -- start 2023-09-10T09:18:39.831 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.817+0000 7f1c3653b640 1 -- start start 2023-09-10T09:18:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c300b0540 0x7f1c300c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1c300c6250 0x7f1c300c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.832 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c4f50 con 0x7f1c300c2d10 2023-09-10T09:18:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c5230 con 0x7f1c300b0540 2023-09-10T09:18:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300c5510 con 0x7f1c300c6250 2023-09-10T09:18:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39286/0 (socket says 172.21.15.84:39286) 2023-09-10T09:18:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 -- 172.21.15.84:0/2349003933 learned_addr learned my addr 172.21.15.84:0/2349003933 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2f7fe640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c300b0540 0x7f1c300c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c34ad8640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1c300c6250 0x7f1c300c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 -- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1c300c6250 msgr2=0x7f1c300c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1c300c6250 0x7f1c300c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 -- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c300b0540 msgr2=0x7f1c300c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c300b0540 0x7f1c300c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 -- 172.21.15.84:0/2349003933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300c57f0 con 0x7f1c300c2d10 2023-09-10T09:18:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2ffff640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f1c20011a80 tx=0x7f1c20011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000fe40 con 0x7f1c300c2d10 2023-09-10T09:18:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c20012540 con 0x7f1c300c2d10 2023-09-10T09:18:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c300c30f0 con 0x7f1c300c2d10 2023-09-10T09:18:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c20012930 con 0x7f1c300c2d10 2023-09-10T09:18:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c300b09a0 con 0x7f1c300c2d10 2023-09-10T09:18:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300c5090 con 0x7f1c300c2d10 2023-09-10T09:18:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7f1c20012a90 con 0x7f1c300c2d10 2023-09-10T09:18:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 0x7f1c1c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2f7fe640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 0x7f1c1c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1c20084240 con 0x7f1c300c2d10 2023-09-10T09:18:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.821+0000 7f1c2f7fe640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 0x7f1c1c067fe0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1c24001680 tx=0x7f1c24019510 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.825+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7f1c300c5090 con 0x7f1c300c2d10 2023-09-10T09:18:39.991 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.981+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1c300c5090 con 0x7f1c300c2d10 2023-09-10T09:18:39.996 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1c300c5090 con 0x7f1c300c2d10 2023-09-10T09:18:39.997 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c2cff9640 1 -- 172.21.15.84:0/2349003933 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1c200557f0 con 0x7f1c300c2d10 2023-09-10T09:18:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 msgr2=0x7f1c1c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 0x7f1c1c067fe0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1c24001680 tx=0x7f1c24019510 comp rx=0 tx=0).stop 2023-09-10T09:18:39.999 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 msgr2=0x7f1c300c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f1c20011a80 tx=0x7f1c20011f40 comp rx=0 tx=0).stop 2023-09-10T09:18:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 shutdown_connections 2023-09-10T09:18:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7f1c1c065b20 0x7f1c1c067fe0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.000 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1c300c6250 0x7f1c300c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c300b0540 0x7f1c300c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 --2- 172.21.15.84:0/2349003933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1c300c2d10 0x7f1c300c3930 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.001 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 >> 172.21.15.84:0/2349003933 conn(0x7f1c300c9a00 msgr2=0x7f1c30158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 shutdown_connections 2023-09-10T09:18:40.002 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:39.989+0000 7f1c3653b640 1 -- 172.21.15.84:0/2349003933 wait complete. 2023-09-10T09:18:40.015 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-10T09:18:40.015 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-10T09:18:40.132 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 -- 172.21.15.84:0/186031254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 msgr2=0x7fe47006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 --2- 172.21.15.84:0/186031254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe47006fad0 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7fe460009900 tx=0x7fe46001c7c0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 -- 172.21.15.84:0/186031254 shutdown_connections 2023-09-10T09:18:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 --2- 172.21.15.84:0/186031254 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe47006fad0 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 --2- 172.21.15.84:0/186031254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe47015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 -- 172.21.15.84:0/186031254 >> 172.21.15.84:0/186031254 conn(0x7fe4700cca70 msgr2=0x7fe4700cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:40.134 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 -- 172.21.15.84:0/186031254 shutdown_connections 2023-09-10T09:18:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.121+0000 7fe4785fa640 1 -- 172.21.15.84:0/186031254 wait complete. 2023-09-10T09:18:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 Processor -- start 2023-09-10T09:18:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- start start 2023-09-10T09:18:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 0x7fe47014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe4700c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c25c0 con 0x7fe4700c77f0 2023-09-10T09:18:40.139 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe470153d30 con 0x7fe470070010 2023-09-10T09:18:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c1f70 con 0x7fe47015ab50 2023-09-10T09:18:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:40.140 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52864/0 (socket says 172.21.15.84:52864) 2023-09-10T09:18:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 -- 172.21.15.84:0/179066062 learned_addr learned my addr 172.21.15.84:0/179066062 (peer_addr_for_me v2:172.21.15.84:0/0) 2023-09-10T09:18:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe476b97640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe4700c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe476396640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 0x7fe47014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 -- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 msgr2=0x7fe4700c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe4700c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 -- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 msgr2=0x7fe47014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 0x7fe47014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 -- 172.21.15.84:0/179066062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009560 con 0x7fe4700c77f0 2023-09-10T09:18:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe476b97640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe4700c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:18:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe476396640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 0x7fe47014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-10T09:18:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe475b95640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7fe460009850 tx=0x7fe4600a56c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460004240 con 0x7fe4700c77f0 2023-09-10T09:18:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe4600044b0 con 0x7fe4700c77f0 2023-09-10T09:18:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460003860 con 0x7fe4700c77f0 2023-09-10T09:18:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700c2250 con 0x7fe4700c77f0 2023-09-10T09:18:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700c06e0 con 0x7fe4700c77f0 2023-09-10T09:18:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.125+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700c2730 con 0x7fe4700c77f0 2023-09-10T09:18:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.129+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) v1 ==== 85354+0+0 (secure 0 0 0) 0x7fe4600b4070 con 0x7fe4700c77f0 2023-09-10T09:18:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.129+0000 7fe466ffd640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 0x7fe454067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-10T09:18:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.129+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe46011d2c0 con 0x7fe4700c77f0 2023-09-10T09:18:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.129+0000 7fe476396640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 0x7fe454067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-10T09:18:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.129+0000 7fe476396640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 0x7fe454067fe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0058d0 tx=0x7fe46c005cc0 comp rx=0 tx=0).ready entity=mgr.4212 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-10T09:18:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.133+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171412 (secure 0 0 0) 0x7fe4600eae80 con 0x7fe4700c77f0 2023-09-10T09:18:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.317+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4700c2700 con 0x7fe4700c77f0 2023-09-10T09:18:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe466ffd640 1 -- 172.21.15.84:0/179066062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3697 (secure 0 0 0) 0x7fe4600ee4a0 con 0x7fe4700c77f0 2023-09-10T09:18:40.328 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-09-10T09:18:40.329 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4829,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/143981861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":143981861},{"type":"v1","addr":"172.21.15.84:6837","nonce":143981861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/645865544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":645865544},{"type":"v1","addr":"172.21.15.100:6835","nonce":645865544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5038,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/586878137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":586878137},{"type":"v1","addr":"172.21.15.100:6833","nonce":586878137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":10491,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/1901328199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":1901328199},{"type":"v1","addr":"172.21.15.84:6836","nonce":1901328199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-09-10T09:18:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 18 2023-09-10T09:18:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 msgr2=0x7fe454067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 0x7fe454067fe0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0058d0 tx=0x7fe46c005cc0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 msgr2=0x7fe4700c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-10T09:18:40.331 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7fe460009850 tx=0x7fe4600a56c0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 shutdown_connections 2023-09-10T09:18:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:6832/670516398,v1:172.21.15.84:6833/670516398] conn(0x7fe454065b20 0x7fe454067fe0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.332 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe47015ab50 0x7fe4700c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe4700c77f0 0x7fe4700c01a0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 --2- 172.21.15.84:0/179066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe470070010 0x7fe47014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-10T09:18:40.333 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 >> 172.21.15.84:0/179066062 conn(0x7fe4700cca70 msgr2=0x7fe47015af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-10T09:18:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 shutdown_connections 2023-09-10T09:18:40.334 INFO:teuthology.orchestra.run.smithi084.stderr:2023-09-10T09:18:40.321+0000 7fe4785fa640 1 -- 172.21.15.84:0/179066062 wait complete. 2023-09-10T09:18:40.347 DEBUG:tasks.cephfs.filesystem:already dead... 2023-09-10T09:18:40.347 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-10T09:18:40.348 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-10T09:18:40.348 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:18:46.450 INFO:tasks.ceph.mds.a:Stopped 2023-09-10T09:18:46.451 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-10T09:18:46.451 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:18:52.553 INFO:tasks.ceph.mds.c:Stopped 2023-09-10T09:18:52.554 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-10T09:18:52.554 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:18:58.656 INFO:tasks.ceph.mds.b:Stopped 2023-09-10T09:18:58.657 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-10T09:18:58.657 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:18:59.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-09-10T09:19:04.759 INFO:tasks.ceph.mds.d:Stopped 2023-09-10T09:19:04.759 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-10T09:19:04.760 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-10T09:19:04.760 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:06.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-09-10T09:19:10.862 INFO:tasks.ceph.osd.0:Stopped 2023-09-10T09:19:10.863 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-10T09:19:10.863 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:23.067 INFO:tasks.ceph.osd.1:Stopped 2023-09-10T09:19:23.068 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-10T09:19:23.069 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:29.170 INFO:tasks.ceph.osd.2:Stopped 2023-09-10T09:19:29.171 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-10T09:19:29.171 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:36.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-09-10T09:19:41.375 INFO:tasks.ceph.osd.3:Stopped 2023-09-10T09:19:41.375 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-10T09:19:41.376 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:42.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-09-10T09:19:47.478 INFO:tasks.ceph.osd.4:Stopped 2023-09-10T09:19:47.479 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-10T09:19:47.480 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:53.583 INFO:tasks.ceph.osd.5:Stopped 2023-09-10T09:19:53.584 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-10T09:19:53.584 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:54.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-09-10T09:19:59.686 INFO:tasks.ceph.osd.6:Stopped 2023-09-10T09:19:59.687 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-10T09:19:59.687 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:19:59.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-09-10T09:19:59.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-09-10T09:20:05.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-09-10T09:20:05.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-09-10T09:20:05.789 INFO:tasks.ceph.osd.7:Stopped 2023-09-10T09:20:05.789 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-10T09:20:05.790 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-10T09:20:05.790 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:20:10.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-09-10T09:20:17.993 INFO:tasks.ceph.mgr.y:Stopped 2023-09-10T09:20:17.994 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-10T09:20:17.994 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:20:24.096 INFO:tasks.ceph.mgr.x:Stopped 2023-09-10T09:20:24.097 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-10T09:20:24.098 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-10T09:20:24.098 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:20:32.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-09-10T09:20:36.300 INFO:tasks.ceph.mon.a:Stopped 2023-09-10T09:20:36.301 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-10T09:20:36.302 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:20:37.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-09-10T09:20:42.406 INFO:tasks.ceph.mon.b:Stopped 2023-09-10T09:20:42.407 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-10T09:20:42.407 INFO:teuthology.orchestra.run:waiting for 300 2023-09-10T09:20:42.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-09-10T09:20:47.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-09-10T09:20:47.448 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-09-10T09:20:48.508 INFO:tasks.ceph.mon.c:Stopped 2023-09-10T09:20:48.509 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-10T09:20:48.510 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-09-10T09:20:48.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:20:48.837 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-10T09:20:50.044 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:20:50.045 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-10T09:20:50.417 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:20:50.417 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-10T09:20:50.787 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T09:20:50.788 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-10T09:20:51.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:20:51.138 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-10T09:20:51.638 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:20:51.639 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-10T09:20:51.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:20:51.980 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-10T09:20:52.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T09:20:52.320 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-10T09:20:52.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-09-10T09:20:52.631 INFO:tasks.ceph:Archiving mon data... 2023-09-10T09:20:52.633 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/data/mon.a.tgz 2023-09-10T09:20:52.634 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2023-09-10T09:20:52.639 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.e2KDw2pZKs 2023-09-10T09:20:52.640 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.e2KDw2pZKs 2023-09-10T09:20:52.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.e2KDw2pZKs 2023-09-10T09:20:53.123 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.e2KDw2pZKs is 630KB 2023-09-10T09:20:53.190 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.e2KDw2pZKs 2023-09-10T09:20:53.196 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/data/mon.b.tgz 2023-09-10T09:20:53.196 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-09-10T09:20:53.227 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.rgMYlOPOSR 2023-09-10T09:20:53.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rgMYlOPOSR 2023-09-10T09:20:53.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.rgMYlOPOSR 2023-09-10T09:20:53.598 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.rgMYlOPOSR is 640KB 2023-09-10T09:20:53.660 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.rgMYlOPOSR 2023-09-10T09:20:53.702 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/data/mon.c.tgz 2023-09-10T09:20:53.703 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-09-10T09:20:53.750 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.qaSz1aM451 2023-09-10T09:20:53.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qaSz1aM451 2023-09-10T09:20:53.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.qaSz1aM451 2023-09-10T09:20:53.974 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.qaSz1aM451 is 640KB 2023-09-10T09:20:53.993 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.qaSz1aM451 2023-09-10T09:20:53.999 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-10T09:20:53.999 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-10T09:20:54.002 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-10T09:20:54.158 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-10T09:20:54.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-10T09:20:54.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-10T09:20:54.220 INFO:teuthology.orchestra.run.smithi084.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-10T09:20:54.252 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-10T09:20:54.256 INFO:tasks.ceph:Archiving crash dumps... 2023-09-10T09:20:54.258 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi084/crash 2023-09-10T09:20:54.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-10T09:20:54.298 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi100/crash 2023-09-10T09:20:54.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-10T09:20:54.318 INFO:tasks.ceph:Shutting down logrotate 2023-09-10T09:22:40.004 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-10T09:22:40.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-10T09:22:40.063 INFO:tasks.ceph:Compressing logs... 2023-09-10T09:22:40.064 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-10T09:22:40.069 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-10T09:22:40.133 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486883.log 2023-09-10T09:22:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271118.log 2023-09-10T09:22:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100769.log 2023-09-10T09:22:40.135 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.486883.log: /var/log/ceph/ceph-client.admin.271118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338476.log 2023-09-10T09:22:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.100769.log: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.486883.log.gz 2023-09-10T09:22:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103181.log 2023-09-10T09:22:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.338476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217422.log 2023-09-10T09:22:40.137 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.103181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386108.log 2023-09-10T09:22:40.138 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409658.log 2023-09-10T09:22:40.141 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.217422.log: /var/log/ceph/ceph-client.admin.386108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159919.log 2023-09-10T09:22:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.409658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356056.log 2023-09-10T09:22:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115439.log 2023-09-10T09:22:40.142 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.159919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198704.log 2023-09-10T09:22:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.356056.log: /var/log/ceph/ceph-client.admin.115439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349557.log 2023-09-10T09:22:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481865.log 2023-09-10T09:22:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.198704.log: /var/log/ceph/ceph-client.admin.349557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83038.log 2023-09-10T09:22:40.143 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.481865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215184.log 2023-09-10T09:22:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398169.log 2023-09-10T09:22:40.144 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.83038.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.215184.log: -- /var/log/ceph/ceph-client.admin.373233.log 2023-09-10T09:22:40.144 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.481865.log.gz 2023-09-10T09:22:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.398169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111737.log 2023-09-10T09:22:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.373233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359704.log 2023-09-10T09:22:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.111737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422334.log 2023-09-10T09:22:40.145 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.359704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233591.log 2023-09-10T09:22:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.422334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270728.log 2023-09-10T09:22:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233989.log 2023-09-10T09:22:40.146 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.233591.log: gzip/var/log/ceph/ceph-client.admin.270728.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2023-09-10T09:22:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.233989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387827.log 2023-09-10T09:22:40.147 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233202.log 2023-09-10T09:22:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38062.log 2023-09-10T09:22:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38014.log 2023-09-10T09:22:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.38062.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38038.log 2023-09-10T09:22:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38086.log 2023-09-10T09:22:40.158 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38038.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-09-10T09:22:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38086.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-09-10T09:22:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44107.log 2023-09-10T09:22:40.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38110.log 2023-09-10T09:22:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-09-10T09:22:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.1.44107.log: /var/log/ceph/ceph-client.admin.38110.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-09-10T09:22:40.160 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-10T09:22:40.160 INFO:teuthology.orchestra.run.smithi100.stderr: 86.5%/var/log/ceph/ceph-mgr.x.log: -- replaced with /var/log/ceph/ceph-client.admin.38014.log.gz 2023-09-10T09:22:40.161 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44219.log 2023-09-10T09:22:40.161 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38182.log 2023-09-10T09:22:40.161 INFO:teuthology.orchestra.run.smithi100.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38062.log.gz 2023-09-10T09:22:40.161 INFO:teuthology.orchestra.run.smithi100.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38038.log.gz 2023-09-10T09:22:40.162 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.3.44219.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38086.log.gz 2023-09-10T09:22:40.162 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-10T09:22:40.166 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38182.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-10T09:22:40.166 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-09-10T09:22:40.166 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-09-10T09:22:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-10T09:22:40.167 INFO:teuthology.orchestra.run.smithi100.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38110.log.gz 2023-09-10T09:22:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-09-10T09:22:40.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38134.log 2023-09-10T09:22:40.168 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38158.log 2023-09-10T09:22:40.170 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38134.log: /var/log/ceph/ceph-client.admin.38158.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38182.log.gz 2023-09-10T09:22:40.170 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.1.44107.log.gz 2023-09-10T09:22:40.170 INFO:teuthology.orchestra.run.smithi100.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.3.44219.log.gz 2023-09-10T09:22:40.181 INFO:teuthology.orchestra.run.smithi100.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38158.log.gz 2023-09-10T09:22:40.217 INFO:teuthology.orchestra.run.smithi100.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38134.log.gz 2023-09-10T09:22:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.387827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209919.log 2023-09-10T09:22:40.229 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.233202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47298.log 2023-09-10T09:22:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105560.log 2023-09-10T09:22:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.209919.log: /var/log/ceph/ceph-client.admin.47298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405239.log 2023-09-10T09:22:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2023-09-10T09:22:40.230 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.105560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273528.log 2023-09-10T09:22:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.405239.log: /var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352835.log 2023-09-10T09:22:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.273528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48867.log 2023-09-10T09:22:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357661.log/var/log/ceph/ceph-client.admin.352835.log: 2023-09-10T09:22:40.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370577.log 2023-09-10T09:22:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.357661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495676.log 2023-09-10T09:22:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173132.log 2023-09-10T09:22:40.232 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.370577.log: /var/log/ceph/ceph-client.admin.495676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275932.log 2023-09-10T09:22:40.233 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.495676.log.gz 2023-09-10T09:22:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302596.log 2023-09-10T09:22:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498667.log 2023-09-10T09:22:40.233 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.275932.log: /var/log/ceph/ceph-client.admin.302596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151459.log 2023-09-10T09:22:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331168.log 2023-09-10T09:22:40.234 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.498667.log.gz 2023-09-10T09:22:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412926.log 2023-09-10T09:22:40.234 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.151459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391064.log 2023-09-10T09:22:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.331168.log: /var/log/ceph/ceph-client.admin.412926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82639.log 2023-09-10T09:22:40.235 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.217422.log.gz 2023-09-10T09:22:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.391064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336027.log 2023-09-10T09:22:40.235 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.82639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149846.log 2023-09-10T09:22:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.336027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165860.log 2023-09-10T09:22:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424562.log 2023-09-10T09:22:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.149846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499485.log 2023-09-10T09:22:40.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165860.log: /var/log/ceph/ceph-client.admin.424562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487295.log 2023-09-10T09:22:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277130.log 2023-09-10T09:22:40.237 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.487295.log: gzip -5 --verbose 87.4% -- /var/log/ceph/ceph-client.admin.271925.log -- replaced with /var/log/ceph/ceph-client.admin.499485.log.gz 2023-09-10T09:22:40.237 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:40.238 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.487295.log.gz 2023-09-10T09:22:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125150.log 2023-09-10T09:22:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.277130.log: /var/log/ceph/ceph-client.admin.271925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392799.log 2023-09-10T09:22:40.238 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38190.log 2023-09-10T09:22:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.392799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87776.log 2023-09-10T09:22:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.38190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314284.log 2023-09-10T09:22:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.87776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407208.log 2023-09-10T09:22:40.239 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164187.log 2023-09-10T09:22:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.314284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360918.log 2023-09-10T09:22:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.407208.log: /var/log/ceph/ceph-client.admin.164187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201966.log 2023-09-10T09:22:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184470.log 2023-09-10T09:22:40.240 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.360918.log: /var/log/ceph/ceph-client.admin.201966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2023-09-10T09:22:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.184470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372030.log 2023-09-10T09:22:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316536.log 2023-09-10T09:22:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45904.log: /var/log/ceph/ceph-client.admin.372030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113361.log 2023-09-10T09:22:40.241 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.316536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498261.log 2023-09-10T09:22:40.242 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2023-09-10T09:22:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.113361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415407.log 2023-09-10T09:22:40.242 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236045.log 2023-09-10T09:22:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.415407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275121.log 2023-09-10T09:22:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.236045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201515.log 2023-09-10T09:22:40.243 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.498261.log.gz 2023-09-10T09:22:40.243 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.275121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2023-09-10T09:22:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.201515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384359.log 2023-09-10T09:22:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194027.log 2023-09-10T09:22:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.384359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97517.log 2023-09-10T09:22:40.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.194027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395296.log 2023-09-10T09:22:40.245 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2023-09-10T09:22:40.245 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410463.log 2023-09-10T09:22:40.245 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97517.log: /var/log/ceph/ceph-client.admin.395296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281258.log 2023-09-10T09:22:40.245 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.410463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229204.log 2023-09-10T09:22:40.246 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.281258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345363.log 2023-09-10T09:22:40.246 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.229204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306766.log 2023-09-10T09:22:40.246 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47298.log.gz 2023-09-10T09:22:40.246 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.345363.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-09-10T09:22:40.247 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.306766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363746.log 2023-09-10T09:22:40.247 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470682.log 2023-09-10T09:22:40.247 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.363746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285756.log 2023-09-10T09:22:40.247 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2023-09-10T09:22:40.248 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.470682.log: gzip/var/log/ceph/ceph-client.admin.285756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.428216.log 2023-09-10T09:22:40.248 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122304.log 2023-09-10T09:22:40.248 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122295.log 2023-09-10T09:22:40.248 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.428216.log: /var/log/ceph/ceph-client.admin.122304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245712.log 2023-09-10T09:22:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.122295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493592.log 2023-09-10T09:22:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246914.log 2023-09-10T09:22:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.245712.log: /var/log/ceph/ceph-client.admin.493592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101968.log 2023-09-10T09:22:40.249 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213523.log 2023-09-10T09:22:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.246914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49475.log 2023-09-10T09:22:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.101968.log: /var/log/ceph/ceph-client.admin.213523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2023-09-10T09:22:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.49475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269928.log 2023-09-10T09:22:40.250 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287751.log 2023-09-10T09:22:40.251 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48867.log.gz 2023-09-10T09:22:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.269928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300301.log 2023-09-10T09:22:40.251 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399525.log 2023-09-10T09:22:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.287751.log: /var/log/ceph/ceph-client.admin.300301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291349.log 2023-09-10T09:22:40.252 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.493592.log.gz 2023-09-10T09:22:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.399525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371701.log 2023-09-10T09:22:40.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.291349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107165.log 2023-09-10T09:22:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.371701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237302.log 2023-09-10T09:22:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304245.log 2023-09-10T09:22:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.237302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373242.log 2023-09-10T09:22:40.253 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169701.log 2023-09-10T09:22:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.304245.log: /var/log/ceph/ceph-client.admin.373242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340076.log 2023-09-10T09:22:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187460.log 2023-09-10T09:22:40.254 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.169701.log: /var/log/ceph/ceph-client.admin.340076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357267.log 2023-09-10T09:22:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405702.log 2023-09-10T09:22:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.187460.log: /var/log/ceph/ceph-client.admin.357267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151062.log 2023-09-10T09:22:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.405702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414598.log 2023-09-10T09:22:40.255 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47985.log 2023-09-10T09:22:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.151062.log: /var/log/ceph/ceph-client.admin.414598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96685.log 2023-09-10T09:22:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394453.log 2023-09-10T09:22:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484418.log 2023-09-10T09:22:40.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96685.log: /var/log/ceph/ceph-client.admin.394453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370188.log 2023-09-10T09:22:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.484418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290525.log 2023-09-10T09:22:40.257 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.484418.log.gz 2023-09-10T09:22:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2023-09-10T09:22:40.257 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.370188.log: /var/log/ceph/ceph-client.admin.290525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89877.log 2023-09-10T09:22:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344131.log 2023-09-10T09:22:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343738.log 2023-09-10T09:22:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.89877.log: /var/log/ceph/ceph-client.admin.344131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2023-09-10T09:22:40.258 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373641.log 2023-09-10T09:22:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.343738.log: /var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496976.log 2023-09-10T09:22:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.373641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243597.log 2023-09-10T09:22:40.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.496976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475959.log 2023-09-10T09:22:40.259 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.373233.log.gz 2023-09-10T09:22:40.260 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.496976.log.gz 2023-09-10T09:22:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316064.log 2023-09-10T09:22:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.243597.log: /var/log/ceph/ceph-client.admin.475959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482734.log 2023-09-10T09:22:40.260 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.316064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106356.log 2023-09-10T09:22:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.482734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286957.log 2023-09-10T09:22:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272328.log 2023-09-10T09:22:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.286957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363306.log 2023-09-10T09:22:40.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.272328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181564.log 2023-09-10T09:22:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.363306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2023-09-10T09:22:40.262 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.181564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289729.log 2023-09-10T09:22:40.262 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.475959.log.gz 2023-09-10T09:22:40.262 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.482734.log.gz 2023-09-10T09:22:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475950.log 2023-09-10T09:22:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44989.log: /var/log/ceph/ceph-client.admin.289729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364533.log 2023-09-10T09:22:40.263 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.475950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173936.log 2023-09-10T09:22:40.263 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.475950.log.gz 2023-09-10T09:22:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.364533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498693.log 2023-09-10T09:22:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162926.log 2023-09-10T09:22:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.173936.log: /var/log/ceph/ceph-client.admin.498693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124349.log 2023-09-10T09:22:40.264 INFO:teuthology.orchestra.run.smithi084.stderr:gzip 87.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.498693.log.gz -- 2023-09-10T09:22:40.265 INFO:teuthology.orchestra.run.smithi084.stderr: /var/log/ceph/ceph-client.admin.44940.log 2023-09-10T09:22:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162926.log: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.233591.log.gz 2023-09-10T09:22:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350782.log 2023-09-10T09:22:40.265 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.124349.log: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.233989.log.gz 2023-09-10T09:22:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102783.log 2023-09-10T09:22:40.266 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.233202.log.gz 2023-09-10T09:22:40.266 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.350782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125141.log 2023-09-10T09:22:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log/var/log/ceph/ceph-client.admin.102783.log: 2023-09-10T09:22:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416210.log 2023-09-10T09:22:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.49341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157006.log 2023-09-10T09:22:40.267 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.416210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346788.log 2023-09-10T09:22:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.157006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2023-09-10T09:22:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.346788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486091.log 2023-09-10T09:22:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191901.log 2023-09-10T09:22:40.268 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98713.log 2023-09-10T09:22:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.486091.log: /var/log/ceph/ceph-client.admin.191901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334049.log 2023-09-10T09:22:40.269 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.405239.log.gz 2023-09-10T09:22:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485220.log 2023-09-10T09:22:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.98713.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.486091.log.gz 2023-09-10T09:22:40.269 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107564.log 2023-09-10T09:22:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.334049.log: /var/log/ceph/ceph-client.admin.485220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484827.log 2023-09-10T09:22:40.270 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.485220.log.gz 2023-09-10T09:22:40.270 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.107564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414184.log 2023-09-10T09:22:40.271 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.484827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102774.log 2023-09-10T09:22:40.271 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.414184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408005.log 2023-09-10T09:22:40.271 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.102774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89078.log 2023-09-10T09:22:40.271 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484827.log.gz 2023-09-10T09:22:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.408005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85240.log 2023-09-10T09:22:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.89078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225091.log 2023-09-10T09:22:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.85240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351215.log 2023-09-10T09:22:40.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.225091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43978.log 2023-09-10T09:22:40.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.351215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206007.log 2023-09-10T09:22:40.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2023-09-10T09:22:40.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.206007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228806.log 2023-09-10T09:22:40.273 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200322.log 2023-09-10T09:22:40.274 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.100769.log.gz 2023-09-10T09:22:40.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47696.log: /var/log/ceph/ceph-client.admin.228806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219071.log 2023-09-10T09:22:40.274 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336425.log 2023-09-10T09:22:40.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.200322.log: /var/log/ceph/ceph-client.admin.219071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121481.log 2023-09-10T09:22:40.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.336425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46953.log 2023-09-10T09:22:40.275 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411696.log 2023-09-10T09:22:40.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.121481.log: /var/log/ceph/ceph-client.admin.46953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115842.log 2023-09-10T09:22:40.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.411696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423267.log 2023-09-10T09:22:40.276 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.115842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353666.log 2023-09-10T09:22:40.276 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.423267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362908.log 2023-09-10T09:22:40.276 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.353666.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.103181.log.gz 2023-09-10T09:22:40.277 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98704.log 2023-09-10T09:22:40.277 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.362908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200313.log 2023-09-10T09:22:40.277 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.98704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182417.log 2023-09-10T09:22:40.277 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.200313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48899.log 2023-09-10T09:22:40.278 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105967.log 2023-09-10T09:22:40.278 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.105560.log.gz 2023-09-10T09:22:40.278 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.182417.log: /var/log/ceph/ceph-client.admin.48899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110007.log 2023-09-10T09:22:40.278 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.105967.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.499329.log 2023-09-10T09:22:40.279 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147855.log 2023-09-10T09:22:40.279 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153661.log 2023-09-10T09:22:40.279 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.147855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499459.log 2023-09-10T09:22:40.279 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.499329.log.gz 2023-09-10T09:22:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-10T09:22:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.153661.log: /var/log/ceph/ceph-client.admin.499459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115833.log 2023-09-10T09:22:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499459.log.gz 2023-09-10T09:22:40.280 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82648.log 2023-09-10T09:22:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.115833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84379.log 2023-09-10T09:22:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.82648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97908.log 2023-09-10T09:22:40.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.84379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48115.log 2023-09-10T09:22:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415796.log 2023-09-10T09:22:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97908.log: /var/log/ceph/ceph-client.admin.48115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386117.log 2023-09-10T09:22:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.415796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492320.log 2023-09-10T09:22:40.282 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.386117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129196.log 2023-09-10T09:22:40.283 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286560.log 2023-09-10T09:22:40.283 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.492320.log: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.492320.log.gz 2023-09-10T09:22:40.283 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.129196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193137.log 2023-09-10T09:22:40.284 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.286560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487692.log 2023-09-10T09:22:40.284 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170128.log 2023-09-10T09:22:40.284 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.193137.log: /var/log/ceph/ceph-client.admin.487692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389878.log 2023-09-10T09:22:40.284 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.487692.log.gz 2023-09-10T09:22:40.285 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2023-09-10T09:22:40.285 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.170128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201117.log 2023-09-10T09:22:40.285 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.389878.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.338476.log.gz 2023-09-10T09:22:40.285 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2023-09-10T09:22:40.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.201117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45956.log 2023-09-10T09:22:40.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205190.log 2023-09-10T09:22:40.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44992.log 2023-09-10T09:22:40.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.205190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358073.log 2023-09-10T09:22:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49043.log 2023-09-10T09:22:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351224.log 2023-09-10T09:22:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.358073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362519.log 2023-09-10T09:22:40.287 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.49043.log: /var/log/ceph/ceph-client.admin.351224.log: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.349557.log.gz 2023-09-10T09:22:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367746.log 2023-09-10T09:22:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.362519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475111.log 2023-09-10T09:22:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.367746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37937.log 2023-09-10T09:22:40.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.475111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303448.log 2023-09-10T09:22:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175928.log 2023-09-10T09:22:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331571.log 2023-09-10T09:22:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.303448.log: /var/log/ceph/ceph-client.admin.175928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2023-09-10T09:22:40.289 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314682.log 2023-09-10T09:22:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.331571.log: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.370577.log.gz 2023-09-10T09:22:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467481.log 2023-09-10T09:22:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46615.log: /var/log/ceph/ceph-client.admin.314682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231194.log 2023-09-10T09:22:40.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.467481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152321.log 2023-09-10T09:22:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.231194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161125.log 2023-09-10T09:22:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241888.log/var/log/ceph/ceph-client.admin.152321.log: 2023-09-10T09:22:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.161125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167993.log 2023-09-10T09:22:40.291 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467089.log 2023-09-10T09:22:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.241888.log: /var/log/ceph/ceph-client.admin.167993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397350.log 2023-09-10T09:22:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.467089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346430.log 2023-09-10T09:22:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.397350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481060.log 2023-09-10T09:22:40.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.346430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396092.log 2023-09-10T09:22:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340472.log 2023-09-10T09:22:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.481060.log: /var/log/ceph/ceph-client.admin.396092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274315.log 2023-09-10T09:22:40.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.340472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499587.log 2023-09-10T09:22:40.293 INFO:teuthology.orchestra.run.smithi084.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.481060.log.gz 2023-09-10T09:22:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2023-09-10T09:22:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.274315.log: /var/log/ceph/ceph-client.admin.499587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397739.log 2023-09-10T09:22:40.294 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.499587.log.gz 2023-09-10T09:22:40.294 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349163.log 2023-09-10T09:22:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2023-09-10T09:22:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.397739.log: /var/log/ceph/ceph-client.admin.349163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133588.log 2023-09-10T09:22:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86500.log 2023-09-10T09:22:40.295 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.133588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485619.log 2023-09-10T09:22:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415008.log 2023-09-10T09:22:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.86500.log: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.165860.log.gz 2023-09-10T09:22:40.296 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.485619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346574.log 2023-09-10T09:22:40.296 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.485619.log.gz 2023-09-10T09:22:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.415008.log: /var/log/ceph/ceph-client.admin.381955.log 2023-09-10T09:22:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.346574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287345.log 2023-09-10T09:22:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.381955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2023-09-10T09:22:40.297 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43647.log 2023-09-10T09:22:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.287345.log: /var/log/ceph/ceph-client.admin.47220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2023-09-10T09:22:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386572.log 2023-09-10T09:22:40.298 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237311.log 2023-09-10T09:22:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.386572.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.286551.log 2023-09-10T09:22:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.237311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348751.log 2023-09-10T09:22:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.286551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331159.log 2023-09-10T09:22:40.299 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346165.log 2023-09-10T09:22:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.348751.log: /var/log/ceph/ceph-client.admin.331159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477231.log 2023-09-10T09:22:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.346165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2023-09-10T09:22:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.477231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208261.log 2023-09-10T09:22:40.300 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38171.log 2023-09-10T09:22:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403083.log 2023-09-10T09:22:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.208261.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.477231.log.gz 2023-09-10T09:22:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.38171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99110.log 2023-09-10T09:22:40.301 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.403083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46823.log 2023-09-10T09:22:40.302 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.83038.log.gz 2023-09-10T09:22:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.99110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46875.log 2023-09-10T09:22:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295801.log 2023-09-10T09:22:40.302 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413786.log 2023-09-10T09:22:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.295801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106764.log 2023-09-10T09:22:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.413786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282063.log 2023-09-10T09:22:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.106764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285359.log 2023-09-10T09:22:40.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.282063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497415.log 2023-09-10T09:22:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.285359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2023-09-10T09:22:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.497415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189901.log 2023-09-10T09:22:40.304 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.497415.log.gz 2023-09-10T09:22:40.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155324.log 2023-09-10T09:22:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365334.log 2023-09-10T09:22:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.189901.log: /var/log/ceph/ceph-client.admin.155324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2023-09-10T09:22:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.365334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168847.log 2023-09-10T09:22:40.305 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402686.log 2023-09-10T09:22:40.306 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48562.log: /var/log/ceph/ceph-client.admin.168847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410852.log 2023-09-10T09:22:40.306 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.402686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133579.log 2023-09-10T09:22:40.306 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.410852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412103.log 2023-09-10T09:22:40.306 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.133579.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.401856.log 2023-09-10T09:22:40.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.412103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363737.log 2023-09-10T09:22:40.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.401856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409260.log 2023-09-10T09:22:40.307 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154063.log 2023-09-10T09:22:40.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.363737.log: /var/log/ceph/ceph-client.admin.409260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110895.log 2023-09-10T09:22:40.308 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.154063.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.313420.log 2023-09-10T09:22:40.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.110895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125587.log 2023-09-10T09:22:40.308 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46352.log 2023-09-10T09:22:40.309 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.313420.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.391064.log.gz 2023-09-10T09:22:40.309 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.125587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466682.log 2023-09-10T09:22:40.309 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194457.log 2023-09-10T09:22:40.309 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.2.46352.log: /var/log/ceph/ceph-client.admin.466682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179917.log 2023-09-10T09:22:40.310 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.194457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177918.log 2023-09-10T09:22:40.310 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.179917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303457.log 2023-09-10T09:22:40.310 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2023-09-10T09:22:40.310 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.177918.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.407208.log.gz 2023-09-10T09:22:40.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.303457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96694.log 2023-09-10T09:22:40.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47377.log 2023-09-10T09:22:40.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.96694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209494.log 2023-09-10T09:22:40.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2023-09-10T09:22:40.312 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.209494.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.204359.log 2023-09-10T09:22:40.312 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154072.log 2023-09-10T09:22:40.312 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163318.log 2023-09-10T09:22:40.312 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.204359.log: /var/log/ceph/ceph-client.admin.154072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2023-09-10T09:22:40.313 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369785.log 2023-09-10T09:22:40.313 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.43621.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.499511.log 2023-09-10T09:22:40.313 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.369785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405248.log 2023-09-10T09:22:40.313 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165471.log 2023-09-10T09:22:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.405248.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499511.log.gz 2023-09-10T09:22:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221074.log 2023-09-10T09:22:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50003.log 2023-09-10T09:22:40.314 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.165471.log: /var/log/ceph/ceph-client.admin.221074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47828.log 2023-09-10T09:22:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123941.log 2023-09-10T09:22:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197508.log 2023-09-10T09:22:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418669.log 2023-09-10T09:22:40.315 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179118.log 2023-09-10T09:22:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386581.log 2023-09-10T09:22:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419882.log 2023-09-10T09:22:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2023-09-10T09:22:40.316 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158758.log 2023-09-10T09:22:40.317 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227523.log 2023-09-10T09:22:40.317 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189052.log 2023-09-10T09:22:40.317 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273519.log 2023-09-10T09:22:40.317 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186459.log 2023-09-10T09:22:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498719.log 2023-09-10T09:22:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2023-09-10T09:22:40.318 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184082.log 2023-09-10T09:22:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99909.log 2023-09-10T09:22:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469090.log 2023-09-10T09:22:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427779.log 2023-09-10T09:22:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413795.log 2023-09-10T09:22:40.319 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232788.log 2023-09-10T09:22:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421928.log 2023-09-10T09:22:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222677.log 2023-09-10T09:22:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242713.log 2023-09-10T09:22:40.320 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2023-09-10T09:22:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228408.log 2023-09-10T09:22:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49199.log 2023-09-10T09:22:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338055.log 2023-09-10T09:22:40.321 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419469.log 2023-09-10T09:22:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484016.log 2023-09-10T09:22:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158307.log 2023-09-10T09:22:40.322 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164178.log 2023-09-10T09:22:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190299.log 2023-09-10T09:22:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49173.log 2023-09-10T09:22:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279537.log 2023-09-10T09:22:40.323 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332799.log 2023-09-10T09:22:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120624.log 2023-09-10T09:22:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45696.log 2023-09-10T09:22:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498615.log 2023-09-10T09:22:40.324 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223483.log 2023-09-10T09:22:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372039.log 2023-09-10T09:22:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48815.log 2023-09-10T09:22:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2023-09-10T09:22:40.325 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2023-09-10T09:22:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205181.log 2023-09-10T09:22:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309176.log 2023-09-10T09:22:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246101.log 2023-09-10T09:22:40.326 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232398.log 2023-09-10T09:22:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244510.log 2023-09-10T09:22:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224688.log 2023-09-10T09:22:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94257.log 2023-09-10T09:22:40.327 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498973.log 2023-09-10T09:22:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161116.log 2023-09-10T09:22:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423945.log 2023-09-10T09:22:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382751.log 2023-09-10T09:22:40.328 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-10T09:22:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132210.log 2023-09-10T09:22:40.329 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385189.log 2023-09-10T09:22:40.330 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-10T09:22:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37895.log 2023-09-10T09:22:40.440 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179908.log 2023-09-10T09:22:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49553.log 2023-09-10T09:22:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49683.log 2023-09-10T09:22:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280353.log 2023-09-10T09:22:40.441 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217820.log 2023-09-10T09:22:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236879.log 2023-09-10T09:22:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177909.log 2023-09-10T09:22:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2023-09-10T09:22:40.442 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478454.log 2023-09-10T09:22:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207854.log 2023-09-10T09:22:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229602.log 2023-09-10T09:22:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235655.log 2023-09-10T09:22:40.443 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46563.log 2023-09-10T09:22:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354064.log 2023-09-10T09:22:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208252.log 2023-09-10T09:22:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101168.log 2023-09-10T09:22:40.444 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469479.log 2023-09-10T09:22:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404840.log 2023-09-10T09:22:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289738.log 2023-09-10T09:22:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331562.log 2023-09-10T09:22:40.445 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332808.log 2023-09-10T09:22:40.446 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420270.log 2023-09-10T09:22:40.446 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316055.log 2023-09-10T09:22:40.446 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2023-09-10T09:22:40.447 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287354.log 2023-09-10T09:22:40.447 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45592.log 2023-09-10T09:22:40.447 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332397.log 2023-09-10T09:22:40.447 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409269.log 2023-09-10T09:22:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488522.log 2023-09-10T09:22:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342889.log 2023-09-10T09:22:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482261.log 2023-09-10T09:22:40.448 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195761.log 2023-09-10T09:22:40.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203552.log 2023-09-10T09:22:40.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288933.log 2023-09-10T09:22:40.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294199.log 2023-09-10T09:22:40.449 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154916.log 2023-09-10T09:22:40.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497844.log 2023-09-10T09:22:40.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393197.log 2023-09-10T09:22:40.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120633.log 2023-09-10T09:22:40.450 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185274.log 2023-09-10T09:22:40.451 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165869.log 2023-09-10T09:22:40.451 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170991.log 2023-09-10T09:22:40.451 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112547.log 2023-09-10T09:22:40.452 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111746.log 2023-09-10T09:22:40.452 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270317.log 2023-09-10T09:22:40.452 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175919.log 2023-09-10T09:22:40.452 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166296.log 2023-09-10T09:22:40.453 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394028.log 2023-09-10T09:22:40.453 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235247.log 2023-09-10T09:22:40.453 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312564.log 2023-09-10T09:22:40.453 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2023-09-10T09:22:40.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48614.log 2023-09-10T09:22:40.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201957.log 2023-09-10T09:22:40.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47880.log 2023-09-10T09:22:40.454 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291340.log 2023-09-10T09:22:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180719.log 2023-09-10T09:22:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151886.log 2023-09-10T09:22:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496538.log 2023-09-10T09:22:40.455 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295792.log 2023-09-10T09:22:40.456 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340481.log 2023-09-10T09:22:40.456 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419478.log 2023-09-10T09:22:40.456 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488531.log 2023-09-10T09:22:40.456 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407199.log 2023-09-10T09:22:40.457 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494834.log 2023-09-10T09:22:40.457 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419074.log 2023-09-10T09:22:40.457 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115011.log 2023-09-10T09:22:40.457 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83448.log 2023-09-10T09:22:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293791.log 2023-09-10T09:22:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162497.log 2023-09-10T09:22:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205618.log 2023-09-10T09:22:40.458 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2023-09-10T09:22:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471080.log 2023-09-10T09:22:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425756.log 2023-09-10T09:22:40.459 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-10T09:22:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415805.log 2023-09-10T09:22:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2023-09-10T09:22:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360112.log 2023-09-10T09:22:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191892.log 2023-09-10T09:22:40.460 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332388.log 2023-09-10T09:22:40.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288139.log 2023-09-10T09:22:40.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123950.log 2023-09-10T09:22:40.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491908.log 2023-09-10T09:22:40.461 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283331.log 2023-09-10T09:22:40.462 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275529.log 2023-09-10T09:22:40.462 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402677.log 2023-09-10T09:22:40.462 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498252.log 2023-09-10T09:22:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282460.log 2023-09-10T09:22:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399033.log 2023-09-10T09:22:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313004.log 2023-09-10T09:22:40.463 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94711.log 2023-09-10T09:22:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491478.log 2023-09-10T09:22:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95849.log 2023-09-10T09:22:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307163.log 2023-09-10T09:22:40.464 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192688.log 2023-09-10T09:22:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171408.log 2023-09-10T09:22:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44758.log 2023-09-10T09:22:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96267.log 2023-09-10T09:22:40.465 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225082.log 2023-09-10T09:22:40.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417065.log 2023-09-10T09:22:40.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344974.log 2023-09-10T09:22:40.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478917.log 2023-09-10T09:22:40.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489383.log 2023-09-10T09:22:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385644.log 2023-09-10T09:22:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272718.log 2023-09-10T09:22:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47800.log 2023-09-10T09:22:40.467 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104366.log 2023-09-10T09:22:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483602.log 2023-09-10T09:22:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162488.log 2023-09-10T09:22:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110460.log 2023-09-10T09:22:40.468 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465098.log 2023-09-10T09:22:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186061.log 2023-09-10T09:22:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372433.log 2023-09-10T09:22:40.469 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225897.log 2023-09-10T09:22:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229611.log 2023-09-10T09:22:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2023-09-10T09:22:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426556.log 2023-09-10T09:22:40.470 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176317.log 2023-09-10T09:22:40.471 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470275.log 2023-09-10T09:22:40.471 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218209.log 2023-09-10T09:22:40.471 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213123.log 2023-09-10T09:22:40.471 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478908.log 2023-09-10T09:22:40.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293392.log 2023-09-10T09:22:40.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492741.log 2023-09-10T09:22:40.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199923.log 2023-09-10T09:22:40.472 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2023-09-10T09:22:40.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2023-09-10T09:22:40.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274727.log 2023-09-10T09:22:40.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475546.log 2023-09-10T09:22:40.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293800.log 2023-09-10T09:22:40.474 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302134.log 2023-09-10T09:22:40.474 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484427.log 2023-09-10T09:22:40.474 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193581.log 2023-09-10T09:22:40.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405711.log 2023-09-10T09:22:40.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148647.log 2023-09-10T09:22:40.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422723.log 2023-09-10T09:22:40.475 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46214.log 2023-09-10T09:22:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175521.log 2023-09-10T09:22:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107955.log 2023-09-10T09:22:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109604.log 2023-09-10T09:22:40.476 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367355.log 2023-09-10T09:22:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47246.log 2023-09-10T09:22:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352033.log 2023-09-10T09:22:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285368.log 2023-09-10T09:22:40.477 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38126.log 2023-09-10T09:22:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171417.log 2023-09-10T09:22:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228815.log 2023-09-10T09:22:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420669.log 2023-09-10T09:22:40.478 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469081.log 2023-09-10T09:22:40.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283739.log 2023-09-10T09:22:40.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44571.log 2023-09-10T09:22:40.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412094.log 2023-09-10T09:22:40.479 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174325.log 2023-09-10T09:22:40.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371408.log 2023-09-10T09:22:40.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44493.log 2023-09-10T09:22:40.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189503.log 2023-09-10T09:22:40.480 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364542.log 2023-09-10T09:22:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362112.log 2023-09-10T09:22:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151895.log 2023-09-10T09:22:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95450.log 2023-09-10T09:22:40.481 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130082.log 2023-09-10T09:22:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88226.log 2023-09-10T09:22:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191484.log 2023-09-10T09:22:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186468.log 2023-09-10T09:22:40.482 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2023-09-10T09:22:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355657.log 2023-09-10T09:22:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172263.log 2023-09-10T09:22:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309583.log 2023-09-10T09:22:40.483 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2023-09-10T09:22:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2023-09-10T09:22:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171844.log 2023-09-10T09:22:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294190.log 2023-09-10T09:22:40.484 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484818.log 2023-09-10T09:22:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182857.log 2023-09-10T09:22:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195315.log 2023-09-10T09:22:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495685.log 2023-09-10T09:22:40.485 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223085.log 2023-09-10T09:22:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346421.log 2023-09-10T09:22:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488961.log 2023-09-10T09:22:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155741.log 2023-09-10T09:22:40.486 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115430.log 2023-09-10T09:22:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183255.log 2023-09-10T09:22:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160727.log 2023-09-10T09:22:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242290.log 2023-09-10T09:22:40.487 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385180.log 2023-09-10T09:22:40.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369776.log 2023-09-10T09:22:40.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199914.log 2023-09-10T09:22:40.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403482.log 2023-09-10T09:22:40.488 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121490.log 2023-09-10T09:22:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494013.log 2023-09-10T09:22:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391875.log 2023-09-10T09:22:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357670.log 2023-09-10T09:22:40.489 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417872.log 2023-09-10T09:22:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390665.log 2023-09-10T09:22:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330292.log 2023-09-10T09:22:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37962.log 2023-09-10T09:22:40.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320297.log 2023-09-10T09:22:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339279.log 2023-09-10T09:22:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303855.log 2023-09-10T09:22:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483611.log 2023-09-10T09:22:40.491 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469488.log 2023-09-10T09:22:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368551.log 2023-09-10T09:22:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281656.log 2023-09-10T09:22:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352024.log 2023-09-10T09:22:40.492 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364940.log 2023-09-10T09:22:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243128.log 2023-09-10T09:22:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232797.log 2023-09-10T09:22:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2023-09-10T09:22:40.493 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221472.log 2023-09-10T09:22:40.494 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156168.log 2023-09-10T09:22:40.494 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204759.log 2023-09-10T09:22:40.494 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479771.log 2023-09-10T09:22:40.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131013.log 2023-09-10T09:22:40.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219869.log 2023-09-10T09:22:40.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381503.log 2023-09-10T09:22:40.495 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96258.log 2023-09-10T09:22:40.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93806.log 2023-09-10T09:22:40.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2023-09-10T09:22:40.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482270.log 2023-09-10T09:22:40.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203153.log 2023-09-10T09:22:40.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216616.log 2023-09-10T09:22:40.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388233.log 2023-09-10T09:22:40.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313819.log 2023-09-10T09:22:40.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183246.log 2023-09-10T09:22:40.498 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306319.log 2023-09-10T09:22:40.498 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167148.log 2023-09-10T09:22:40.498 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234815.log 2023-09-10T09:22:40.498 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174334.log 2023-09-10T09:22:40.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122707.log 2023-09-10T09:22:40.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288148.log 2023-09-10T09:22:40.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345372.log 2023-09-10T09:22:40.499 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156177.log 2023-09-10T09:22:40.500 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219475.log 2023-09-10T09:22:40.500 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466284.log 2023-09-10T09:22:40.500 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177511.log 2023-09-10T09:22:40.500 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310379.log 2023-09-10T09:22:40.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235256.log 2023-09-10T09:22:40.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2023-09-10T09:22:40.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495264.log 2023-09-10T09:22:40.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2023-09-10T09:22:40.501 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422325.log 2023-09-10T09:22:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386979.log 2023-09-10T09:22:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113763.log 2023-09-10T09:22:40.502 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295005.log 2023-09-10T09:22:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499563.log 2023-09-10T09:22:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478463.log 2023-09-10T09:22:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465895.log 2023-09-10T09:22:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246110.log 2023-09-10T09:22:40.503 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223886.log 2023-09-10T09:22:40.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133150.log 2023-09-10T09:22:40.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340067.log 2023-09-10T09:22:40.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190688.log 2023-09-10T09:22:40.504 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181573.log 2023-09-10T09:22:40.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2023-09-10T09:22:40.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152312.log 2023-09-10T09:22:40.505 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491899.log 2023-09-10T09:22:40.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153652.log 2023-09-10T09:22:40.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197906.log 2023-09-10T09:22:40.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411250.log 2023-09-10T09:22:40.506 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367346.log 2023-09-10T09:22:40.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407606.log 2023-09-10T09:22:40.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197499.log 2023-09-10T09:22:40.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399516.log 2023-09-10T09:22:40.507 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485628.log 2023-09-10T09:22:40.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424951.log 2023-09-10T09:22:40.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384779.log 2023-09-10T09:22:40.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85648.log 2023-09-10T09:22:40.508 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345767.log 2023-09-10T09:22:40.509 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2023-09-10T09:22:40.509 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404378.log 2023-09-10T09:22:40.509 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270719.log 2023-09-10T09:22:40.509 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394845.log 2023-09-10T09:22:40.510 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241897.log 2023-09-10T09:22:40.510 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218664.log 2023-09-10T09:22:40.510 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354851.log 2023-09-10T09:22:40.510 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368144.log 2023-09-10T09:22:40.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157428.log 2023-09-10T09:22:40.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234824.log 2023-09-10T09:22:40.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371417.log 2023-09-10T09:22:40.511 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342880.log 2023-09-10T09:22:40.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110904.log 2023-09-10T09:22:40.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369349.log 2023-09-10T09:22:40.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356459.log 2023-09-10T09:22:40.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365343.log 2023-09-10T09:22:40.512 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2023-09-10T09:22:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47083.log 2023-09-10T09:22:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176715.log 2023-09-10T09:22:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475102.log 2023-09-10T09:22:40.513 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471867.log 2023-09-10T09:22:40.514 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2023-09-10T09:22:40.514 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279528.log 2023-09-10T09:22:40.514 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215595.log 2023-09-10T09:22:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132761.log 2023-09-10T09:22:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313828.log 2023-09-10T09:22:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83457.log 2023-09-10T09:22:40.515 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489796.log 2023-09-10T09:22:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2023-09-10T09:22:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299512.log 2023-09-10T09:22:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340907.log 2023-09-10T09:22:40.516 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318430.log 2023-09-10T09:22:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318874.log 2023-09-10T09:22:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296200.log 2023-09-10T09:22:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84388.log 2023-09-10T09:22:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290534.log 2023-09-10T09:22:40.517 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186880.log 2023-09-10T09:22:40.518 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368542.log 2023-09-10T09:22:40.518 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202763.log 2023-09-10T09:22:40.518 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188256.log 2023-09-10T09:22:40.518 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192697.log 2023-09-10T09:22:40.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97917.log 2023-09-10T09:22:40.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156997.log 2023-09-10T09:22:40.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499355.log 2023-09-10T09:22:40.519 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331965.log 2023-09-10T09:22:40.520 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307172.log 2023-09-10T09:22:40.520 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370983.log 2023-09-10T09:22:40.520 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276321.log 2023-09-10T09:22:40.520 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357258.log 2023-09-10T09:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100778.log 2023-09-10T09:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307984.log 2023-09-10T09:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-09-10T09:22:40.521 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498920.log 2023-09-10T09:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221875.log 2023-09-10T09:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368955.log 2023-09-10T09:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485229.log 2023-09-10T09:22:40.522 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198296.log 2023-09-10T09:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383151.log 2023-09-10T09:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236054.log 2023-09-10T09:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231601.log 2023-09-10T09:22:40.523 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167575.log 2023-09-10T09:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287742.log 2023-09-10T09:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185672.log 2023-09-10T09:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48089.log 2023-09-10T09:22:40.524 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317035.log 2023-09-10T09:22:40.525 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175530.log 2023-09-10T09:22:40.525 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286948.log 2023-09-10T09:22:40.525 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2023-09-10T09:22:40.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299503.log 2023-09-10T09:22:40.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420279.log 2023-09-10T09:22:40.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398579.log 2023-09-10T09:22:40.526 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219878.log 2023-09-10T09:22:40.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220281.log 2023-09-10T09:22:40.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310787.log 2023-09-10T09:22:40.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105171.log 2023-09-10T09:22:40.527 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182426.log 2023-09-10T09:22:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2023-09-10T09:22:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234396.log 2023-09-10T09:22:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38169.log 2023-09-10T09:22:40.528 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46095.log 2023-09-10T09:22:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424960.log 2023-09-10T09:22:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472265.log 2023-09-10T09:22:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83942.log 2023-09-10T09:22:40.529 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290136.log 2023-09-10T09:22:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2023-09-10T09:22:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498641.log 2023-09-10T09:22:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113754.log 2023-09-10T09:22:40.530 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355249.log 2023-09-10T09:22:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471469.log 2023-09-10T09:22:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84823.log 2023-09-10T09:22:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362121.log 2023-09-10T09:22:40.531 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94702.log 2023-09-10T09:22:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293002.log 2023-09-10T09:22:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47592.log 2023-09-10T09:22:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320306.log 2023-09-10T09:22:40.532 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493583.log 2023-09-10T09:22:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280838.log 2023-09-10T09:22:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103570.log 2023-09-10T09:22:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394037.log 2023-09-10T09:22:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403923.log 2023-09-10T09:22:40.533 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418270.log 2023-09-10T09:22:40.534 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303059.log 2023-09-10T09:22:40.534 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335348.log 2023-09-10T09:22:40.534 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191095.log 2023-09-10T09:22:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499043.log 2023-09-10T09:22:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472274.log 2023-09-10T09:22:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182848.log 2023-09-10T09:22:40.535 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305495.log 2023-09-10T09:22:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112144.log 2023-09-10T09:22:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406103.log 2023-09-10T09:22:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95858.log 2023-09-10T09:22:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360515.log 2023-09-10T09:22:40.536 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178718.log 2023-09-10T09:22:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222287.log 2023-09-10T09:22:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216625.log 2023-09-10T09:22:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121091.log 2023-09-10T09:22:40.537 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479339.log 2023-09-10T09:22:40.538 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100337.log 2023-09-10T09:22:40.538 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498946.log 2023-09-10T09:22:40.538 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213532.log 2023-09-10T09:22:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296602.log 2023-09-10T09:22:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314691.log 2023-09-10T09:22:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410454.log 2023-09-10T09:22:40.539 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204750.log 2023-09-10T09:22:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400908.log 2023-09-10T09:22:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350379.log 2023-09-10T09:22:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404849.log 2023-09-10T09:22:40.540 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297004.log 2023-09-10T09:22:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308373.log 2023-09-10T09:22:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221083.log 2023-09-10T09:22:40.541 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199525.log 2023-09-10T09:22:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45193.log 2023-09-10T09:22:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346565.log 2023-09-10T09:22:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229213.log 2023-09-10T09:22:40.542 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150251.log 2023-09-10T09:22:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222686.log 2023-09-10T09:22:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315566.log 2023-09-10T09:22:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46693.log 2023-09-10T09:22:40.543 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422732.log 2023-09-10T09:22:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412493.log 2023-09-10T09:22:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312555.log 2023-09-10T09:22:40.544 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491487.log 2023-09-10T09:22:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398178.log 2023-09-10T09:22:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416664.log 2023-09-10T09:22:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108759.log 2023-09-10T09:22:40.545 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193128.log 2023-09-10T09:22:40.546 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368946.log 2023-09-10T09:22:40.546 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159288.log 2023-09-10T09:22:40.546 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124747.log 2023-09-10T09:22:40.546 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48037.log 2023-09-10T09:22:40.547 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218673.log 2023-09-10T09:22:40.547 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48276.log 2023-09-10T09:22:40.547 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402283.log 2023-09-10T09:22:40.547 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279940.log 2023-09-10T09:22:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107555.log 2023-09-10T09:22:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104773.log 2023-09-10T09:22:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465497.log 2023-09-10T09:22:40.548 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47906.log 2023-09-10T09:22:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83933.log 2023-09-10T09:22:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364931.log 2023-09-10T09:22:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230398.log 2023-09-10T09:22:40.549 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318439.log 2023-09-10T09:22:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425747.log 2023-09-10T09:22:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160718.log 2023-09-10T09:22:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209910.log 2023-09-10T09:22:40.550 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416201.log 2023-09-10T09:22:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341305.log 2023-09-10T09:22:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486480.log 2023-09-10T09:22:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342389.log 2023-09-10T09:22:40.551 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151071.log 2023-09-10T09:22:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396888.log 2023-09-10T09:22:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488952.log 2023-09-10T09:22:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2023-09-10T09:22:40.552 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2023-09-10T09:22:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411259.log 2023-09-10T09:22:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130514.log 2023-09-10T09:22:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161962.log 2023-09-10T09:22:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2023-09-10T09:22:40.553 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394444.log 2023-09-10T09:22:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330301.log 2023-09-10T09:22:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476758.log 2023-09-10T09:22:40.554 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230805.log 2023-09-10T09:22:40.555 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174732.log 2023-09-10T09:22:40.555 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244909.log 2023-09-10T09:22:40.555 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471876.log 2023-09-10T09:22:40.555 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469877.log 2023-09-10T09:22:40.556 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315113.log 2023-09-10T09:22:40.556 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369358.log 2023-09-10T09:22:40.556 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271526.log 2023-09-10T09:22:40.556 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215604.log 2023-09-10T09:22:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-10T09:22:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337220.log 2023-09-10T09:22:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423693.log 2023-09-10T09:22:40.557 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206953.log 2023-09-10T09:22:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123130.log 2023-09-10T09:22:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343287.log 2023-09-10T09:22:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99507.log 2023-09-10T09:22:40.558 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45826.log 2023-09-10T09:22:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2023-09-10T09:22:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124340.log 2023-09-10T09:22:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150663.log 2023-09-10T09:22:40.559 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279931.log 2023-09-10T09:22:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486082.log 2023-09-10T09:22:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2023-09-10T09:22:40.560 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49977.log 2023-09-10T09:22:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44056.log 2023-09-10T09:22:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190697.log 2023-09-10T09:22:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307578.log 2023-09-10T09:22:40.561 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499537.log 2023-09-10T09:22:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206962.log 2023-09-10T09:22:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305075.log 2023-09-10T09:22:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417473.log 2023-09-10T09:22:40.562 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213926.log 2023-09-10T09:22:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102371.log 2023-09-10T09:22:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499613.log 2023-09-10T09:22:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201506.log 2023-09-10T09:22:40.563 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392790.log 2023-09-10T09:22:40.564 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488133.log 2023-09-10T09:22:40.564 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164615.log 2023-09-10T09:22:40.564 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48011.log 2023-09-10T09:22:40.564 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226703.log 2023-09-10T09:22:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424150.log 2023-09-10T09:22:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368153.log 2023-09-10T09:22:40.565 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114161.log 2023-09-10T09:22:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490646.log 2023-09-10T09:22:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187858.log 2023-09-10T09:22:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45982.log 2023-09-10T09:22:40.566 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273917.log 2023-09-10T09:22:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112135.log 2023-09-10T09:22:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284967.log 2023-09-10T09:22:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358478.log 2023-09-10T09:22:40.567 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2023-09-10T09:22:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406112.log 2023-09-10T09:22:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491058.log 2023-09-10T09:22:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468287.log 2023-09-10T09:22:40.568 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371822.log 2023-09-10T09:22:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468676.log 2023-09-10T09:22:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390674.log 2023-09-10T09:22:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158767.log 2023-09-10T09:22:40.569 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49095.log 2023-09-10T09:22:40.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317026.log 2023-09-10T09:22:40.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2023-09-10T09:22:40.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196270.log 2023-09-10T09:22:40.570 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49629.log 2023-09-10T09:22:40.571 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47351.log 2023-09-10T09:22:40.573 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37975.log 2023-09-10T09:22:40.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403914.log 2023-09-10T09:22:40.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184876.log 2023-09-10T09:22:40.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223877.log 2023-09-10T09:22:40.574 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419873.log 2023-09-10T09:22:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297013.log 2023-09-10T09:22:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499121.log 2023-09-10T09:22:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38118.log 2023-09-10T09:22:40.575 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217413.log 2023-09-10T09:22:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168856.log 2023-09-10T09:22:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227092.log 2023-09-10T09:22:40.576 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156566.log 2023-09-10T09:22:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2023-09-10T09:22:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2023-09-10T09:22:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181999.log 2023-09-10T09:22:40.577 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293401.log 2023-09-10T09:22:40.578 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97508.log 2023-09-10T09:22:40.578 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187451.log 2023-09-10T09:22:40.578 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317509.log 2023-09-10T09:22:40.578 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111304.log 2023-09-10T09:22:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494422.log 2023-09-10T09:22:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317977.log 2023-09-10T09:22:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421531.log 2023-09-10T09:22:40.579 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38021.log 2023-09-10T09:22:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230796.log 2023-09-10T09:22:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370974.log 2023-09-10T09:22:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400444.log 2023-09-10T09:22:40.580 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244075.log 2023-09-10T09:22:40.581 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498823.log 2023-09-10T09:22:40.582 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49069.log 2023-09-10T09:22:40.582 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101177.log 2023-09-10T09:22:40.582 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181146.log 2023-09-10T09:22:40.582 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85231.log 2023-09-10T09:22:40.583 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499381.log 2023-09-10T09:22:40.583 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89478.log 2023-09-10T09:22:40.583 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2023-09-10T09:22:40.583 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114152.log 2023-09-10T09:22:40.584 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474686.log 2023-09-10T09:22:40.584 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209051.log 2023-09-10T09:22:40.584 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493162.log 2023-09-10T09:22:40.584 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47057.log 2023-09-10T09:22:40.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219466.log 2023-09-10T09:22:40.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359296.log 2023-09-10T09:22:40.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288536.log 2023-09-10T09:22:40.585 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169283.log 2023-09-10T09:22:40.586 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473468.log 2023-09-10T09:22:40.586 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415398.log 2023-09-10T09:22:40.586 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2023-09-10T09:22:40.586 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482725.log 2023-09-10T09:22:40.587 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156575.log 2023-09-10T09:22:40.587 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304652.log 2023-09-10T09:22:40.587 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126486.log 2023-09-10T09:22:40.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292594.log 2023-09-10T09:22:40.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183684.log 2023-09-10T09:22:40.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387818.log 2023-09-10T09:22:40.588 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275130.log 2023-09-10T09:22:40.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106365.log 2023-09-10T09:22:40.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471071.log 2023-09-10T09:22:40.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473061.log 2023-09-10T09:22:40.589 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2023-09-10T09:22:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90284.log 2023-09-10T09:22:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383947.log 2023-09-10T09:22:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372836.log 2023-09-10T09:22:40.590 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202364.log 2023-09-10T09:22:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174723.log 2023-09-10T09:22:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499277.log 2023-09-10T09:22:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219062.log 2023-09-10T09:22:40.591 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301656.log 2023-09-10T09:22:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421937.log 2023-09-10T09:22:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299911.log 2023-09-10T09:22:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149448.log 2023-09-10T09:22:40.592 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246503.log 2023-09-10T09:22:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413397.log 2023-09-10T09:22:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197109.log 2023-09-10T09:22:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216197.log 2023-09-10T09:22:40.593 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400453.log 2023-09-10T09:22:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33087.log 2023-09-10T09:22:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231592.log 2023-09-10T09:22:40.594 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335339.log 2023-09-10T09:22:40.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423258.log 2023-09-10T09:22:40.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149054.log 2023-09-10T09:22:40.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292993.log 2023-09-10T09:22:40.595 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48198.log 2023-09-10T09:22:40.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213935.log 2023-09-10T09:22:40.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302587.log 2023-09-10T09:22:40.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339677.log 2023-09-10T09:22:40.596 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472672.log 2023-09-10T09:22:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89087.log 2023-09-10T09:22:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482986.log 2023-09-10T09:22:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284535.log 2023-09-10T09:22:40.597 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309185.log 2023-09-10T09:22:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361718.log 2023-09-10T09:22:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417074.log 2023-09-10T09:22:40.598 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90275.log 2023-09-10T09:22:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408395.log 2023-09-10T09:22:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207411.log 2023-09-10T09:22:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38147.log 2023-09-10T09:22:40.599 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132201.log 2023-09-10T09:22:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2023-09-10T09:22:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278333.log 2023-09-10T09:22:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203951.log 2023-09-10T09:22:40.600 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37986.log 2023-09-10T09:22:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2023-09-10T09:22:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396490.log 2023-09-10T09:22:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2023-09-10T09:22:40.601 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354860.log 2023-09-10T09:22:40.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346779.log 2023-09-10T09:22:40.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348357.log 2023-09-10T09:22:40.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2023-09-10T09:22:40.602 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149457.log 2023-09-10T09:22:40.603 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410861.log 2023-09-10T09:22:40.603 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45384.log 2023-09-10T09:22:40.603 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276330.log 2023-09-10T09:22:40.603 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2023-09-10T09:22:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282054.log 2023-09-10T09:22:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426953.log 2023-09-10T09:22:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209060.log 2023-09-10T09:22:40.604 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2023-09-10T09:22:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499433.log 2023-09-10T09:22:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275520.log 2023-09-10T09:22:40.605 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499407.log 2023-09-10T09:22:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498745.log 2023-09-10T09:22:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149855.log 2023-09-10T09:22:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2023-09-10T09:22:40.606 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470673.log 2023-09-10T09:22:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169710.log 2023-09-10T09:22:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203162.log 2023-09-10T09:22:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395685.log 2023-09-10T09:22:40.607 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-10T09:22:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108768.log 2023-09-10T09:22:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486489.log 2023-09-10T09:22:40.608 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214724.log 2023-09-10T09:22:40.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336434.log 2023-09-10T09:22:40.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223474.log 2023-09-10T09:22:40.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201108.log 2023-09-10T09:22:40.609 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2023-09-10T09:22:40.610 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233998.log 2023-09-10T09:22:40.610 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47748.log 2023-09-10T09:22:40.610 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175132.log 2023-09-10T09:22:40.610 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188654.log 2023-09-10T09:22:40.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397748.log 2023-09-10T09:22:40.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340916.log 2023-09-10T09:22:40.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49367.log 2023-09-10T09:22:40.611 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226300.log 2023-09-10T09:22:40.612 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311240.log 2023-09-10T09:22:40.612 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474285.log 2023-09-10T09:22:40.612 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223076.log 2023-09-10T09:22:40.612 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170563.log 2023-09-10T09:22:40.613 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99900.log 2023-09-10T09:22:40.613 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498894.log 2023-09-10T09:22:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395287.log 2023-09-10T09:22:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121895.log 2023-09-10T09:22:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465886.log 2023-09-10T09:22:40.614 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273130.log 2023-09-10T09:22:40.615 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311249.log 2023-09-10T09:22:40.615 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399042.log 2023-09-10T09:22:40.615 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126053.log 2023-09-10T09:22:40.615 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358064.log 2023-09-10T09:22:40.616 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151468.log 2023-09-10T09:22:40.616 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392394.log 2023-09-10T09:22:40.616 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125596.log 2023-09-10T09:22:40.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344140.log 2023-09-10T09:22:40.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189043.log 2023-09-10T09:22:40.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2023-09-10T09:22:40.617 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236870.log 2023-09-10T09:22:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489374.log 2023-09-10T09:22:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499017.log 2023-09-10T09:22:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301203.log 2023-09-10T09:22:40.618 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216188.log 2023-09-10T09:22:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396879.log 2023-09-10T09:22:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233193.log 2023-09-10T09:22:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129187.log 2023-09-10T09:22:40.619 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177113.log 2023-09-10T09:22:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2023-09-10T09:22:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188645.log 2023-09-10T09:22:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428207.log 2023-09-10T09:22:40.620 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44862.log 2023-09-10T09:22:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199127.log 2023-09-10T09:22:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2023-09-10T09:22:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479780.log 2023-09-10T09:22:40.621 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199118.log 2023-09-10T09:22:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112538.log 2023-09-10T09:22:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2023-09-10T09:22:40.622 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487304.log 2023-09-10T09:22:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212729.log 2023-09-10T09:22:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2023-09-10T09:22:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220272.log 2023-09-10T09:22:40.623 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492329.log 2023-09-10T09:22:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313013.log 2023-09-10T09:22:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401865.log 2023-09-10T09:22:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104375.log 2023-09-10T09:22:40.624 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318883.log 2023-09-10T09:22:40.625 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362510.log 2023-09-10T09:22:40.625 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344965.log 2023-09-10T09:22:40.625 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175123.log 2023-09-10T09:22:40.625 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426547.log 2023-09-10T09:22:40.626 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181137.log 2023-09-10T09:22:40.626 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205609.log 2023-09-10T09:22:40.626 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392385.log 2023-09-10T09:22:40.627 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224285.log 2023-09-10T09:22:40.627 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310778.log 2023-09-10T09:22:40.627 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469886.log 2023-09-10T09:22:40.627 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283340.log 2023-09-10T09:22:40.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2023-09-10T09:22:40.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124738.log 2023-09-10T09:22:40.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97083.log 2023-09-10T09:22:40.628 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384770.log 2023-09-10T09:22:40.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86952.log 2023-09-10T09:22:40.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226694.log 2023-09-10T09:22:40.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333243.log 2023-09-10T09:22:40.629 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193590.log 2023-09-10T09:22:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308382.log 2023-09-10T09:22:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305486.log 2023-09-10T09:22:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194018.log 2023-09-10T09:22:40.630 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87767.log 2023-09-10T09:22:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236444.log 2023-09-10T09:22:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45878.log 2023-09-10T09:22:40.631 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236453.log 2023-09-10T09:22:40.632 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272727.log 2023-09-10T09:22:40.632 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186871.log 2023-09-10T09:22:40.632 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381946.log 2023-09-10T09:22:40.632 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499303.log 2023-09-10T09:22:40.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401315.log 2023-09-10T09:22:40.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389063.log 2023-09-10T09:22:40.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226291.log 2023-09-10T09:22:40.633 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211874.log 2023-09-10T09:22:40.634 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133159.log 2023-09-10T09:22:40.634 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389466.log 2023-09-10T09:22:40.634 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44623.log 2023-09-10T09:22:40.634 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208650.log 2023-09-10T09:22:40.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105958.log 2023-09-10T09:22:40.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399989.log 2023-09-10T09:22:40.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224276.log 2023-09-10T09:22:40.635 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276727.log 2023-09-10T09:22:40.636 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2023-09-10T09:22:40.636 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130091.log 2023-09-10T09:22:40.636 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406636.log 2023-09-10T09:22:40.636 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470284.log 2023-09-10T09:22:40.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481051.log 2023-09-10T09:22:40.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49225.log 2023-09-10T09:22:40.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312159.log 2023-09-10T09:22:40.637 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194448.log 2023-09-10T09:22:40.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103172.log 2023-09-10T09:22:40.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106755.log 2023-09-10T09:22:40.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208659.log 2023-09-10T09:22:40.638 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114613.log 2023-09-10T09:22:40.639 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166287.log 2023-09-10T09:22:40.639 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497424.log 2023-09-10T09:22:40.639 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126477.log 2023-09-10T09:22:40.640 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360909.log 2023-09-10T09:22:40.640 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37935.log 2023-09-10T09:22:40.640 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167566.log 2023-09-10T09:22:40.640 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360506.log 2023-09-10T09:22:40.641 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272319.log 2023-09-10T09:22:40.641 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354453.log 2023-09-10T09:22:40.641 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2023-09-10T09:22:40.641 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338467.log 2023-09-10T09:22:40.642 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330706.log 2023-09-10T09:22:40.642 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2023-09-10T09:22:40.642 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97092.log 2023-09-10T09:22:40.642 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291748.log 2023-09-10T09:22:40.643 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391462.log 2023-09-10T09:22:40.643 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418261.log 2023-09-10T09:22:40.643 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273926.log 2023-09-10T09:22:40.643 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488124.log 2023-09-10T09:22:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192299.log 2023-09-10T09:22:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166713.log 2023-09-10T09:22:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313429.log 2023-09-10T09:22:40.644 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288942.log 2023-09-10T09:22:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150654.log 2023-09-10T09:22:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173534.log 2023-09-10T09:22:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358907.log 2023-09-10T09:22:40.645 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304643.log 2023-09-10T09:22:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482995.log 2023-09-10T09:22:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465089.log 2023-09-10T09:22:40.646 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202754.log 2023-09-10T09:22:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132504.log 2023-09-10T09:22:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480643.log 2023-09-10T09:22:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414589.log 2023-09-10T09:22:40.647 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353255.log 2023-09-10T09:22:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194886.log 2023-09-10T09:22:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189892.log 2023-09-10T09:22:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285765.log 2023-09-10T09:22:40.648 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410065.log 2023-09-10T09:22:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309574.log 2023-09-10T09:22:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496547.log 2023-09-10T09:22:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409667.log 2023-09-10T09:22:40.649 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48692.log 2023-09-10T09:22:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476767.log 2023-09-10T09:22:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224679.log 2023-09-10T09:22:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336831.log 2023-09-10T09:22:40.650 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296191.log 2023-09-10T09:22:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349566.log 2023-09-10T09:22:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362917.log 2023-09-10T09:22:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352431.log 2023-09-10T09:22:40.651 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473070.log 2023-09-10T09:22:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44158.log 2023-09-10T09:22:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108365.log 2023-09-10T09:22:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244501.log 2023-09-10T09:22:40.652 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349154.log 2023-09-10T09:22:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498589.log 2023-09-10T09:22:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2023-09-10T09:22:40.653 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289331.log 2023-09-10T09:22:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2023-09-10T09:22:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397341.log 2023-09-10T09:22:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466293.log 2023-09-10T09:22:40.654 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165462.log 2023-09-10T09:22:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481454.log 2023-09-10T09:22:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2023-09-10T09:22:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300731.log 2023-09-10T09:22:40.655 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214733.log 2023-09-10T09:22:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49281.log 2023-09-10T09:22:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404387.log 2023-09-10T09:22:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349985.log 2023-09-10T09:22:40.656 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157894.log 2023-09-10T09:22:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103977.log 2023-09-10T09:22:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188247.log 2023-09-10T09:22:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408404.log 2023-09-10T09:22:40.657 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169274.log 2023-09-10T09:22:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86047.log 2023-09-10T09:22:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149045.log 2023-09-10T09:22:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353657.log 2023-09-10T09:22:40.658 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49423.log 2023-09-10T09:22:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243588.log 2023-09-10T09:22:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44983.log 2023-09-10T09:22:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386970.log 2023-09-10T09:22:40.659 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282933.log 2023-09-10T09:22:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82054.log 2023-09-10T09:22:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351621.log 2023-09-10T09:22:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197100.log 2023-09-10T09:22:40.660 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311688.log 2023-09-10T09:22:40.726 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163751.log 2023-09-10T09:22:40.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494843.log 2023-09-10T09:22:40.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278324.log 2023-09-10T09:22:40.727 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427788.log 2023-09-10T09:22:40.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481463.log 2023-09-10T09:22:40.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195306.log 2023-09-10T09:22:40.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231203.log 2023-09-10T09:22:40.728 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294605.log 2023-09-10T09:22:40.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197897.log 2023-09-10T09:22:40.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2023-09-10T09:22:40.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228019.log 2023-09-10T09:22:40.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177520.log 2023-09-10T09:22:40.729 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213132.log 2023-09-10T09:22:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172691.log 2023-09-10T09:22:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179509.log 2023-09-10T09:22:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218218.log 2023-09-10T09:22:40.730 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387382.log 2023-09-10T09:22:40.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337643.log 2023-09-10T09:22:40.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2023-09-10T09:22:40.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280344.log 2023-09-10T09:22:40.731 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371813.log 2023-09-10T09:22:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179518.log 2023-09-10T09:22:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294596.log 2023-09-10T09:22:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364144.log 2023-09-10T09:22:40.732 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2023-09-10T09:22:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426147.log 2023-09-10T09:22:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361321.log 2023-09-10T09:22:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341991.log 2023-09-10T09:22:40.733 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157903.log 2023-09-10T09:22:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314293.log 2023-09-10T09:22:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277524.log 2023-09-10T09:22:40.734 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279118.log 2023-09-10T09:22:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489805.log 2023-09-10T09:22:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290937.log 2023-09-10T09:22:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338046.log 2023-09-10T09:22:40.735 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178309.log 2023-09-10T09:22:40.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490216.log 2023-09-10T09:22:40.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171835.log 2023-09-10T09:22:40.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305084.log 2023-09-10T09:22:40.736 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114622.log 2023-09-10T09:22:40.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499251.log 2023-09-10T09:22:40.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361312.log 2023-09-10T09:22:40.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345776.log 2023-09-10T09:22:40.737 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87560.log 2023-09-10T09:22:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356450.log 2023-09-10T09:22:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427375.log 2023-09-10T09:22:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46771.log 2023-09-10T09:22:40.738 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427384.log 2023-09-10T09:22:40.739 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396481.log 2023-09-10T09:22:40.739 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98315.log 2023-09-10T09:22:40.739 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333641.log 2023-09-10T09:22:40.739 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123544.log 2023-09-10T09:22:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426156.log 2023-09-10T09:22:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276718.log 2023-09-10T09:22:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370586.log 2023-09-10T09:22:40.740 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2023-09-10T09:22:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222278.log 2023-09-10T09:22:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490225.log 2023-09-10T09:22:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334867.log 2023-09-10T09:22:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499225.log 2023-09-10T09:22:40.741 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2023-09-10T09:22:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334040.log 2023-09-10T09:22:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478027.log 2023-09-10T09:22:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383540.log 2023-09-10T09:22:40.742 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159928.log 2023-09-10T09:22:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306757.log 2023-09-10T09:22:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2023-09-10T09:22:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109171.log 2023-09-10T09:22:40.743 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496097.log 2023-09-10T09:22:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82063.log 2023-09-10T09:22:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473459.log 2023-09-10T09:22:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220675.log 2023-09-10T09:22:40.744 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2023-09-10T09:22:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333650.log 2023-09-10T09:22:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299902.log 2023-09-10T09:22:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282942.log 2023-09-10T09:22:40.745 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48718.log 2023-09-10T09:22:40.746 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383938.log 2023-09-10T09:22:40.746 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305893.log 2023-09-10T09:22:40.746 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499199.log 2023-09-10T09:22:40.746 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477629.log 2023-09-10T09:22:40.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190290.log 2023-09-10T09:22:40.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245703.log 2023-09-10T09:22:40.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354055.log 2023-09-10T09:22:40.747 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172272.log 2023-09-10T09:22:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478018.log 2023-09-10T09:22:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209485.log 2023-09-10T09:22:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291739.log 2023-09-10T09:22:40.748 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400917.log 2023-09-10T09:22:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185265.log 2023-09-10T09:22:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200720.log 2023-09-10T09:22:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177122.log 2023-09-10T09:22:40.749 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214324.log 2023-09-10T09:22:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163327.log 2023-09-10T09:22:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131811.log 2023-09-10T09:22:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331974.log 2023-09-10T09:22:40.750 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498771.log 2023-09-10T09:22:40.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483208.log 2023-09-10T09:22:40.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382742.log 2023-09-10T09:22:40.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105569.log 2023-09-10T09:22:40.751 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310370.log 2023-09-10T09:22:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-10T09:22:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474276.log 2023-09-10T09:22:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348348.log 2023-09-10T09:22:40.752 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200711.log 2023-09-10T09:22:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172700.log 2023-09-10T09:22:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281267.log 2023-09-10T09:22:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496985.log 2023-09-10T09:22:40.753 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-09-10T09:22:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2023-09-10T09:22:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2023-09-10T09:22:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234387.log 2023-09-10T09:22:40.754 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212289.log 2023-09-10T09:22:40.755 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398570.log 2023-09-10T09:22:40.755 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342000.log 2023-09-10T09:22:40.755 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243137.log 2023-09-10T09:22:40.755 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290946.log 2023-09-10T09:22:40.756 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203561.log 2023-09-10T09:22:40.756 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176724.log 2023-09-10T09:22:40.756 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123139.log 2023-09-10T09:22:40.756 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225485.log 2023-09-10T09:22:40.757 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246512.log 2023-09-10T09:22:40.757 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277936.log 2023-09-10T09:22:40.757 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292603.log 2023-09-10T09:22:40.757 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356047.log 2023-09-10T09:22:40.758 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465488.log 2023-09-10T09:22:40.758 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-10T09:22:40.758 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121886.log 2023-09-10T09:22:40.758 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227101.log 2023-09-10T09:22:40.759 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390276.log 2023-09-10T09:22:40.759 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467080.log 2023-09-10T09:22:40.759 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225888.log 2023-09-10T09:22:40.759 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180307.log 2023-09-10T09:22:40.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497853.log 2023-09-10T09:22:40.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47854.log 2023-09-10T09:22:40.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334477.log 2023-09-10T09:22:40.760 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490637.log 2023-09-10T09:22:40.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308787.log 2023-09-10T09:22:40.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148249.log 2023-09-10T09:22:40.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85639.log 2023-09-10T09:22:40.761 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45411.log 2023-09-10T09:22:40.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403491.log 2023-09-10T09:22:40.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183675.log 2023-09-10T09:22:40.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416673.log 2023-09-10T09:22:40.762 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407996.log 2023-09-10T09:22:40.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232389.log 2023-09-10T09:22:40.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115020.log 2023-09-10T09:22:40.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159279.log 2023-09-10T09:22:40.763 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196701.log 2023-09-10T09:22:40.764 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244900.log 2023-09-10T09:22:40.764 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487701.log 2023-09-10T09:22:40.764 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164606.log 2023-09-10T09:22:40.764 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242299.log 2023-09-10T09:22:40.765 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162917.log 2023-09-10T09:22:40.765 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417863.log 2023-09-10T09:22:40.765 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187849.log 2023-09-10T09:22:40.765 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131802.log 2023-09-10T09:22:40.766 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108356.log 2023-09-10T09:22:40.766 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88626.log 2023-09-10T09:22:40.766 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492750.log 2023-09-10T09:22:40.766 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269919.log 2023-09-10T09:22:40.767 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280829.log 2023-09-10T09:22:40.767 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344539.log 2023-09-10T09:22:40.767 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483199.log 2023-09-10T09:22:40.767 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212720.log 2023-09-10T09:22:40.768 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336822.log 2023-09-10T09:22:40.768 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166722.log 2023-09-10T09:22:40.768 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148258.log 2023-09-10T09:22:40.768 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245308.log 2023-09-10T09:22:40.769 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419065.log 2023-09-10T09:22:40.769 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113352.log 2023-09-10T09:22:40.769 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367755.log 2023-09-10T09:22:40.769 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338874.log 2023-09-10T09:22:40.770 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389869.log 2023-09-10T09:22:40.770 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414193.log 2023-09-10T09:22:40.770 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179109.log 2023-09-10T09:22:40.770 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304254.log 2023-09-10T09:22:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342398.log 2023-09-10T09:22:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423684.log 2023-09-10T09:22:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348760.log 2023-09-10T09:22:40.771 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388242.log 2023-09-10T09:22:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122698.log 2023-09-10T09:22:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499173.log 2023-09-10T09:22:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343278.log 2023-09-10T09:22:40.772 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425358.log 2023-09-10T09:22:40.773 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426944.log 2023-09-10T09:22:40.773 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333252.log 2023-09-10T09:22:40.773 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44545.log 2023-09-10T09:22:40.773 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49147.log 2023-09-10T09:22:40.774 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393188.log 2023-09-10T09:22:40.774 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308778.log 2023-09-10T09:22:40.774 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168419.log 2023-09-10T09:22:40.774 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45410.log 2023-09-10T09:22:40.775 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194877.log 2023-09-10T09:22:40.775 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217023.log 2023-09-10T09:22:40.775 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48640.log 2023-09-10T09:22:40.775 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233600.log 2023-09-10T09:22:40.776 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312150.log 2023-09-10T09:22:40.776 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47774.log 2023-09-10T09:22:40.776 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83047.log 2023-09-10T09:22:40.776 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101575.log 2023-09-10T09:22:40.777 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339668.log 2023-09-10T09:22:40.777 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230009.log 2023-09-10T09:22:40.777 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206016.log 2023-09-10T09:22:40.777 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49449.log 2023-09-10T09:22:40.778 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123535.log 2023-09-10T09:22:40.778 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155750.log 2023-09-10T09:22:40.778 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217811.log 2023-09-10T09:22:40.778 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86038.log 2023-09-10T09:22:40.779 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288545.log 2023-09-10T09:22:40.779 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181990.log 2023-09-10T09:22:40.779 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93797.log 2023-09-10T09:22:40.779 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382353.log 2023-09-10T09:22:40.780 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406627.log 2023-09-10T09:22:40.780 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199516.log 2023-09-10T09:22:40.780 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284137.log 2023-09-10T09:22:40.781 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131413.log 2023-09-10T09:22:40.781 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350388.log 2023-09-10T09:22:40.781 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346469.log 2023-09-10T09:22:40.781 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352422.log 2023-09-10T09:22:40.782 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167139.log 2023-09-10T09:22:40.782 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131404.log 2023-09-10T09:22:40.782 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107156.log 2023-09-10T09:22:40.782 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228417.log 2023-09-10T09:22:40.783 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170554.log 2023-09-10T09:22:40.783 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466691.log 2023-09-10T09:22:40.783 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309981.log 2023-09-10T09:22:40.783 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300310.log 2023-09-10T09:22:40.784 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202355.log 2023-09-10T09:22:40.784 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346174.log 2023-09-10T09:22:40.784 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384350.log 2023-09-10T09:22:40.784 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99101.log 2023-09-10T09:22:40.785 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110016.log 2023-09-10T09:22:40.785 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284128.log 2023-09-10T09:22:40.785 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37999.log 2023-09-10T09:22:40.785 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289340.log 2023-09-10T09:22:40.786 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207863.log 2023-09-10T09:22:40.786 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2023-09-10T09:22:40.786 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274324.log 2023-09-10T09:22:40.786 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481856.log 2023-09-10T09:22:40.787 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388672.log 2023-09-10T09:22:40.787 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495255.log 2023-09-10T09:22:40.787 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103968.log 2023-09-10T09:22:40.787 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418660.log 2023-09-10T09:22:40.788 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292201.log 2023-09-10T09:22:40.788 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279127.log 2023-09-10T09:22:40.788 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353264.log 2023-09-10T09:22:40.788 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388663.log 2023-09-10T09:22:40.789 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412935.log 2023-09-10T09:22:40.789 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471478.log 2023-09-10T09:22:40.789 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47932.log 2023-09-10T09:22:40.789 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421092.log 2023-09-10T09:22:40.790 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44597.log 2023-09-10T09:22:40.790 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359305.log 2023-09-10T09:22:40.790 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173927.log 2023-09-10T09:22:40.791 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191086.log 2023-09-10T09:22:40.791 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158298.log 2023-09-10T09:22:40.791 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373632.log 2023-09-10T09:22:40.791 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300740.log 2023-09-10T09:22:40.792 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412502.log 2023-09-10T09:22:40.792 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101566.log 2023-09-10T09:22:40.792 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2023-09-10T09:22:40.792 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160318.log 2023-09-10T09:22:40.793 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220684.log 2023-09-10T09:22:40.793 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476369.log 2023-09-10T09:22:40.793 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150260.log 2023-09-10T09:22:40.793 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474695.log 2023-09-10T09:22:40.794 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424159.log 2023-09-10T09:22:40.794 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48841.log 2023-09-10T09:22:40.794 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43952.log 2023-09-10T09:22:40.794 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46667.log 2023-09-10T09:22:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307569.log 2023-09-10T09:22:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414999.log 2023-09-10T09:22:40.795 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356847.log 2023-09-10T09:22:40.796 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371692.log 2023-09-10T09:22:40.796 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499095.log 2023-09-10T09:22:40.796 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476360.log 2023-09-10T09:22:40.796 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129601.log 2023-09-10T09:22:40.797 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2023-09-10T09:22:40.797 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221481.log 2023-09-10T09:22:40.797 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231999.log 2023-09-10T09:22:40.797 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498797.log 2023-09-10T09:22:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180710.log 2023-09-10T09:22:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493171.log 2023-09-10T09:22:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307975.log 2023-09-10T09:22:40.798 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231990.log 2023-09-10T09:22:40.799 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154498.log 2023-09-10T09:22:40.799 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408859.log 2023-09-10T09:22:40.799 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38183.log 2023-09-10T09:22:40.799 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403092.log 2023-09-10T09:22:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44680.log 2023-09-10T09:22:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195770.log 2023-09-10T09:22:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277533.log 2023-09-10T09:22:40.800 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475555.log 2023-09-10T09:22:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170137.log 2023-09-10T09:22:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2023-09-10T09:22:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2023-09-10T09:22:40.801 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38192.log 2023-09-10T09:22:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168002.log 2023-09-10T09:22:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303846.log 2023-09-10T09:22:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425349.log 2023-09-10T09:22:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44706.log 2023-09-10T09:22:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396083.log 2023-09-10T09:22:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346516.log 2023-09-10T09:22:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302125.log 2023-09-10T09:22:40.803 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105162.log 2023-09-10T09:22:40.804 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176326.log 2023-09-10T09:22:40.804 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467490.log 2023-09-10T09:22:40.804 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107964.log 2023-09-10T09:22:40.804 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355648.log 2023-09-10T09:22:40.805 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129592.log 2023-09-10T09:22:40.805 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2023-09-10T09:22:40.805 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163760.log 2023-09-10T09:22:40.805 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173123.log 2023-09-10T09:22:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341314.log 2023-09-10T09:22:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109162.log 2023-09-10T09:22:40.806 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498849.log 2023-09-10T09:22:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2023-09-10T09:22:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381494.log 2023-09-10T09:22:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294996.log 2023-09-10T09:22:40.807 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161563.log 2023-09-10T09:22:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387373.log 2023-09-10T09:22:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2023-09-10T09:22:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2023-09-10T09:22:40.808 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46262.log 2023-09-10T09:22:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198695.log 2023-09-10T09:22:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196710.log 2023-09-10T09:22:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38111.log 2023-09-10T09:22:40.809 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126044.log 2023-09-10T09:22:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411705.log 2023-09-10T09:22:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271127.log 2023-09-10T09:22:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130523.log 2023-09-10T09:22:40.810 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170982.log 2023-09-10T09:22:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413388.log 2023-09-10T09:22:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38161.log 2023-09-10T09:22:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283730.log 2023-09-10T09:22:40.811 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245299.log 2023-09-10T09:22:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2023-09-10T09:22:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112951.log 2023-09-10T09:22:40.812 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2023-09-10T09:22:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295403.log 2023-09-10T09:22:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198305.log 2023-09-10T09:22:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306328.log 2023-09-10T09:22:40.813 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160327.log 2023-09-10T09:22:40.814 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227532.log 2023-09-10T09:22:40.814 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189494.log 2023-09-10T09:22:40.814 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408868.log 2023-09-10T09:22:40.814 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2023-09-10T09:22:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499069.log 2023-09-10T09:22:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385653.log 2023-09-10T09:22:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473866.log 2023-09-10T09:22:40.815 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94248.log 2023-09-10T09:22:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372442.log 2023-09-10T09:22:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112942.log 2023-09-10T09:22:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290127.log 2023-09-10T09:22:40.816 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424553.log 2023-09-10T09:22:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165034.log 2023-09-10T09:22:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244066.log 2023-09-10T09:22:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480652.log 2023-09-10T09:22:40.817 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315575.log 2023-09-10T09:22:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330697.log 2023-09-10T09:22:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165043.log 2023-09-10T09:22:40.818 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410056.log 2023-09-10T09:22:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286153.log 2023-09-10T09:22:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494413.log 2023-09-10T09:22:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395694.log 2023-09-10T09:22:40.819 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161953.log 2023-09-10T09:22:40.820 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168428.log 2023-09-10T09:22:40.820 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339270.log 2023-09-10T09:22:40.820 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389475.log 2023-09-10T09:22:40.820 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479348.log 2023-09-10T09:22:40.821 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401306.log 2023-09-10T09:22:40.821 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315104.log 2023-09-10T09:22:40.821 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486892.log 2023-09-10T09:22:40.821 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2023-09-10T09:22:40.822 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473857.log 2023-09-10T09:22:40.822 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361709.log 2023-09-10T09:22:40.822 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44654.log 2023-09-10T09:22:40.822 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391866.log 2023-09-10T09:22:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44281.log 2023-09-10T09:22:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48484.log 2023-09-10T09:22:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192290.log 2023-09-10T09:22:40.823 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343729.log 2023-09-10T09:22:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344530.log 2023-09-10T09:22:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184073.log 2023-09-10T09:22:40.824 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99498.log 2023-09-10T09:22:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346525.log 2023-09-10T09:22:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154925.log 2023-09-10T09:22:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349976.log 2023-09-10T09:22:40.825 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295394.log 2023-09-10T09:22:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102380.log 2023-09-10T09:22:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346478.log 2023-09-10T09:22:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305884.log 2023-09-10T09:22:40.826 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152783.log 2023-09-10T09:22:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273121.log 2023-09-10T09:22:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95441.log 2023-09-10T09:22:40.827 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271517.log 2023-09-10T09:22:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383142.log 2023-09-10T09:22:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296611.log 2023-09-10T09:22:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417464.log 2023-09-10T09:22:40.828 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157437.log 2023-09-10T09:22:40.829 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421540.log 2023-09-10T09:22:40.829 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43896.log 2023-09-10T09:22:40.829 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178709.log 2023-09-10T09:22:40.829 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352826.log 2023-09-10T09:22:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477620.log 2023-09-10T09:22:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355258.log 2023-09-10T09:22:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498563.log 2023-09-10T09:22:40.830 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228010.log 2023-09-10T09:22:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393595.log 2023-09-10T09:22:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86491.log 2023-09-10T09:22:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499147.log 2023-09-10T09:22:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2023-09-10T09:22:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230000.log 2023-09-10T09:22:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103579.log 2023-09-10T09:22:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467880.log 2023-09-10T09:22:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275923.log 2023-09-10T09:22:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484007.log 2023-09-10T09:22:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121082.log 2023-09-10T09:22:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393586.log 2023-09-10T09:22:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317968.log 2023-09-10T09:22:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89487.log 2023-09-10T09:22:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292192.log 2023-09-10T09:22:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2023-09-10T09:22:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196261.log 2023-09-10T09:22:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88635.log 2023-09-10T09:22:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372845.log 2023-09-10T09:22:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303050.log 2023-09-10T09:22:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215175.log 2023-09-10T09:22:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46426.log 2023-09-10T09:22:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382344.log 2023-09-10T09:22:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173525.log 2023-09-10T09:22:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47405.log 2023-09-10T09:22:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360103.log 2023-09-10T09:22:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467889.log 2023-09-10T09:22:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277121.log 2023-09-10T09:22:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2023-09-10T09:22:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207402.log 2023-09-10T09:22:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235646.log 2023-09-10T09:22:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366492.log 2023-09-10T09:22:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203960.log 2023-09-10T09:22:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338865.log 2023-09-10T09:22:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468685.log 2023-09-10T09:22:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317500.log 2023-09-10T09:22:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161554.log 2023-09-10T09:22:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185663.log 2023-09-10T09:22:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84832.log 2023-09-10T09:22:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399980.log 2023-09-10T09:22:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2023-09-10T09:22:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496106.log 2023-09-10T09:22:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2023-09-10T09:22:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350791.log 2023-09-10T09:22:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284526.log 2023-09-10T09:22:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356856.log 2023-09-10T09:22:40.842 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402274.log 2023-09-10T09:22:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364135.log 2023-09-10T09:22:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354462.log 2023-09-10T09:22:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2023-09-10T09:22:40.843 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301194.log 2023-09-10T09:22:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358898.log 2023-09-10T09:22:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152774.log 2023-09-10T09:22:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2023-09-10T09:22:40.844 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184479.log 2023-09-10T09:22:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421101.log 2023-09-10T09:22:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391073.log 2023-09-10T09:22:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278721.log 2023-09-10T09:22:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271916.log 2023-09-10T09:22:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191493.log 2023-09-10T09:22:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423936.log 2023-09-10T09:22:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394854.log 2023-09-10T09:22:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477222.log 2023-09-10T09:22:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246905.log 2023-09-10T09:22:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89886.log 2023-09-10T09:22:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212298.log 2023-09-10T09:22:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337652.log 2023-09-10T09:22:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286162.log 2023-09-10T09:22:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211865.log 2023-09-10T09:22:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389072.log 2023-09-10T09:22:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282451.log 2023-09-10T09:22:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407597.log 2023-09-10T09:22:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45198.log 2023-09-10T09:22:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370179.log 2023-09-10T09:22:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180316.log 2023-09-10T09:22:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2023-09-10T09:22:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184867.log 2023-09-10T09:22:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155315.log 2023-09-10T09:22:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316545.log 2023-09-10T09:22:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383549.log 2023-09-10T09:22:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217014.log 2023-09-10T09:22:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2023-09-10T09:22:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391471.log 2023-09-10T09:22:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111295.log 2023-09-10T09:22:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270326.log 2023-09-10T09:22:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480202.log 2023-09-10T09:22:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309972.log 2023-09-10T09:22:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278730.log 2023-09-10T09:22:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284958.log 2023-09-10T09:22:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109613.log 2023-09-10T09:22:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2023-09-10T09:22:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86943.log 2023-09-10T09:22:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104764.log 2023-09-10T09:22:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100346.log 2023-09-10T09:22:40.854 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468278.log 2023-09-10T09:22:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491067.log 2023-09-10T09:22:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494004.log 2023-09-10T09:22:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214333.log 2023-09-10T09:22:40.855 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358469.log 2023-09-10T09:22:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186070.log 2023-09-10T09:22:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204350.log 2023-09-10T09:22:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47431.log 2023-09-10T09:22:40.856 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221884.log 2023-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472663.log 2023-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390267.log 2023-09-10T09:22:40.857 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337229.log 2023-09-10T09:22:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46797.log 2023-09-10T09:22:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148656.log 2023-09-10T09:22:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311697.log 2023-09-10T09:22:40.858 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154489.log 2023-09-10T09:22:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363315.log 2023-09-10T09:22:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48510.log 2023-09-10T09:22:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242704.log 2023-09-10T09:22:40.859 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359695.log 2023-09-10T09:22:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87551.log 2023-09-10T09:22:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480211.log 2023-09-10T09:22:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274718.log 2023-09-10T09:22:40.860 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2023-09-10T09:22:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2023-09-10T09:22:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2023-09-10T09:22:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351630.log 2023-09-10T09:22:40.861 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281665.log 2023-09-10T09:22:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132752.log 2023-09-10T09:22:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132513.log 2023-09-10T09:22:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48063.log 2023-09-10T09:22:40.862 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178318.log 2023-09-10T09:22:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2023-09-10T09:22:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44981.log 2023-09-10T09:22:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336036.log 2023-09-10T09:22:40.863 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277927.log 2023-09-10T09:22:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225494.log 2023-09-10T09:22:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301665.log 2023-09-10T09:22:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110451.log 2023-09-10T09:22:40.864 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2023-09-10T09:22:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334468.log 2023-09-10T09:22:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366501.log 2023-09-10T09:22:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147846.log 2023-09-10T09:22:40.865 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230407.log 2023-09-10T09:22:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88235.log 2023-09-10T09:22:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47566.log 2023-09-10T09:22:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48536.log 2023-09-10T09:22:40.866 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420678.log 2023-09-10T09:22:40.867 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2023-09-10T09:22:40.867 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131004.log 2023-09-10T09:22:40.867 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101977.log 2023-09-10T09:22:40.867 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38153.log 2023-09-10T09:22:40.868 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98306.log 2023-09-10T09:22:40.868 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334876.log 2023-09-10T09:22:40.910 INFO:teuthology.orchestra.run.smithi100.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-10T09:22:41.374 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-09-10T09:22:41.400 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-09-10T09:22:42.218 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.372030.log.gz 2023-09-10T09:22:42.221 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.115430.log: /var/log/ceph/ceph-client.admin.418669.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.370188.log.gz 2023-09-10T09:22:42.221 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46485.log: /var/log/ceph/ceph-client.admin.155741.log: /var/log/ceph/ceph-client.admin.386581.log: /var/log/ceph/ceph-client.admin.188256.log: /var/log/ceph/ceph-client.admin.183255.log: /var/log/ceph/ceph-client.admin.419882.log: /var/log/ceph/ceph-client.admin.498719.log: /var/log/ceph/ceph-client.admin.469090.log: /var/log/ceph/ceph-client.admin.427779.log: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.111737.log.gz 2023-09-10T09:22:42.222 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.413795.log: /var/log/ceph/ceph-client.admin.421928.log: /var/log/ceph/ceph-client.admin.419469.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.113361.log.gz 2023-09-10T09:22:42.222 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.484016.log: /var/log/ceph/ceph-client.admin.498615.log: /var/log/ceph/ceph-client.admin.372039.log: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.275121.log.gz 2023-09-10T09:22:42.222 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498973.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.498719.log.gz 2023-09-10T09:22:42.223 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.275932.log.gz 2023-09-10T09:22:42.225 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.423945.log: /var/log/ceph/ceph-client.admin.382751.log: /var/log/ceph/ceph-osd.2.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.277130.log.gz 2023-09-10T09:22:42.226 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.385189.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.498615.log.gz 2023-09-10T09:22:42.226 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.498973.log.gz 2023-09-10T09:22:42.226 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.478454.log: /var/log/ceph/ceph-client.admin.354064.log: /var/log/ceph/ceph-client.admin.469479.log: /var/log/ceph/ceph-client.admin.404840.log: /var/log/ceph/ceph-client.admin.420270.log: 73.5% 71.3% -- replaced with /var/log/ceph/ceph-client.admin.316536.log.gz 2023-09-10T09:22:42.227 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.478454.log.gz 2023-09-10T09:22:42.227 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.409269.log: /var/log/ceph/ceph-client.admin.488522.log: /var/log/ceph/ceph-client.admin.482261.log: /var/log/ceph/ceph-client.admin.497844.log: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.488522.log.gz 2023-09-10T09:22:42.227 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.393197.log: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.482261.log.gz 2023-09-10T09:22:42.227 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.302596.log.gz 2023-09-10T09:22:42.228 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.497844.log.gz 2023-09-10T09:22:42.228 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.394028.log: /var/log/ceph/ceph-client.admin.496538.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.159919.log.gz 2023-09-10T09:22:42.228 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.419478.log: /var/log/ceph/ceph-client.admin.488531.log: /var/log/ceph/ceph-client.admin.407199.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.496538.log.gz 2023-09-10T09:22:42.228 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.494834.log: /var/log/ceph/ceph-client.admin.419074.log: /var/log/ceph/ceph-client.admin.471080.log: /var/log/ceph/ceph-client.admin.425756.log: /var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.415805.log: 74.1%/var/log/ceph/ceph-client.admin.360112.log: -- replaced with /var/log/ceph/ceph-client.admin.494834.log.gz 2023-09-10T09:22:42.229 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.491908.log: /var/log/ceph/ceph-client.admin.402677.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47377.log.gz 2023-09-10T09:22:42.229 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2023-09-10T09:22:42.229 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.484016.log.gz 2023-09-10T09:22:42.231 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2023-09-10T09:22:42.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498252.log: /var/log/ceph/ceph-client.admin.399033.log: /var/log/ceph/ceph-client.admin.491478.log: /var/log/ceph/ceph-client.admin.417065.log: 74.1% -- replaced with /var/log/ceph/ceph-client.admin.498252.log.gz 2023-09-10T09:22:42.231 INFO:teuthology.orchestra.run.smithi084.stderr: 67.5% -- replaced with /var/log/ceph/ceph-client.admin.491478.log.gz 2023-09-10T09:22:42.231 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.478917.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.360918.log.gz 2023-09-10T09:22:42.232 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.489383.log: /var/log/ceph/ceph-client.admin.385644.log: /var/log/ceph/ceph-client.admin.483602.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.363746.log.gz 2023-09-10T09:22:42.232 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7%/var/log/ceph/ceph-client.admin.465098.log: -- replaced with /var/log/ceph/ceph-client.admin.483602.log.gz 2023-09-10T09:22:42.232 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.372433.log: /var/log/ceph/ceph-client.admin.426556.log: /var/log/ceph/ceph-client.admin.470275.log: /var/log/ceph/ceph-client.admin.478908.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.399525.log.gz 2023-09-10T09:22:42.232 INFO:teuthology.orchestra.run.smithi084.stderr: 70.6% -- replaced with /var/log/ceph/ceph-client.admin.478908.log.gz 2023-09-10T09:22:42.233 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.492741.log: /var/log/ceph/ceph-client.admin.475546.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.492741.log.gz 2023-09-10T09:22:42.233 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.475546.log.gz 2023-09-10T09:22:42.234 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.484427.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.491908.log.gz 2023-09-10T09:22:42.235 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2023-09-10T09:22:42.235 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2023-09-10T09:22:42.235 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484427.log.gz 2023-09-10T09:22:42.235 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.405711.log: /var/log/ceph/ceph-client.admin.422723.log: /var/log/ceph/ceph-client.admin.367355.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.386108.log.gz 2023-09-10T09:22:42.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.352033.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.387827.log.gz 2023-09-10T09:22:42.236 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.412926.log.gz 2023-09-10T09:22:42.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.420669.log: /var/log/ceph/ceph-client.admin.469081.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2023-09-10T09:22:42.236 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.412094.log: /var/log/ceph/ceph-client.admin.371408.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2023-09-10T09:22:42.237 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2023-09-10T09:22:42.237 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.364542.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.101968.log.gz 2023-09-10T09:22:42.237 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.362112.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.102783.log.gz 2023-09-10T09:22:42.238 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.355657.log: /var/log/ceph/ceph-client.admin.484818.log: /var/log/ceph/ceph-client.admin.488961.log: /var/log/ceph/ceph-client.admin.495685.log: /var/log/ceph/ceph-client.admin.385180.log: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.484818.log.gz 2023-09-10T09:22:42.238 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.489383.log.gz 2023-09-10T09:22:42.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.369776.log: /var/log/ceph/ceph-client.admin.403482.log: /var/log/ceph/ceph-client.admin.494013.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2023-09-10T09:22:42.239 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.356056.log.gz 2023-09-10T09:22:42.239 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.391875.log: /var/log/ceph/ceph-client.admin.357670.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.357661.log.gz 2023-09-10T09:22:42.240 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.417872.log: /var/log/ceph/ceph-client.admin.390665.log: /var/log/ceph/ceph-client.admin.483611.log: 90.3%/var/log/ceph/ceph-client.admin.469488.log: -- replaced with /var/log/ceph/ceph-client.admin.357267.log.gz 2023-09-10T09:22:42.240 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.368551.log: /var/log/ceph/ceph-client.admin.352024.log: /var/log/ceph/ceph-client.admin.364940.log: /var/log/ceph/ceph-client.admin.479771.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.422334.log.gz 2023-09-10T09:22:42.240 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.479771.log.gz 2023-09-10T09:22:42.240 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.483611.log.gz 2023-09-10T09:22:42.241 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.381503.log: /var/log/ceph/ceph-client.admin.482270.log: /var/log/ceph/ceph-client.admin.388233.log: /var/log/ceph/ceph-client.admin.466284.log: /var/log/ceph/ceph-client.admin.495264.log: /var/log/ceph/ceph-client.admin.422325.log: /var/log/ceph/ceph-client.admin.386979.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.482270.log.gz 2023-09-10T09:22:42.241 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.495685.log.gz 2023-09-10T09:22:42.242 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.488961.log.gz 2023-09-10T09:22:42.244 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499563.log: /var/log/ceph/ceph-client.admin.478463.log: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.415796.log.gz 2023-09-10T09:22:42.244 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.494013.log.gz 2023-09-10T09:22:42.244 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.499563.log.gz 2023-09-10T09:22:42.245 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.465895.log: /var/log/ceph/ceph-client.admin.491899.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.415407.log.gz 2023-09-10T09:22:42.245 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.411250.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.491899.log.gz 2023-09-10T09:22:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.367346.log: /var/log/ceph/ceph-client.admin.407606.log: /var/log/ceph/ceph-client.admin.399516.log: /var/log/ceph/ceph-client.admin.485628.log: /var/log/ceph/ceph-client.admin.424951.log: /var/log/ceph/ceph-client.admin.384779.log: /var/log/ceph/ceph-client.admin.404378.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.495264.log.gz 2023-09-10T09:22:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.394845.log: /var/log/ceph/ceph-client.admin.354851.log: /var/log/ceph/ceph-client.admin.368144.log: /var/log/ceph/ceph-client.admin.371417.log: /var/log/ceph/ceph-client.admin.369349.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.271118.log.gz 2023-09-10T09:22:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.356459.log: /var/log/ceph/ceph-client.admin.365343.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.270728.log.gz 2023-09-10T09:22:42.252 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.475102.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.271925.log.gz 2023-09-10T09:22:42.253 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.471867.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.314284.log.gz 2023-09-10T09:22:42.253 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.273528.log.gz -- replaced with /var/log/ceph/ceph-client.admin.336027.log.gz 2023-09-10T09:22:42.253 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.254 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.489796.log: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.170128.log.gz 2023-09-10T09:22:42.255 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.368542.log: /var/log/ceph/ceph-client.admin.499355.log: /var/log/ceph/ceph-client.admin.370983.log: /var/log/ceph/ceph-client.admin.357258.log: /var/log/ceph/ceph-client.admin.49121.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.179917.log.gz 2023-09-10T09:22:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.498920.log: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.184470.log.gz 2023-09-10T09:22:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.368955.log: /var/log/ceph/ceph-client.admin.485229.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.485628.log.gz 2023-09-10T09:22:42.256 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.498920.log.gz 2023-09-10T09:22:42.256 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.383151.log: /var/log/ceph/ceph-client.admin.420279.log: /var/log/ceph/ceph-client.admin.398579.log: /var/log/ceph/ceph-client.admin.424960.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.182417.log.gz 2023-09-10T09:22:42.257 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.472265.log: /var/log/ceph/ceph-client.admin.498641.log: /var/log/ceph/ceph-client.admin.355249.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.498641.log.gz 2023-09-10T09:22:42.257 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.485229.log.gz 2023-09-10T09:22:42.258 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.471469.log: /var/log/ceph/ceph-client.admin.362121.log: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.285756.log.gz 2023-09-10T09:22:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.493583.log: /var/log/ceph/ceph-client.admin.394037.log: /var/log/ceph/ceph-client.admin.403923.log: 71.6%/var/log/ceph/ceph-client.admin.418270.log: -- replaced with /var/log/ceph/ceph-client.admin.493583.log.gz 2023-09-10T09:22:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499043.log: /var/log/ceph/ceph-client.admin.472274.log: /var/log/ceph/ceph-client.admin.406103.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.82639.log.gz 2023-09-10T09:22:42.259 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.499043.log.gz 2023-09-10T09:22:42.259 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.360515.log: /var/log/ceph/ceph-client.admin.479339.log: /var/log/ceph/ceph-client.admin.498946.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.115439.log.gz 2023-09-10T09:22:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.410454.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.479339.log.gz 2023-09-10T09:22:42.260 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.400908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.498946.log.gz 2023-09-10T09:22:42.261 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.350379.log: /var/log/ceph/ceph-client.admin.404849.log: /var/log/ceph/ceph-client.admin.422732.log: /var/log/ceph/ceph-client.admin.412493.log: /var/log/ceph/ceph-client.admin.491487.log: /var/log/ceph/ceph-client.admin.398178.log: /var/log/ceph/ceph-client.admin.416664.log: /var/log/ceph/ceph-client.admin.368946.log: /var/log/ceph/ceph-client.admin.465497.log: /var/log/ceph/ceph-client.admin.402283.log: /var/log/ceph/ceph-client.admin.364931.log: /var/log/ceph/ceph-client.admin.425747.log: /var/log/ceph/ceph-client.admin.416201.log: /var/log/ceph/ceph-client.admin.486480.log: /var/log/ceph/ceph-client.admin.396888.log: /var/log/ceph/ceph-client.admin.488952.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.486480.log.gz 2023-09-10T09:22:42.261 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.488952.log.gz 2023-09-10T09:22:42.262 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.411259.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.97517.log.gz 2023-09-10T09:22:42.262 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.394444.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.124349.log.gz 2023-09-10T09:22:42.263 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.476758.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.491487.log.gz 2023-09-10T09:22:42.263 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.269928.log.gz 2023-09-10T09:22:42.264 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.476758.log.gz 2023-09-10T09:22:42.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.471876.log: /var/log/ceph/ceph-client.admin.469877.log: /var/log/ceph/ceph-client.admin.369358.log: /var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.423693.log: /var/log/ceph/ceph-client.admin.486082.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.107165.log.gz 2023-09-10T09:22:42.268 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499537.log: /var/log/ceph/ceph-client.admin.417473.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.486082.log.gz 2023-09-10T09:22:42.269 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.499537.log.gz 2023-09-10T09:22:42.269 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.115430.log.gz 2023-09-10T09:22:42.269 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499613.log: /var/log/ceph/ceph-client.admin.392790.log: /var/log/ceph/ceph-client.admin.488133.log: /var/log/ceph/ceph-client.admin.424150.log: /var/log/ceph/ceph-client.admin.368153.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.499613.log.gz 2023-09-10T09:22:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.490646.log: /var/log/ceph/ceph-client.admin.358478.log: /var/log/ceph/ceph-client.admin.406112.log: /var/log/ceph/ceph-client.admin.491058.log: /var/log/ceph/ceph-client.admin.468287.log: /var/log/ceph/ceph-client.admin.371822.log: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.491058.log.gz 2023-09-10T09:22:42.270 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.488133.log.gz 2023-09-10T09:22:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.468676.log: /var/log/ceph/ceph-client.admin.390674.log: /var/log/ceph/ceph-client.admin.403914.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.392799.log.gz 2023-09-10T09:22:42.270 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.419873.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.409658.log.gz 2023-09-10T09:22:42.271 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499121.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.410463.log.gz 2023-09-10T09:22:42.271 INFO:teuthology.orchestra.run.smithi084.stderr: 73.3%/var/log/ceph/ceph-client.admin.494422.log: -- replaced with /var/log/ceph/ceph-client.admin.363306.log.gz 2023-09-10T09:22:42.272 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.213523.log.gz 2023-09-10T09:22:42.272 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.421531.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.499121.log.gz 2023-09-10T09:22:42.273 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.370974.log: /var/log/ceph/ceph-client.admin.400444.log: /var/log/ceph/ceph-client.admin.498823.log: /var/log/ceph/ceph-client.admin.499381.log: /var/log/ceph/ceph-client.admin.474686.log: /var/log/ceph/ceph-client.admin.493162.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.201966.log.gz 2023-09-10T09:22:42.273 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.498823.log.gz 2023-09-10T09:22:42.273 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% 69.0% -- replaced with /var/log/ceph/ceph-client.admin.493162.log.gz 2023-09-10T09:22:42.273 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.402677.log.gz 2023-09-10T09:22:42.274 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2023-09-10T09:22:42.274 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.359296.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.499381.log.gz 2023-09-10T09:22:42.274 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2023-09-10T09:22:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.473468.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2023-09-10T09:22:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.415398.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.490646.log.gz 2023-09-10T09:22:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.482725.log: /var/log/ceph/ceph-client.admin.387818.log: /var/log/ceph/ceph-client.admin.471071.log: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.482725.log.gz 2023-09-10T09:22:42.275 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.473061.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.417065.log.gz 2023-09-10T09:22:42.278 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.383947.log: /var/log/ceph/ceph-client.admin.372836.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.313420.log.gz 2023-09-10T09:22:42.279 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499277.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.494422.log.gz 2023-09-10T09:22:42.279 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499277.log.gz 2023-09-10T09:22:42.279 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.415805.log.gz 2023-09-10T09:22:42.279 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.344131.log.gz 2023-09-10T09:22:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.421937.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.343738.log.gz 2023-09-10T09:22:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.413397.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.345363.log.gz 2023-09-10T09:22:42.280 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.400453.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373242.log.gz 2023-09-10T09:22:42.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.423258.log: /var/log/ceph/ceph-client.admin.472672.log: /var/log/ceph/ceph-client.admin.482986.log: /var/log/ceph/ceph-client.admin.361718.log: /var/log/ceph/ceph-client.admin.417074.log: /var/log/ceph/ceph-client.admin.408395.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.416210.log.gz 2023-09-10T09:22:42.281 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.96685.log.gz 2023-09-10T09:22:42.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.396490.log: /var/log/ceph/ceph-client.admin.354860.log: /var/log/ceph/ceph-client.admin.346779.log: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.419469.log.gz 2023-09-10T09:22:42.281 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.348357.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.420270.log.gz 2023-09-10T09:22:42.282 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.418669.log.gz 2023-09-10T09:22:42.282 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.419074.log.gz 2023-09-10T09:22:42.282 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.419478.log.gz 2023-09-10T09:22:42.282 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.419882.log.gz 2023-09-10T09:22:42.283 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.410861.log: /var/log/ceph/ceph-client.admin.426953.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.194027.log.gz 2023-09-10T09:22:42.283 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499433.log: /var/log/ceph/ceph-client.admin.499407.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499433.log.gz 2023-09-10T09:22:42.283 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499407.log.gz 2023-09-10T09:22:42.284 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498745.log: /var/log/ceph/ceph-client.admin.470673.log: /var/log/ceph/ceph-client.admin.395685.log: /var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.486489.log: /var/log/ceph/ceph-client.admin.397748.log: /var/log/ceph/ceph-client.admin.474285.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.498745.log.gz 2023-09-10T09:22:42.285 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498894.log: /var/log/ceph/ceph-client.admin.395287.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.498894.log.gz 2023-09-10T09:22:42.285 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.486489.log.gz 2023-09-10T09:22:42.285 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.421928.log.gz 2023-09-10T09:22:42.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.465886.log: /var/log/ceph/ceph-client.admin.399042.log: /var/log/ceph/ceph-client.admin.358064.log: /var/log/ceph/ceph-client.admin.392394.log: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.181564.log.gz 2023-09-10T09:22:42.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.489374.log: 64.6% -- replaced with /var/log/ceph/ceph-client.admin.489374.log.gz 2023-09-10T09:22:42.286 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499017.log: /var/log/ceph/ceph-client.admin.396879.log: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.115833.log.gz 2023-09-10T09:22:42.288 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.428207.log: /var/log/ceph/ceph-client.admin.479780.log: /var/log/ceph/ceph-client.admin.487304.log: /var/log/ceph/ceph-client.admin.280344.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.125141.log.gz 2023-09-10T09:22:42.290 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.492329.log: /var/log/ceph/ceph-client.admin.401865.log: 90.2% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.393197.log.gz -- replaced with /var/log/ceph/ceph-client.admin.487304.log.gz 2023-09-10T09:22:42.290 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.291 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.362510.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.409269.log.gz 2023-09-10T09:22:42.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.426547.log: /var/log/ceph/ceph-client.admin.392385.log: /var/log/ceph/ceph-client.admin.469886.log: /var/log/ceph/ceph-client.admin.384770.log: /var/log/ceph/ceph-client.admin.381946.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.389878.log.gz 2023-09-10T09:22:42.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499303.log: /var/log/ceph/ceph-client.admin.401315.log: /var/log/ceph/ceph-client.admin.389063.log: /var/log/ceph/ceph-client.admin.389466.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.499303.log.gz 2023-09-10T09:22:42.292 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.399989.log: 68.9%/var/log/ceph/ceph-client.admin.406636.log: -- replaced with /var/log/ceph/ceph-client.admin.281258.log.gz 2023-09-10T09:22:42.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.470284.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.469081.log.gz 2023-09-10T09:22:42.293 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.481051.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.471469.log.gz 2023-09-10T09:22:42.294 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.481051.log.gz 2023-09-10T09:22:42.294 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471080.log.gz 2023-09-10T09:22:42.294 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.465098.log.gz 2023-09-10T09:22:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.497424.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.304245.log.gz 2023-09-10T09:22:42.303 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.492329.log.gz 2023-09-10T09:22:42.303 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.360909.log: /var/log/ceph/ceph-client.admin.360506.log: /var/log/ceph/ceph-client.admin.354453.log: /var/log/ceph/ceph-client.admin.391462.log: /var/log/ceph/ceph-client.admin.418261.log: /var/log/ceph/ceph-client.admin.488124.log: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.488124.log.gz 2023-09-10T09:22:42.304 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.291349.log.gz 2023-09-10T09:22:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.358907.log: /var/log/ceph/ceph-client.admin.482995.log: /var/log/ceph/ceph-client.admin.465089.log: /var/log/ceph/ceph-client.admin.480643.log: /var/log/ceph/ceph-client.admin.414589.log: /var/log/ceph/ceph-client.admin.353255.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.480643.log.gz 2023-09-10T09:22:42.304 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.410065.log: /var/log/ceph/ceph-client.admin.496547.log: /var/log/ceph/ceph-client.admin.409667.log: /var/log/ceph/ceph-client.admin.476767.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.287751.log.gz 2023-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.349566.log: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.289729.log.gz 2023-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.362917.log: /var/log/ceph/ceph-client.admin.352431.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.336425.log.gz 2023-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.496547.log.gz 2023-09-10T09:22:42.305 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.497424.log.gz 2023-09-10T09:22:42.306 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.473070.log: /var/log/ceph/ceph-client.admin.349154.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.362519.log.gz 2023-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498589.log: /var/log/ceph/ceph-client.admin.397341.log: /var/log/ceph/ceph-client.admin.466293.log: /var/log/ceph/ceph-client.admin.481454.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.498589.log.gz 2023-09-10T09:22:42.307 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.404387.log: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.481454.log.gz 2023-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.349985.log: /var/log/ceph/ceph-client.admin.408404.log: /var/log/ceph/ceph-client.admin.353657.log: /var/log/ceph/ceph-client.admin.386970.log: /var/log/ceph/ceph-client.admin.351621.log: /var/log/ceph/ceph-client.admin.494843.log: /var/log/ceph/ceph-client.admin.427788.log: /var/log/ceph/ceph-client.admin.481463.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.125150.log.gz 2023-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.387382.log: /var/log/ceph/ceph-client.admin.371813.log: /var/log/ceph/ceph-client.admin.364144.log: /var/log/ceph/ceph-client.admin.426147.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.481463.log.gz 2023-09-10T09:22:42.308 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.200313.log.gz 2023-09-10T09:22:42.309 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.361321.log: /var/log/ceph/ceph-client.admin.489805.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.476767.log.gz 2023-09-10T09:22:42.309 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2023-09-10T09:22:42.309 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.494843.log.gz 2023-09-10T09:22:42.310 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.489805.log.gz 2023-09-10T09:22:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.490216.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.187460.log.gz 2023-09-10T09:22:42.311 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499251.log: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.490216.log.gz 2023-09-10T09:22:42.311 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.364533.log.gz 2023-09-10T09:22:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.361312.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499251.log.gz 2023-09-10T09:22:42.312 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46953.log.gz/var/log/ceph/ceph-client.admin.356450.log: 2023-09-10T09:22:42.312 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.427375.log: /var/log/ceph/ceph-client.admin.427384.log: /var/log/ceph/ceph-client.admin.396481.log: /var/log/ceph/ceph-client.admin.426156.log: /var/log/ceph/ceph-client.admin.370586.log: /var/log/ceph/ceph-client.admin.490225.log: /var/log/ceph/ceph-client.admin.499225.log: /var/log/ceph/ceph-client.admin.478027.log: /var/log/ceph/ceph-client.admin.383540.log: /var/log/ceph/ceph-client.admin.496097.log: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.496097.log.gz 2023-09-10T09:22:42.313 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.499225.log.gz 2023-09-10T09:22:42.313 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.382751.log.gz 2023-09-10T09:22:42.314 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.385644.log.gz 2023-09-10T09:22:42.315 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.385180.log.gz 2023-09-10T09:22:42.315 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.384779.log.gz 2023-09-10T09:22:42.315 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.478027.log.gz 2023-09-10T09:22:42.315 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.473459.log: /var/log/ceph/ceph-client.admin.383938.log: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.387818.log.gz 2023-09-10T09:22:42.316 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.385189.log.gz 2023-09-10T09:22:42.316 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.490225.log.gz 2023-09-10T09:22:42.317 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499199.log: /var/log/ceph/ceph-client.admin.477629.log: /var/log/ceph/ceph-client.admin.354055.log: /var/log/ceph/ceph-client.admin.478018.log: /var/log/ceph/ceph-client.admin.400917.log: /var/log/ceph/ceph-client.admin.498771.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.499199.log.gz 2023-09-10T09:22:42.317 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.478018.log.gz 2023-09-10T09:22:42.318 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.498771.log.gz 2023-09-10T09:22:42.318 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.477629.log.gz 2023-09-10T09:22:42.319 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.483208.log: /var/log/ceph/ceph-client.admin.382742.log: /var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.474276.log: /var/log/ceph/ceph-client.admin.348348.log: /var/log/ceph/ceph-client.admin.496985.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.386581.log.gz 2023-09-10T09:22:42.320 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.398570.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.483208.log.gz 2023-09-10T09:22:42.320 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.398169.log.gz/var/log/ceph/ceph-client.admin.356047.log: 2023-09-10T09:22:42.320 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.413795.log.gz 2023-09-10T09:22:42.320 INFO:teuthology.orchestra.run.smithi084.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.360112.log.gz 2023-09-10T09:22:42.323 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.465488.log: /var/log/ceph/ceph-mds.a.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.496985.log.gz 2023-09-10T09:22:42.324 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.390276.log: /var/log/ceph/ceph-client.admin.467080.log: /var/log/ceph/ceph-client.admin.497853.log: /var/log/ceph/ceph-client.admin.490637.log: /var/log/ceph/ceph-client.admin.403491.log: /var/log/ceph/ceph-client.admin.416673.log: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.490637.log.gz 2023-09-10T09:22:42.324 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.407996.log: /var/log/ceph/ceph-client.admin.487701.log: /var/log/ceph/ceph-client.admin.417863.log: /var/log/ceph/ceph-client.admin.492750.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.497853.log.gz 2023-09-10T09:22:42.325 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.483199.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.483199.log.gz 2023-09-10T09:22:42.328 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.419065.log: /var/log/ceph/ceph-client.admin.367755.log: /var/log/ceph/ceph-client.admin.389869.log: /var/log/ceph/ceph-client.admin.414193.log: /var/log/ceph/ceph-client.admin.423684.log: /var/log/ceph/ceph-client.admin.348760.log: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.236045.log.gz 2023-09-10T09:22:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.388242.log: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.237302.log.gz 2023-09-10T09:22:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499173.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.492750.log.gz 2023-09-10T09:22:42.329 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.425358.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.499173.log.gz 2023-09-10T09:22:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.426944.log: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.405702.log.gz 2023-09-10T09:22:42.330 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.393188.log: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.229204.log.gz 2023-09-10T09:22:42.330 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.82648.log.gz 2023-09-10T09:22:42.332 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.382353.log: /var/log/ceph/ceph-client.admin.406627.log: /var/log/ceph/ceph-client.admin.350388.log: /var/log/ceph/ceph-client.admin.352422.log: /var/log/ceph/ceph-client.admin.46458.log: 90.3%/var/log/ceph/ceph-client.admin.47722.log: -- replaced with /var/log/ceph/ceph-client.admin.395296.log.gz 2023-09-10T09:22:42.333 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.466691.log: /var/log/ceph/ceph-client.admin.384350.log: /var/log/ceph/ceph-client.admin.481856.log: /var/log/ceph/ceph-client.admin.388672.log: /var/log/ceph/ceph-client.admin.495255.log: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.481856.log.gz 2023-09-10T09:22:42.333 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.495255.log.gz 2023-09-10T09:22:42.334 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.418660.log: /var/log/ceph/ceph-client.admin.353264.log: /var/log/ceph/ceph-client.admin.388663.log: /var/log/ceph/ceph-client.admin.412935.log: /var/log/ceph/ceph-client.admin.471478.log: /var/log/ceph/ceph-client.admin.421092.log: /var/log/ceph/ceph-client.admin.359305.log: /var/log/ceph/ceph-client.admin.373632.log: /var/log/ceph/ceph-client.admin.412502.log: /var/log/ceph/ceph-client.admin.476369.log: /var/log/ceph/ceph-client.admin.474695.log: /var/log/ceph/ceph-client.admin.424159.log: /var/log/ceph/ceph-client.admin.414999.log: /var/log/ceph/ceph-client.admin.356847.log: /var/log/ceph/ceph-client.admin.371692.log: /var/log/ceph/ceph-client.admin.499095.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.499095.log.gz 2023-09-10T09:22:42.334 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.423945.log.gz 2023-09-10T09:22:42.335 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476369.log.gz 2023-09-10T09:22:42.335 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.476360.log: /var/log/ceph/ceph-client.admin.498797.log: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.476360.log.gz 2023-09-10T09:22:42.335 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.498797.log.gz 2023-09-10T09:22:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.493171.log: /var/log/ceph/ceph-client.admin.408859.log: /var/log/ceph/ceph-client.admin.403092.log: /var/log/ceph/ceph-client.admin.475555.log: /var/log/ceph/ceph-client.admin.425349.log: 73.9% -- replaced with /var/log/ceph/ceph-client.admin.84379.log.gz 2023-09-10T09:22:42.336 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.396083.log: 73.9% -- replaced with /var/log/ceph/ceph-client.admin.122295.log.gz 2023-09-10T09:22:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.467490.log: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.110007.log.gz 2023-09-10T09:22:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.355648.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475555.log.gz 2023-09-10T09:22:42.337 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.201117.log.gz 2023-09-10T09:22:42.337 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498849.log: /var/log/ceph/ceph-client.admin.381494.log: /var/log/ceph/ceph-client.admin.387373.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386117.log.gz 2023-09-10T09:22:42.338 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.498849.log.gz 2023-09-10T09:22:42.338 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.493171.log.gz 2023-09-10T09:22:42.339 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.411705.log: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.411696.log.gz 2023-09-10T09:22:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.413388.log: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.351215.log.gz 2023-09-10T09:22:42.340 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.408868.log: /var/log/ceph/ceph-client.admin.499069.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.499069.log.gz 2023-09-10T09:22:42.341 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.385653.log: /var/log/ceph/ceph-client.admin.473866.log: /var/log/ceph/ceph-client.admin.372442.log: /var/log/ceph/ceph-client.admin.424553.log: /var/log/ceph/ceph-client.admin.480652.log: /var/log/ceph/ceph-client.admin.410056.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.414598.log.gz 2023-09-10T09:22:42.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.494413.log: /var/log/ceph/ceph-client.admin.395694.log: 73.4% -- replaced with /var/log/ceph/ceph-client.admin.494413.log.gz 2023-09-10T09:22:42.342 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.389475.log: /var/log/ceph/ceph-client.admin.479348.log: /var/log/ceph/ceph-client.admin.401306.log: /var/log/ceph/ceph-client.admin.486892.log: /var/log/ceph/ceph-client.admin.473857.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.480652.log.gz 2023-09-10T09:22:42.342 INFO:teuthology.orchestra.run.smithi084.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.486892.log.gz 2023-09-10T09:22:42.343 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.361709.log: /var/log/ceph/ceph-client.admin.391866.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.470682.log.gz 2023-09-10T09:22:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.349976.log: /var/log/ceph/ceph-client.admin.383142.log: /var/log/ceph/ceph-client.admin.417464.log: /var/log/ceph/ceph-client.admin.421540.log: /var/log/ceph/ceph-client.admin.352826.log: /var/log/ceph/ceph-client.admin.477620.log: /var/log/ceph/ceph-client.admin.355258.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.477620.log.gz 2023-09-10T09:22:42.344 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.498563.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.498563.log.gz 2023-09-10T09:22:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.393595.log: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.414184.log.gz 2023-09-10T09:22:42.345 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.499147.log: /var/log/ceph/ceph-client.admin.467880.log: /var/log/ceph/ceph-client.admin.484007.log: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.484007.log.gz 2023-09-10T09:22:42.346 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499147.log.gz 2023-09-10T09:22:42.347 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.393586.log: /var/log/ceph/ceph-client.admin.372845.log: /var/log/ceph/ceph-client.admin.382344.log: /var/log/ceph/ceph-client.admin.360103.log: /var/log/ceph/ceph-client.admin.467889.log: /var/log/ceph/ceph-client.admin.366492.log: /var/log/ceph/ceph-client.admin.468685.log: /var/log/ceph/ceph-client.admin.399980.log: /var/log/ceph/ceph-client.admin.496106.log: /var/log/ceph/ceph-client.admin.350791.log: /var/log/ceph/ceph-client.admin.356856.log: /var/log/ceph/ceph-client.admin.402274.log: /var/log/ceph/ceph-client.admin.364135.log: /var/log/ceph/ceph-client.admin.354462.log: /var/log/ceph/ceph-client.admin.358898.log: /var/log/ceph/ceph-client.admin.421101.log: /var/log/ceph/ceph-client.admin.391073.log: /var/log/ceph/ceph-client.admin.423936.log: /var/log/ceph/ceph-client.admin.394854.log: /var/log/ceph/ceph-client.admin.477222.log: 68.4% -- replaced with /var/log/ceph/ceph-client.admin.477222.log.gz 2023-09-10T09:22:42.348 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.389072.log: /var/log/ceph/ceph-client.admin.407597.log: /var/log/ceph/ceph-client.admin.370179.log: /var/log/ceph/ceph-client.admin.383549.log: /var/log/ceph/ceph-client.admin.391471.log: /var/log/ceph/ceph-client.admin.480202.log: /var/log/ceph/ceph-client.admin.468278.log: /var/log/ceph/ceph-client.admin.491067.log: /var/log/ceph/ceph-client.admin.494004.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.480202.log.gz 2023-09-10T09:22:42.348 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.494004.log.gz 2023-09-10T09:22:42.349 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.358469.log: /var/log/ceph/ceph-client.admin.472663.log: /var/log/ceph/ceph-client.admin.390267.log: /var/log/ceph/ceph-client.admin.363315.log: /var/log/ceph/ceph-client.admin.359695.log: /var/log/ceph/ceph-client.admin.480211.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.496106.log.gz 2023-09-10T09:22:42.349 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.480211.log.gz 2023-09-10T09:22:42.350 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.491067.log.gz 2023-09-10T09:22:42.351 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.351630.log: /var/log/ceph/ceph-client.admin.366501.log: /var/log/ceph/ceph-client.admin.420678.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.105967.log.gz 2023-09-10T09:22:42.351 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz 2023-09-10T09:22:42.351 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48899.log.gz 2023-09-10T09:22:42.352 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49043.log.gz 2023-09-10T09:22:42.354 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44992.log.gz 2023-09-10T09:22:42.355 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2023-09-10T09:22:42.355 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.121481.log.gz 2023-09-10T09:22:42.355 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2023-09-10T09:22:42.356 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.102774.log.gz 2023-09-10T09:22:42.356 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43647.log.gz 2023-09-10T09:22:42.356 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz 2023-09-10T09:22:42.356 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46875.log.gz 2023-09-10T09:22:42.357 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.169701.log.gz 2023-09-10T09:22:42.357 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.151459.log.gz 2023-09-10T09:22:42.357 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.191901.log.gz 2023-09-10T09:22:42.358 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.208261.log.gz 2023-09-10T09:22:42.358 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.219071.log.gz 2023-09-10T09:22:42.358 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47985.log.gz 2023-09-10T09:22:42.358 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.2.46352.log.gz 2023-09-10T09:22:42.359 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48115.log.gz 2023-09-10T09:22:42.359 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49475.log.gz 2023-09-10T09:22:42.359 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.151062.log.gz 2023-09-10T09:22:42.359 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.149846.log.gz 2023-09-10T09:22:42.360 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2023-09-10T09:22:42.360 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2023-09-10T09:22:42.360 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.331159.log.gz 2023-09-10T09:22:42.361 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.331168.log.gz 2023-09-10T09:22:42.361 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.331571.log.gz 2023-09-10T09:22:42.361 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43978.log.gz 2023-09-10T09:22:42.361 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38190.log.gz 2023-09-10T09:22:42.366 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38171.log.gz 2023-09-10T09:22:42.366 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.424562.log.gz 2023-09-10T09:22:42.367 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.245712.log.gz 2023-09-10T09:22:42.367 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2023-09-10T09:22:42.367 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46823.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2023-09-10T09:22:42.367 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.368 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.106356.log.gz 2023-09-10T09:22:42.368 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.133579.log.gz 2023-09-10T09:22:42.368 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.348751.log.gz 2023-09-10T09:22:42.368 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.231194.log.gz 2023-09-10T09:22:42.369 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.396092.log.gz 2023-09-10T09:22:42.369 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.274315.log.gz 2023-09-10T09:22:42.369 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.353666.log.gz 2023-09-10T09:22:42.369 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.300301.log.gz 2023-09-10T09:22:42.370 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.408005.log.gz 2023-09-10T09:22:42.370 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.282063.log.gz 2023-09-10T09:22:42.370 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.285359.log.gz 2023-09-10T09:22:42.371 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.286551.log.gz 2023-09-10T09:22:42.371 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.287345.log.gz 2023-09-10T09:22:42.371 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.286560.log.gz 2023-09-10T09:22:42.371 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.386572.log.gz 2023-09-10T09:22:42.372 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.362908.log.gz 2023-09-10T09:22:42.372 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.410852.log.gz 2023-09-10T09:22:42.372 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.346165.log.gz 2023-09-10T09:22:42.372 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.381955.log.gz 2023-09-10T09:22:42.373 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.401856.log.gz 2023-09-10T09:22:42.373 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.403083.log.gz 2023-09-10T09:22:42.373 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.394453.log.gz 2023-09-10T09:22:42.374 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.415008.log.gz 2023-09-10T09:22:42.374 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.125587.log.gz 2023-09-10T09:22:42.374 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.167993.log.gz 2023-09-10T09:22:42.374 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.96694.log.gz 2023-09-10T09:22:42.375 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.286957.log.gz 2023-09-10T09:22:42.375 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.200322.log.gz 2023-09-10T09:22:42.375 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.359704.log.gz 2023-09-10T09:22:42.375 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.467089.log.gz 2023-09-10T09:22:42.376 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.467481.log.gz 2023-09-10T09:22:42.376 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.340472.log.gz 2023-09-10T09:22:42.376 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.363737.log.gz 2023-09-10T09:22:42.377 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.89078.log.gz 2023-09-10T09:22:42.377 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.97908.log.gz 2023-09-10T09:22:42.377 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.98704.log.gz 2023-09-10T09:22:42.377 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.98713.log.gz 2023-09-10T09:22:42.378 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.99110.log.gz 2023-09-10T09:22:42.378 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.340076.log.gz 2023-09-10T09:22:42.378 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2023-09-10T09:22:42.378 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2023-09-10T09:22:42.379 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2023-09-10T09:22:42.379 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2023-09-10T09:22:42.379 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.175928.log.gz 2023-09-10T09:22:42.380 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.350782.log.gz 2023-09-10T09:22:42.380 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.413786.log.gz 2023-09-10T09:22:42.380 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.466682.log.gz 2023-09-10T09:22:42.380 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.163318.log.gz 2023-09-10T09:22:42.381 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.165471.log.gz 2023-09-10T09:22:42.381 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.177918.log.gz 2023-09-10T09:22:42.381 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.303457.log.gz 2023-09-10T09:22:42.381 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.358073.log.gz 2023-09-10T09:22:42.382 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.402686.log.gz 2023-09-10T09:22:42.382 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.295801.log.gz 2023-09-10T09:22:42.382 INFO:teuthology.orchestra.run.smithi084.stderr: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.409260.log.gz 2023-09-10T09:22:42.383 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.272328.log.gz 2023-09-10T09:22:42.383 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.412103.log.gz 2023-09-10T09:22:42.383 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.367746.log.gz 2023-09-10T09:22:42.383 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.423267.log.gz 2023-09-10T09:22:42.384 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.204359.log.gz 2023-09-10T09:22:42.384 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45956.log.gz 2023-09-10T09:22:42.384 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.349163.log.gz 2023-09-10T09:22:42.384 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.209494.log.gz 2023-09-10T09:22:42.385 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.110895.log.gz 2023-09-10T09:22:42.385 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.405248.log.gz 2023-09-10T09:22:42.385 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.225091.log.gz 2023-09-10T09:22:42.385 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.487701.log.gz 2023-09-10T09:22:42.386 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.314682.log.gz 2023-09-10T09:22:42.386 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.168847.log.gz 2023-09-10T09:22:42.386 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.221074.log.gz 2023-09-10T09:22:42.387 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.107564.log.gz 2023-09-10T09:22:42.387 INFO:teuthology.orchestra.run.smithi084.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.371701.log.gz 2023-09-10T09:22:42.387 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.303448.log.gz 2023-09-10T09:22:42.387 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.290525.log.gz 2023-09-10T09:22:42.388 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.206007.log.gz 2023-09-10T09:22:42.388 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.365334.log.gz 2023-09-10T09:22:42.388 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.173936.log.gz 2023-09-10T09:22:42.388 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.154063.log.gz 2023-09-10T09:22:42.389 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.89877.log.gz 2023-09-10T09:22:42.389 INFO:teuthology.orchestra.run.smithi084.stderr: 92.0% 71.1% -- replaced with /var/log/ceph/ceph-client.admin.162926.log.gz -- replaced with /var/log/ceph/ceph-client.admin.228806.log.gz 2023-09-10T09:22:42.389 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.389 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.306766.log.gz 2023-09-10T09:22:42.444 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.348357.log.gz 2023-09-10T09:22:42.444 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.157006.log.gz 2023-09-10T09:22:42.445 INFO:teuthology.orchestra.run.smithi084.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.147855.log.gz 2023-09-10T09:22:42.445 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.397739.log.gz 2023-09-10T09:22:42.445 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.397350.log.gz 2023-09-10T09:22:42.445 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.346574.log.gz 2023-09-10T09:22:42.446 INFO:teuthology.orchestra.run.smithi084.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.129196.log.gz 2023-09-10T09:22:42.446 INFO:teuthology.orchestra.run.smithi084.stderr: 74.6% -- replaced with /var/log/ceph/ceph-client.admin.37937.log.gz 2023-09-10T09:22:42.446 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.349566.log.gz 2023-09-10T09:22:42.447 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.106764.log.gz 2023-09-10T09:22:42.447 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.189901.log.gz 2023-09-10T09:22:42.447 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.369785.log.gz 2023-09-10T09:22:42.447 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2023-09-10T09:22:42.448 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.241888.log.gz 2023-09-10T09:22:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.50003.log: /var/log/ceph/ceph-client.admin.46901.log: /var/log/ceph/ceph-client.admin.179118.log: /var/log/ceph/ceph-client.admin.47828.log: /var/log/ceph/ceph-client.admin.123941.log: /var/log/ceph/ceph-client.admin.197508.log: /var/log/ceph/ceph-client.admin.273519.log: /var/log/ceph/ceph-client.admin.227523.log: /var/log/ceph/ceph-client.admin.186459.log: /var/log/ceph/ceph-client.admin.189052.log: /var/log/ceph/ceph-client.admin.158758.log: /var/log/ceph/ceph-client.admin.184082.log: /var/log/ceph/ceph-client.admin.45852.log: /var/log/ceph/ceph-client.admin.228408.log: /var/log/ceph/ceph-client.admin.38440.log: /var/log/ceph/ceph-client.admin.279537.log: /var/log/ceph/ceph-client.admin.49199.log: /var/log/ceph/ceph-client.admin.190299.log: /var/log/ceph/ceph-client.admin.242713.log: /var/log/ceph/ceph-client.admin.332808.log: /var/log/ceph/ceph-client.admin.289738.log: /var/log/ceph/ceph-client.admin.309176.log: /var/log/ceph/ceph-client.admin.158307.log: /var/log/ceph/ceph-client.admin.120624.log: /var/log/ceph/ceph-client.admin.246101.log: /var/log/ceph/ceph-client.admin.316055.log: /var/log/ceph/ceph-client.admin.205181.log: /var/log/ceph/ceph-client.admin.44414.log: /var/log/ceph/ceph-client.admin.208252.log: /var/log/ceph/ceph-client.admin.287354.log: /var/log/ceph/ceph-client.admin.94257.log: /var/log/ceph/ceph-client.admin.45722.log: /var/log/ceph/ceph-client.admin.48815.log: /var/log/ceph/ceph-client.admin.288933.log: /var/log/ceph/ceph-client.admin.46563.log: /var/log/ceph/ceph-client.admin.195761.log: /var/log/ceph/ceph-client.admin.332397.log: /var/log/ceph/ceph-client.admin.244510.log: /var/log/ceph/ceph-client.admin.223483.log: /var/log/ceph/ceph-client.admin.229602.log: /var/log/ceph/ceph-client.admin.340481.log: /var/log/ceph/ceph-client.admin.154916.log: /var/log/ceph/ceph-client.admin.342889.log: /var/log/ceph/ceph-client.admin.203552.log: /var/log/ceph/ceph-client.admin.191892.log: /var/log/ceph/ceph-client.admin.45696.log: /var/log/ceph/ceph-client.admin.177909.log: /var/log/ceph/ceph-client.admin.175919.log: /var/log/ceph/ceph-client.admin.185274.log: /var/log/ceph/ceph-client.admin.45592.log: /var/log/ceph/ceph-client.admin.294199.log: /var/log/ceph/ceph-client.admin.288139.log: /var/log/ceph/ceph-client.admin.332799.log: /var/log/ceph/ceph-client.admin.217820.log: /var/log/ceph/ceph-client.admin.111746.log: /var/log/ceph/ceph-client.admin.45930.log: /var/log/ceph/ceph-client.admin.170991.log: /var/log/ceph/ceph-client.admin.120633.log: /var/log/ceph/ceph-client.admin.192688.log: /var/log/ceph/ceph-client.0.49683.log: /var/log/ceph/ceph-client.admin.49173.log: /var/log/ceph/ceph-client.admin.331562.log: /var/log/ceph/ceph-client.admin.101168.log: /var/log/ceph/ceph-client.admin.312564.log: /var/log/ceph/ceph-client.admin.165869.log: /var/log/ceph/ceph-client.admin.44758.log: /var/log/ceph/ceph-client.admin.164178.log: /var/log/ceph/ceph-client.admin.132210.log: /var/log/ceph/ceph-client.admin.179908.log: /var/log/ceph/ceph-client.admin.48614.log: /var/log/ceph/ceph-client.admin.235655.log: /var/log/ceph/ceph-client.admin.112547.log: /var/log/ceph/ceph-client.admin.162488.log: /var/log/ceph/ceph-client.admin.224688.log: /var/log/ceph/ceph-client.admin.338055.log: /var/log/ceph/ceph-client.admin.207854.log: /var/log/ceph/ceph-client.admin.151895.log: /var/log/ceph/ceph-client.admin.47880.log: /var/log/ceph/ceph-client.admin.270317.log: /var/log/ceph/ceph-client.admin.213123.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.155741.log.gz 2023-09-10T09:22:42.448 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.320297.log: /var/log/ceph/ceph-client.admin.232398.log: /var/log/ceph/ceph-client.admin.222677.log: /var/log/ceph/ceph-client.admin.180719.log: /var/log/ceph/ceph-client.admin.166296.log: /var/log/ceph/ceph-client.admin.46589.log: /var/log/ceph/ceph-client.admin.293392.log: /var/log/ceph/ceph-client.admin.174334.log: /var/log/ceph/ceph-client.admin.109604.log: /var/log/ceph/ceph-client.admin.232788.log: /var/log/ceph/ceph-client.admin.115011.log: /var/log/ceph/ceph-client.admin.236879.log: /var/log/ceph/ceph-client.admin.235247.log: /var/log/ceph/ceph-client.admin.156177.log: /var/log/ceph/ceph-client.admin.199923.log: /var/log/ceph/ceph-client.admin.47246.log: /var/log/ceph/ceph-client.admin.99909.log: /var/log/ceph/ceph-client.admin.280353.log: /var/log/ceph/ceph-client.admin.293791.log: /var/log/ceph/ceph-client.admin.49315.log: /var/log/ceph/ceph-client.admin.110904.log: /var/log/ceph/ceph-client.admin.47958.log: /var/log/ceph/ceph-client.admin.285368.log: /var/log/ceph/ceph-client.admin.205618.log: /var/log/ceph/ceph-client.admin.49553.log: /var/log/ceph/ceph-client.admin.201957.log: /var/log/ceph/ceph-client.admin.37895.log: /var/log/ceph/ceph-client.admin.48146.log: /var/log/ceph/ceph-client.admin.302134.log: /var/log/ceph/ceph-client.admin.122707.log: /var/log/ceph/ceph-client.admin.107955.log: /var/log/ceph/ceph-client.admin.234815.log: /var/log/ceph/ceph-client.admin.291340.log: /var/log/ceph/ceph-client.admin.275529.log: /var/log/ceph/ceph-client.admin.161116.log: /var/log/ceph/ceph-client.admin.130082.log: /var/log/ceph/ceph-client.admin.345372.log: /var/log/ceph/ceph-client.0.46214.log: /var/log/ceph/ceph-client.admin.94711.log: /var/log/ceph/ceph-client.admin.306319.log: /var/log/ceph/ceph-client.admin.296200.log: /var/log/ceph/ceph-client.admin.151886.log: /var/log/ceph/ceph-client.admin.307172.log: /var/log/ceph/ceph-client.admin.95849.log: /var/log/ceph/ceph-client.admin.148647.log: /var/log/ceph/ceph-client.admin.330292.log: /var/log/ceph/ceph-client.admin.219475.log: /var/log/ceph/ceph-client.admin.313819.log: /var/log/ceph/ceph-client.admin.295792.log: /var/log/ceph/ceph-client.admin.225082.log: /var/log/ceph/ceph-client.admin.104366.log: /var/log/ceph/ceph-client.admin.193581.log: /var/log/ceph/ceph-client.admin.131013.log: /var/log/ceph/ceph-client.admin.216616.log: /var/log/ceph/ceph-client.admin.177511.log: /var/log/ceph/ceph-client.admin.272718.log: /var/log/ceph/ceph-client.admin.229611.log: /var/log/ceph/ceph-client.admin.83448.log: /var/log/ceph/ceph-client.admin.288148.log: /var/log/ceph/ceph-client.admin.235256.log: /var/log/ceph/ceph-client.admin.246110.log: /var/log/ceph/ceph-client.admin.93806.log: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.390665.log.gz 2023-09-10T09:22:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.344974.log: /var/log/ceph/ceph-client.admin.313828.log: /var/log/ceph/ceph-client.admin.182857.log: /var/log/ceph/ceph-client.admin.204759.log: /var/log/ceph/ceph-client.admin.113763.log: /var/log/ceph/ceph-client.admin.294190.log: 90.3%/var/log/ceph/ceph-client.admin.279528.log: -- replaced with /var/log/ceph/ceph-client.admin.390276.log.gz 2023-09-10T09:22:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.162497.log: /var/log/ceph/ceph-client.admin.282460.log: /var/log/ceph/ceph-client.admin.221472.log: /var/log/ceph/ceph-client.admin.223886.log: /var/log/ceph/ceph-client.admin.176715.log: /var/log/ceph/ceph-client.admin.313004.log: /var/log/ceph/ceph-client.admin.44108.log: /var/log/ceph/ceph-client.admin.84388.log: /var/log/ceph/ceph-client.admin.186880.log: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.407199.log.gz 2023-09-10T09:22:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.340067.log: /var/log/ceph/ceph-client.admin.232797.log: /var/log/ceph/ceph-client.admin.307163.log: /var/log/ceph/ceph-client.admin.332388.log: /var/log/ceph/ceph-client.admin.183246.log: /var/log/ceph/ceph-client.admin.318874.log: /var/log/ceph/ceph-client.admin.167148.log: /var/log/ceph/ceph-client.admin.202763.log: /var/log/ceph/ceph-client.admin.123950.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.407597.log.gz 2023-09-10T09:22:42.449 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.171408.log: /var/log/ceph/ceph-client.admin.281656.log: /var/log/ceph/ceph-client.admin.181573.log: /var/log/ceph/ceph-client.admin.203153.log: /var/log/ceph/ceph-client.admin.283331.log: /var/log/ceph/ceph-client.admin.96267.log: /var/log/ceph/ceph-client.admin.340907.log: /var/log/ceph/ceph-client.admin.192697.log: /var/log/ceph/ceph-client.admin.310379.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.407606.log.gz 2023-09-10T09:22:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.152312.log: 73.8% 71.0% -- replaced with /var/log/ceph/ceph-client.admin.428207.log.gz -- replaced with /var/log/ceph/ceph-client.admin.465488.log.gz 2023-09-10T09:22:42.450 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.450 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.303855.log: /var/log/ceph/ceph-client.admin.38126.log: /var/log/ceph/ceph-client.admin.46979.log: /var/log/ceph/ceph-client.admin.175521.log: /var/log/ceph/ceph-client.admin.43752.log: /var/log/ceph/ceph-client.admin.156997.log: /var/log/ceph/ceph-client.admin.46641.log: /var/log/ceph/ceph-client.admin.153652.log: /var/log/ceph/ceph-client.admin.121490.log: /var/log/ceph/ceph-client.admin.228815.log: /var/log/ceph/ceph-client.admin.293800.log: /var/log/ceph/ceph-client.admin.96258.log: /var/log/ceph/ceph-client.admin.44571.log: /var/log/ceph/ceph-client.admin.274727.log: /var/log/ceph/ceph-client.admin.331965.log: /var/log/ceph/ceph-client.admin.83457.log: /var/log/ceph/ceph-client.admin.199914.log: /var/log/ceph/ceph-client.admin.44440.log: /var/log/ceph/ceph-client.admin.85648.log: /var/log/ceph/ceph-client.admin.47135.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.469877.log.gz 2023-09-10T09:22:42.451 INFO:teuthology.orchestra.run.smithi084.stderr: 68.1% -- replaced with /var/log/ceph/ceph-client.admin.465886.log.gz 2023-09-10T09:22:42.451 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.470275.log.gz 2023-09-10T09:22:42.451 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.174325.log: /var/log/ceph/ceph-client.admin.219869.log: /var/log/ceph/ceph-client.admin.160727.log: /var/log/ceph/ceph-client.admin.132761.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.465895.log.gz 2023-09-10T09:22:42.451 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.469886.log.gz 2023-09-10T09:22:42.452 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.470284.log.gz 2023-09-10T09:22:42.452 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.295005.log: /var/log/ceph/ceph-client.admin.218209.log: /var/log/ceph/ceph-client.admin.44493.log: /var/log/ceph/ceph-client.admin.156168.log: /var/log/ceph/ceph-client.admin.97917.log: /var/log/ceph/ceph-client.admin.95450.log: /var/log/ceph/ceph-client.admin.176317.log: /var/log/ceph/ceph-client.admin.45800.log: /var/log/ceph/ceph-client.admin.172263.log: /var/log/ceph/ceph-client.admin.43836.log: /var/log/ceph/ceph-client.admin.133150.log: /var/log/ceph/ceph-client.admin.48744.log: /var/log/ceph/ceph-client.admin.37950.log: /var/log/ceph/ceph-client.admin.88226.log: /var/log/ceph/ceph-client.admin.47083.log: /var/log/ceph/ceph-client.admin.48964.log: /var/log/ceph/ceph-client.admin.191484.log: /var/log/ceph/ceph-client.admin.186468.log: /var/log/ceph/ceph-client.admin.225897.log: /var/log/ceph/ceph-client.admin.215595.log: /var/log/ceph/ceph-client.admin.190688.log: /var/log/ceph/ceph-client.admin.243128.log: /var/log/ceph/ceph-client.admin.186061.log: /var/log/ceph/ceph-client.admin.309583.log: /var/log/ceph/ceph-client.admin.189503.log: /var/log/ceph/ceph-client.admin.171844.log: /var/log/ceph/ceph-client.admin.157428.log: /var/log/ceph/ceph-client.admin.44004.log: /var/log/ceph/ceph-client.admin.339279.log: /var/log/ceph/ceph-client.admin.299512.log: /var/log/ceph/ceph-client.admin.110460.log: /var/log/ceph/ceph-client.admin.44388.log: /var/log/ceph/ceph-client.admin.283739.log: /var/log/ceph/ceph-client.admin.195315.log: /var/log/ceph/ceph-client.admin.241897.log: /var/log/ceph/ceph-client.admin.47800.log: /var/log/ceph/ceph-client.admin.318430.log: /var/log/ceph/ceph-client.admin.342880.log: /var/log/ceph/ceph-client.admin.197906.log: /var/log/ceph/ceph-client.admin.37962.log: /var/log/ceph/ceph-client.admin.223085.log: /var/log/ceph/ceph-client.admin.171417.log: /var/log/ceph/ceph-client.admin.218664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37962.log.gz 2023-09-10T09:22:42.452 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.270719.log: /var/log/ceph/ceph-client.admin.345767.log: /var/log/ceph/ceph-client.admin.290534.log: /var/log/ceph/ceph-client.admin.242290.log: /var/log/ceph/ceph-client.admin.38625.log: /var/log/ceph/ceph-client.admin.234824.log: /var/log/ceph/ceph-client.admin.197499.log: /var/log/ceph/ceph-client.admin.346421.log: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.489796.log.gz 2023-09-10T09:22:42.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.276321.log: /var/log/ceph/ceph-client.admin.100778.log: /var/log/ceph/ceph-client.admin.182426.log: /var/log/ceph/ceph-client.admin.307984.log: /var/log/ceph/ceph-client.admin.221875.log: /var/log/ceph/ceph-client.admin.222287.log: /var/log/ceph/ceph-client.admin.47906.log: /var/log/ceph/ceph-client.admin.231601.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.499355.log.gz 2023-09-10T09:22:42.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.314691.log: /var/log/ceph/ceph-client.admin.318439.log: /var/log/ceph/ceph-client.admin.244909.log: /var/log/ceph/ceph-client.admin.49977.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.427779.log.gz 2023-09-10T09:22:42.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.287742.log: /var/log/ceph/ceph-client.admin.337220.log: /var/log/ceph/ceph-client.admin.151071.log: /var/log/ceph/ceph-client.admin.343287.log: /var/log/ceph/ceph-client.admin.48089.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.422325.log.gz 2023-09-10T09:22:42.453 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.215604.log: /var/log/ceph/ceph-client.admin.48666.log: /var/log/ceph/ceph-client.admin.190697.log: /var/log/ceph/ceph-client.admin.206953.log: /var/log/ceph/ceph-client.admin.124340.log: /var/log/ceph/ceph-client.admin.175530.log: /var/log/ceph/ceph-client.admin.305075.log: /var/log/ceph/ceph-client.admin.45826.log: /var/log/ceph/ceph.tmp-client.admin.33087.log: /var/log/ceph/ceph-client.admin.48328.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33087.log.gz 2023-09-10T09:22:42.454 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3%/var/log/ceph/ceph-client.admin.279931.log: -- replaced with /var/log/ceph/ceph-client.admin.421937.log.gz 2023-09-10T09:22:42.454 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.335339.log: /var/log/ceph/ceph-client.admin.213926.log: /var/log/ceph/ceph-client.admin.219878.log: /var/log/ceph/ceph-client.admin.156575.log: /var/log/ceph/ceph-client.admin.149054.log: /var/log/ceph/ceph-client.admin.126486.log: /var/log/ceph/ceph-client.admin.310787.log: /var/log/ceph/ceph-client.admin.164615.log: /var/log/ceph/ceph-client.admin.48198.log: /var/log/ceph/ceph-client.admin.234396.log: /var/log/ceph/ceph-client.admin.183684.log: /var/log/ceph/ceph-client.admin.226703.log: /var/log/ceph/ceph-client.admin.302587.log: /var/log/ceph/ceph-client.admin.275130.log: /var/log/ceph/ceph-client.admin.46095.log: /var/log/ceph/ceph-client.admin.45982.log: /var/log/ceph/ceph-client.admin.309185.log: /var/log/ceph/ceph-client.admin.198296.log: /var/log/ceph/ceph-client.admin.290136.log: /var/log/ceph/ceph-client.admin.48172.log: /var/log/ceph/ceph-client.admin.112135.log: /var/log/ceph/ceph-client.admin.38147.log: /var/log/ceph/ceph-client.admin.236054.log: /var/log/ceph/ceph-client.admin.202364.log: /var/log/ceph/ceph-client.admin.84823.log: /var/log/ceph/ceph-client.admin.44888.log: /var/log/ceph/ceph-client.admin.167575.log: /var/log/ceph/ceph-client.admin.158767.log: /var/log/ceph/ceph-client.admin.94702.log: /var/log/ceph/ceph-client.admin.301656.log: /var/log/ceph/ceph-client.admin.203951.log: /var/log/ceph/ceph-client.admin.185672.log: /var/log/ceph/ceph-client.admin.317026.log: /var/log/ceph/ceph-client.admin.47592.log: /var/log/ceph/ceph-client.admin.299911.log: /var/log/ceph/ceph-client.admin.317035.log: /var/log/ceph/ceph-client.admin.196270.log: /var/log/ceph/ceph-client.admin.103570.log: /var/log/ceph/ceph-client.admin.286948.log: /var/log/ceph/ceph-client.admin.49501.log: /var/log/ceph/ceph-client.admin.47457.log: /var/log/ceph/ceph-client.admin.47351.log: /var/log/ceph/ceph-client.admin.303059.log: /var/log/ceph/ceph-client.admin.299503.log: /var/log/ceph/ceph-client.admin.48380.log: /var/log/ceph/ceph-client.admin.223877.log: /var/log/ceph/ceph-client.admin.191095.log: /var/log/ceph/ceph-client.admin.220281.log: /var/log/ceph/ceph-client.admin.305495.log: /var/log/ceph/ceph-client.admin.276330.log: /var/log/ceph/ceph-client.admin.297013.log: /var/log/ceph/ceph-client.admin.105171.log: /var/log/ceph/ceph-client.admin.121091.log: /var/log/ceph/ceph-client.admin.282054.log: /var/log/ceph/ceph-client.admin.38118.log: /var/log/ceph/ceph-client.admin.44985.log: /var/log/ceph/ceph-client.admin.100337.log: /var/log/ceph/ceph-client.admin.209060.log: /var/log/ceph/ceph-client.admin.38169.log: /var/log/ceph/ceph-client.admin.168856.log: /var/log/ceph/ceph-client.admin.213532.log: /var/log/ceph/ceph-client.admin.275520.log: /var/log/ceph/ceph-client.admin.83942.log: /var/log/ceph/ceph-client.admin.204750.log: /var/log/ceph/ceph-client.admin.156566.log: /var/log/ceph/ceph-client.admin.46719.log: /var/log/ceph/ceph-client.admin.297004.log: /var/log/ceph/ceph-client.admin.47644.log: /var/log/ceph/ceph-client.admin.43455.log: /var/log/ceph/ceph-client.admin.221083.log: /var/log/ceph/ceph-client.admin.113754.log: /var/log/ceph/ceph-client.admin.169710.log: /var/log/ceph/ceph-client.admin.293401.log: /var/log/ceph/ceph-client.admin.45193.log: /var/log/ceph/ceph-client.admin.293002.log: /var/log/ceph/ceph-client.admin.108768.log: /var/log/ceph/ceph-client.admin.187451.log: /var/log/ceph/ceph-client.admin.229213.log: /var/log/ceph/ceph-client.admin.320306.log: /var/log/ceph/ceph-client.admin.214724.log: /var/log/ceph/ceph-client.admin.222686.log: /var/log/ceph/ceph-client.admin.111304.log: /var/log/ceph/ceph-client.admin.280838.log: /var/log/ceph/ceph-client.admin.46693.log: /var/log/ceph/ceph-client.admin.223474.log: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.394028.log.gz 2023-09-10T09:22:42.454 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.317977.log: /var/log/ceph/ceph-client.admin.335348.log: /var/log/ceph/ceph-client.admin.193128.log: /var/log/ceph/ceph-client.admin.47161.log: /var/log/ceph/ceph-client.admin.230796.log: /var/log/ceph/ceph-client.admin.159288.log: /var/log/ceph/ceph-client.admin.182848.log: /var/log/ceph/ceph-client.admin.47748.log: /var/log/ceph/ceph-client.admin.48037.log: /var/log/ceph/ceph-client.admin.101177.log: /var/log/ceph/ceph-client.admin.112144.log: /var/log/ceph/ceph-client.admin.48276.log: /var/log/ceph/ceph-client.admin.188654.log: /var/log/ceph/ceph-client.admin.85231.log: /var/log/ceph/ceph-client.admin.95858.log: /var/log/ceph/ceph-client.admin.279940.log: /var/log/ceph/ceph-client.admin.340916.log: /var/log/ceph/ceph-client.admin.89478.log: /var/log/ceph/ceph-client.admin.104773.log: /var/log/ceph/ceph-client.admin.178718.log: /var/log/ceph/ceph-client.admin.226300.log: /var/log/ceph/ceph-client.admin.160718.log: /var/log/ceph/ceph-client.admin.216625.log: /var/log/ceph/ceph-client.admin.114152.log: /var/log/ceph/ceph-client.admin.130514.log: /var/log/ceph/ceph-client.admin.170563.log: /var/log/ceph/ceph-client.admin.296602.log: /var/log/ceph/ceph-client.admin.209051.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.422723.log.gz 2023-09-10T09:22:42.455 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47670.log: /var/log/ceph/ceph-client.admin.121895.log: /var/log/ceph/ceph-client.admin.308373.log: /var/log/ceph/ceph-client.admin.330301.log: /var/log/ceph/ceph-client.admin.149448.log: /var/log/ceph/ceph-client.admin.199525.log: /var/log/ceph/ceph-client.admin.273130.log: /var/log/ceph/ceph-client.admin.230805.log: /var/log/ceph/ceph-client.admin.216197.log: /var/log/ceph/ceph-client.admin.346565.log: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.469479.log.gz 2023-09-10T09:22:42.455 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44732.log: /var/log/ceph/ceph-client.admin.344140.log: /var/log/ceph/ceph-client.admin.49016.log: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.417863.log.gz 2023-09-10T09:22:42.455 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.150251.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469488.log.gz 2023-09-10T09:22:42.455 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48224.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469090.log.gz 2023-09-10T09:22:42.456 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.129187.log: /var/log/ceph/ceph-client.admin.315566.log: /var/log/ceph/ceph-client.admin.301203.log: /var/log/ceph/ceph-client.admin.199127.log: /var/log/ceph/ceph-client.admin.312555.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.417872.log.gz 2023-09-10T09:22:42.456 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.419065.log.gz 2023-09-10T09:22:42.456 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48250.log: /var/log/ceph/ceph-client.admin.108759.log: /var/log/ceph/ceph-client.admin.124747.log: /var/log/ceph/ceph-client.admin.218673.log: /var/log/ceph/ceph-client.admin.107555.log: /var/log/ceph/ceph-client.admin.83933.log: /var/log/ceph/ceph-client.admin.230398.log: /var/log/ceph/ceph-client.admin.209910.log: /var/log/ceph/ceph-client.admin.341305.log: /var/log/ceph/ceph-client.admin.342389.log: /var/log/ceph/ceph-client.admin.44914.log: /var/log/ceph/ceph-client.admin.161962.log: /var/log/ceph/ceph-client.admin.174732.log: /var/log/ceph/ceph-client.admin.315113.log: /var/log/ceph/ceph-client.admin.271526.log: /var/log/ceph/ceph-client.admin.123130.log: /var/log/ceph/ceph-client.admin.99507.log: /var/log/ceph/ceph-client.admin.46927.log: /var/log/ceph/ceph-client.admin.150663.log: /var/log/ceph/ceph-client.admin.48458.log: /var/log/ceph/ceph-client.admin.44056.log: /var/log/ceph/ceph-client.admin.307578.log: /var/log/ceph/ceph-client.admin.206962.log: /var/log/ceph/ceph-client.admin.102371.log: /var/log/ceph/ceph-client.admin.201506.log: /var/log/ceph/ceph-client.admin.48011.log: /var/log/ceph/ceph-client.admin.114161.log: /var/log/ceph/ceph-client.admin.187858.log: /var/log/ceph/ceph-client.admin.273917.log: /var/log/ceph/ceph-client.admin.284967.log: /var/log/ceph/ceph-client.admin.47109.log: /var/log/ceph/ceph-client.admin.49095.log: /var/log/ceph/ceph-client.admin.44836.log: /var/log/ceph/ceph-client.admin.49629.log: /var/log/ceph/ceph-client.admin.47057.log: /var/log/ceph/ceph-client.admin.37975.log: /var/log/ceph/ceph-client.admin.90275.log: /var/log/ceph/ceph-client.admin.207411.log: /var/log/ceph/ceph-client.admin.169283.log: /var/log/ceph/ceph-client.admin.284535.log: /var/log/ceph/ceph-client.admin.132201.log: /var/log/ceph/ceph-client.admin.48354.log: /var/log/ceph/ceph-client.admin.89087.log: /var/log/ceph/ceph-client.admin.278333.log: /var/log/ceph/ceph-client.admin.339677.log: /var/log/ceph/ceph-client.admin.37986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37986.log.gz 2023-09-10T09:22:42.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.213935.log: /var/log/ceph/ceph-client.admin.149457.log: /var/log/ceph/ceph-client.admin.292993.log: /var/log/ceph/ceph-client.admin.45384.log: /var/log/ceph/ceph-client.admin.231592.log: /var/log/ceph/ceph-client.admin.149855.log: /var/log/ceph/ceph-client.admin.197109.log: /var/log/ceph/ceph-client.admin.203162.log: /var/log/ceph/ceph-client.admin.246503.log: /var/log/ceph/ceph-client.admin.219062.log: /var/log/ceph/ceph-client.admin.336434.log: /var/log/ceph/ceph-client.admin.174723.log: /var/log/ceph/ceph-client.admin.201108.log: /var/log/ceph/ceph-client.admin.90284.log: /var/log/ceph/ceph-client.admin.233998.log: /var/log/ceph/ceph-client.admin.106365.log: /var/log/ceph/ceph-client.admin.175132.log: /var/log/ceph/ceph-client.admin.292594.log: /var/log/ceph/ceph-client.admin.49367.log: /var/log/ceph/ceph-client.admin.304652.log: /var/log/ceph/ceph-client.admin.311240.log: /var/log/ceph/ceph-client.admin.288536.log: /var/log/ceph/ceph-client.admin.219466.log: /var/log/ceph/ceph-client.admin.223076.log: /var/log/ceph/ceph-client.admin.44082.log: /var/log/ceph/ceph-client.admin.99900.log: /var/log/ceph/ceph-client.admin.181146.log: /var/log/ceph/ceph-client.admin.311249.log: /var/log/ceph/ceph-client.admin.49069.log: /var/log/ceph/ceph-client.admin.126053.log: /var/log/ceph/ceph-client.admin.244075.log: /var/log/ceph/ceph-client.admin.151468.log: /var/log/ceph/ceph-client.admin.38021.log: /var/log/ceph/ceph-client.admin.125596.log: /var/log/ceph/ceph-client.admin.317509.log: /var/log/ceph/ceph-client.admin.189043.log: /var/log/ceph/ceph-client.admin.97508.log: /var/log/ceph/ceph-client.admin.236870.log: /var/log/ceph/ceph-client.admin.181999.log: /var/log/ceph/ceph-client.admin.48432.log: /var/log/ceph/ceph-client.admin.216188.log: /var/log/ceph/ceph-client.admin.233193.log: /var/log/ceph/ceph-client.admin.227092.log: /var/log/ceph/ceph-client.admin.217413.log: /var/log/ceph/ceph-client.admin.177113.log: /var/log/ceph/ceph-client.admin.184876.log: /var/log/ceph/ceph-client.admin.188645.log: /var/log/ceph/ceph-client.admin.44862.log: /var/log/ceph/ceph-client.admin.43780.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.499017.log.gz 2023-09-10T09:22:42.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.212729.log: /var/log/ceph/ceph-client.admin.199118.log: /var/log/ceph/ceph-client.admin.226694.log: /var/log/ceph/ceph-client.admin.220272.log: /var/log/ceph/ceph-client.admin.211874.log: /var/log/ceph/ceph-client.admin.308382.log: /var/log/ceph/ceph-client.admin.86952.log: /var/log/ceph/ceph-client.admin.313013.log: /var/log/ceph/ceph-client.admin.333243.log: /var/log/ceph/ceph-client.admin.47324.log: /var/log/ceph/ceph-client.admin.194018.log: /var/log/ceph/ceph-client.admin.104375.log: /var/log/ceph/ceph-client.admin.236444.log: /var/log/ceph/ceph-client.admin.97092.log: /var/log/ceph/ceph-client.admin.175123.log: /var/log/ceph/ceph-client.admin.186871.log: /var/log/ceph/ceph-client.admin.181137.log: /var/log/ceph/ceph-client.admin.236453.log: /var/log/ceph/ceph-client.admin.169274.log: /var/log/ceph/ceph-client.admin.208650.log: /var/log/ceph/ceph-client.admin.310778.log: /var/log/ceph/ceph-client.admin.130091.log: /var/log/ceph/ceph-client.admin.149045.log: /var/log/ceph/ceph-client.admin.276727.log: /var/log/ceph/ceph-client.admin.283340.log: /var/log/ceph/ceph-client.admin.49225.log: /var/log/ceph/ceph-client.admin.49423.log: /var/log/ceph/ceph-client.admin.338467.log: /var/log/ceph/ceph-client.admin.124738.log: /var/log/ceph/ceph-client.admin.194448.log: /var/log/ceph/ceph-client.admin.44983.log: /var/log/ceph/ceph-client.admin.193590.log: /var/log/ceph/ceph-client.admin.288942.log: /var/log/ceph/ceph-client.admin.106755.log: /var/log/ceph/ceph-client.admin.305486.log: /var/log/ceph/ceph-client.admin.173534.log: /var/log/ceph/ceph-client.admin.114622.log: /var/log/ceph/ceph-client.admin.87767.log: /var/log/ceph/ceph-client.admin.114613.log: /var/log/ceph/ceph-client.admin.304643.log: /var/log/ceph/ceph-client.admin.132504.log: /var/log/ceph/ceph-client.admin.123544.log: /var/log/ceph/ceph-client.admin.49147.log: /var/log/ceph/ceph-client.admin.45878.log: /var/log/ceph/ceph-client.admin.291748.log: /var/log/ceph/ceph-client.admin.336831.log: /var/log/ceph/ceph-client.admin.44362.log: /var/log/ceph/ceph-client.admin.194886.log: /var/log/ceph/ceph-client.admin.272727.log: /var/log/ceph/ceph-client.admin.308778.log: /var/log/ceph/ceph-client.admin.166713.log: /var/log/ceph/ceph-client.admin.98315.log: /var/log/ceph/ceph-client.admin.226291.log: /var/log/ceph/ceph-client.admin.285765.log: /var/log/ceph/ceph-client.admin.334040.log: /var/log/ceph/ceph-client.admin.276718.log: /var/log/ceph/ceph-client.admin.87560.log: /var/log/ceph/ceph-client.admin.45410.log: /var/log/ceph/ceph-client.admin.133159.log: /var/log/ceph/ceph-client.admin.280829.log: /var/log/ceph/ceph-client.admin.309574.log: /var/log/ceph/ceph-client.admin.306757.log: /var/log/ceph/ceph-client.admin.121886.log: /var/log/ceph/ceph-client.admin.44623.log: /var/log/ceph/ceph-client.admin.217023.log: /var/log/ceph/ceph-client.admin.187849.log: /var/log/ceph/ceph-client.admin.109171.log: /var/log/ceph/ceph-client.admin.82063.log: /var/log/ceph/ceph-client.admin.47774.log: /var/log/ceph/ceph-client.admin.105958.log: /var/log/ceph/ceph-client.admin.108356.log: /var/log/ceph/ceph-client.admin.220675.log: /var/log/ceph/ceph-client.admin.200720.log: /var/log/ceph/ceph-client.admin.224276.log: /var/log/ceph/ceph-client.admin.49449.log: /var/log/ceph/ceph-client.admin.333650.log: /var/log/ceph/ceph-client.admin.336822.log: /var/log/ceph/ceph-client.admin.43674.log: /var/log/ceph/ceph-client.admin.155750.log: /var/log/ceph/ceph-client.admin.214324.log: /var/log/ceph/ceph-client.admin.282942.log: /var/log/ceph/ceph-client.admin.148258.log: /var/log/ceph/ceph-client.admin.312159.log: /var/log/ceph/ceph-client.admin.181990.log: /var/log/ceph/ceph-client.admin.105569.log: /var/log/ceph/ceph-client.admin.103172.log: /var/log/ceph/ceph-client.admin.179109.log: /var/log/ceph/ceph-client.admin.190290.log: /var/log/ceph/ceph-client.admin.172700.log: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.352024.log.gz 2023-09-10T09:22:42.457 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.199516.log: /var/log/ceph/ceph-client.admin.208659.log: /var/log/ceph/ceph-client.admin.342398.log: /var/log/ceph/ceph-client.admin.291739.log: /var/log/ceph/ceph-client.admin.166287.log: /var/log/ceph/ceph-client.admin.48588.log: /var/log/ceph/ceph-client.admin.346469.log: /var/log/ceph/ceph-client.admin.185265.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.352033.log.gz/var/log/ceph/ceph-client.admin.343278.log: 2023-09-10T09:22:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.234387.log: /var/log/ceph/ceph-client.admin.126477.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.351630.log.gz 2023-09-10T09:22:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44545.log: /var/log/ceph/ceph-client.admin.177122.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.352422.log.gz 2023-09-10T09:22:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.243137.log: /var/log/ceph/ceph-client.admin.167566.log: /var/log/ceph/ceph-client.admin.131811.log: /var/log/ceph/ceph-client.admin.203561.log: /var/log/ceph/ceph-client.admin.272319.log: /var/log/ceph/ceph-client.admin.123139.log: /var/log/ceph/ceph-client.admin.246512.log: /var/log/ceph/ceph-client.admin.157903.log: /var/log/ceph/ceph-client.admin.292603.log: /var/log/ceph/ceph-client.admin.38010.log: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.354055.log.gz 2023-09-10T09:22:42.458 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.277524.log: /var/log/ceph/ceph-client.admin.225888.log: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.354453.log.gz 2023-09-10T09:22:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.294596.log: /var/log/ceph/ceph-client.admin.338046.log: /var/log/ceph/ceph-client.admin.334477.log: /var/log/ceph/ceph-client.admin.47005.log: /var/log/ceph/ceph-client.admin.305084.log: /var/log/ceph/ceph-client.admin.308787.log: /var/log/ceph/ceph-client.admin.345776.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.354462.log.gz 2023-09-10T09:22:42.459 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4%/var/log/ceph/ceph-client.admin.179509.log: -- replaced with /var/log/ceph/ceph-client.admin.354064.log.gz 2023-09-10T09:22:42.459 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.85639.log: /var/log/ceph/ceph-client.admin.46771.log: /var/log/ceph/ceph-client.admin.213132.log: /var/log/ceph/ceph-client.admin.232389.log: /var/log/ceph/ceph-client.admin.333641.log: /var/log/ceph/ceph-client.admin.228019.log: /var/log/ceph/ceph-client.admin.159279.log: /var/log/ceph/ceph-client.admin.222278.log: /var/log/ceph/ceph-client.admin.244900.log: /var/log/ceph/ceph-client.admin.197897.log: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.355648.log.gz 2023-09-10T09:22:42.459 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.356047.log.gz 2023-09-10T09:22:42.460 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.334867.log: /var/log/ceph/ceph-client.admin.164606.log: /var/log/ceph/ceph-client.admin.231203.log: /var/log/ceph/ceph-client.admin.45184.log: /var/log/ceph/ceph-client.admin.162917.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.355258.log.gz 2023-09-10T09:22:42.460 INFO:teuthology.orchestra.run.smithi084.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.488531.log.gz 2023-09-10T09:22:42.460 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.355657.log.gz 2023-09-10T09:22:42.461 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.108365.log: /var/log/ceph/ceph-client.admin.296191.log: /var/log/ceph/ceph-client.admin.159928.log: /var/log/ceph/ceph-client.admin.122698.log: /var/log/ceph/ceph-client.admin.49527.log: /var/log/ceph/ceph-client.admin.45182.log: /var/log/ceph/ceph-client.admin.224679.log: /var/log/ceph/ceph-client.admin.46400.log: /var/log/ceph/ceph-client.admin.48692.log: /var/log/ceph/ceph-client.admin.45748.log: /var/log/ceph/ceph-client.admin.299902.log: /var/log/ceph/ceph-client.admin.189892.log: /var/log/ceph/ceph-client.admin.300731.log: /var/log/ceph/ceph-client.admin.48718.log: /var/log/ceph/ceph-client.admin.202754.log: /var/log/ceph/ceph-client.admin.49281.log: /var/log/ceph/ceph-client.admin.305893.log: /var/log/ceph/ceph-client.admin.103977.log: /var/log/ceph/ceph-client.admin.150654.log: /var/log/ceph/ceph-client.admin.245703.log: /var/log/ceph/ceph-client.admin.86047.log: /var/log/ceph/ceph-client.admin.313429.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.359296.log.gz 2023-09-10T09:22:42.461 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.359695.log.gz 2023-09-10T09:22:42.461 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.358898.log.gz 2023-09-10T09:22:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.172272.log: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.358469.log.gz 2023-09-10T09:22:42.462 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.358907.log.gz 2023-09-10T09:22:42.462 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.243588.log: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.383938.log.gz 2023-09-10T09:22:42.463 INFO:teuthology.orchestra.run.smithi084.stderr: 70.7% -- replaced with /var/log/ceph/ceph-client.admin.384770.log.gz 2023-09-10T09:22:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.192299.log: /var/log/ceph/ceph-client.admin.209485.log: /var/log/ceph/ceph-client.admin.163327.log: /var/log/ceph/ceph-client.admin.273926.log: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.384350.log.gz 2023-09-10T09:22:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.82054.log: /var/log/ceph/ceph-client.admin.331974.log: /var/log/ceph/ceph-client.admin.197100.log: /var/log/ceph/ceph-client.admin.330706.log: /var/log/ceph/ceph-client.admin.310370.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.383549.log.gz 2023-09-10T09:22:42.463 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47194.log: /var/log/ceph/ceph-client.admin.163751.log: /var/log/ceph/ceph-client.admin.200711.log: /var/log/ceph/ceph-client.admin.278324.log: /var/log/ceph/ceph-client.admin.281267.log: /var/log/ceph/ceph-client.admin.212720.log: /var/log/ceph/ceph-client.admin.344539.log: /var/log/ceph/ceph-client.admin.166722.log: /var/log/ceph/ceph-client.admin.269919.log: /var/log/ceph/ceph-client.admin.245308.log: /var/log/ceph/ceph-client.admin.88626.log: /var/log/ceph/ceph-client.admin.131802.log: /var/log/ceph/ceph-client.admin.338874.log: /var/log/ceph/ceph-client.admin.242299.log: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.413388.log.gz 2023-09-10T09:22:42.464 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.412094.log.gz 2023-09-10T09:22:42.464 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.304254.log: /var/log/ceph/ceph-client.admin.113352.log: /var/log/ceph/ceph-client.admin.196701.log: /var/log/ceph/ceph-client.admin.333252.log: 71.8%/var/log/ceph/ceph-client.admin.168419.log: -- replaced with /var/log/ceph/ceph-client.admin.360506.log.gz 2023-09-10T09:22:42.464 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.411705.log.gz 2023-09-10T09:22:42.465 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.360909.log.gz 2023-09-10T09:22:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.115020.log: /var/log/ceph/ceph-client.admin.194877.log: /var/log/ceph/ceph-client.admin.183675.log: /var/log/ceph/ceph-client.admin.48640.log: /var/log/ceph/ceph-client.admin.45411.log: /var/log/ceph/ceph-client.admin.312150.log: /var/log/ceph/ceph-client.admin.148249.log: /var/log/ceph/ceph-client.admin.83047.log: /var/log/ceph/ceph-client.admin.47854.log: /var/log/ceph/ceph-client.admin.339668.log: /var/log/ceph/ceph-client.admin.180307.log: /var/log/ceph/ceph-client.admin.206016.log: /var/log/ceph/ceph-client.admin.227101.log: /var/log/ceph/ceph-client.admin.123535.log: /var/log/ceph/ceph-client.admin.217811.log: /var/log/ceph/ceph-client.admin.277936.log: /var/log/ceph/ceph-client.admin.288545.log: /var/log/ceph/ceph-client.admin.225485.log: /var/log/ceph/ceph-client.admin.93797.log: /var/log/ceph/ceph-client.admin.176724.log: /var/log/ceph/ceph-client.admin.284137.log: /var/log/ceph/ceph-client.admin.290946.log: /var/log/ceph/ceph-client.admin.131404.log: /var/log/ceph/ceph-client.admin.112538.log: /var/log/ceph/ceph-client.admin.342000.log: /var/log/ceph/ceph-client.admin.212289.log: /var/log/ceph/ceph-client.admin.294605.log: /var/log/ceph/ceph-client.admin.45412.log: /var/log/ceph/ceph-client.admin.195306.log: /var/log/ceph/ceph-client.admin.167139.log: /var/log/ceph/ceph-client.admin.44158.log: /var/log/ceph/ceph-client.admin.131413.log: /var/log/ceph/ceph-client.admin.244501.log: /var/log/ceph/ceph-client.admin.37935.log: /var/log/ceph/ceph-client.admin.86038.log: /var/log/ceph/ceph-client.admin.289331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2023-09-10T09:22:42.465 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.97083.log: /var/log/ceph/ceph-client.admin.230009.log: /var/log/ceph/ceph-client.admin.165462.log: /var/log/ceph/ceph-client.admin.45409.log: /var/log/ceph/ceph-client.admin.101575.log: /var/log/ceph/ceph-client.admin.224285.log: /var/log/ceph/ceph-client.admin.47272.log: /var/log/ceph/ceph-client.admin.233600.log: /var/log/ceph/ceph-client.admin.205609.log: /var/log/ceph/ceph-client.admin.214733.log: /var/log/ceph/ceph-client.admin.171835.log: /var/log/ceph/ceph-client.admin.344965.log: /var/log/ceph/ceph-client.admin.157894.log: /var/log/ceph/ceph-client.admin.178309.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.344140.log.gz 2023-09-10T09:22:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.318883.log: /var/log/ceph/ceph-client.admin.188247.log: /var/log/ceph/ceph-client.admin.290937.log: /var/log/ceph/ceph-client.admin.46008.log: /var/log/ceph/ceph-client.admin.279118.log: /var/log/ceph/ceph-client.admin.282933.log: /var/log/ceph/ceph-client.admin.314293.log: /var/log/ceph/ceph-client.admin.311688.log: /var/log/ceph/ceph-client.admin.341991.log: /var/log/ceph/ceph-client.admin.218218.log: /var/log/ceph/ceph-client.admin.172691.log: /var/log/ceph/ceph-client.admin.177520.log: /var/log/ceph/ceph-client.admin.337643.log: /var/log/ceph/ceph-client.admin.179518.log: /var/log/ceph/ceph-client.admin.44994.log: /var/log/ceph/ceph-client.admin.107156.log: /var/log/ceph/ceph-client.admin.228417.log: /var/log/ceph/ceph-client.admin.110016.log: /var/log/ceph/ceph-client.admin.170554.log: /var/log/ceph/ceph-client.admin.309981.log: /var/log/ceph/ceph-client.admin.158298.log: /var/log/ceph/ceph-client.admin.49395.log: /var/log/ceph/ceph-client.admin.49579.log: /var/log/ceph/ceph-client.admin.103968.log: /var/log/ceph/ceph-client.admin.294996.log: /var/log/ceph/ceph-client.admin.38111.log: /var/log/ceph/ceph-client.admin.38161.log: /var/log/ceph/ceph-client.admin.292201.log: /var/log/ceph/ceph-client.admin.126044.log: /var/log/ceph/ceph-client.admin.38183.log: /var/log/ceph/ceph-client.admin.165034.log: /var/log/ceph/ceph-client.admin.245299.log: /var/log/ceph/ceph-client.admin.47932.log: /var/log/ceph/ceph-client.admin.271517.log: /var/log/ceph/ceph-client.admin.271127.log: /var/log/ceph/ceph-client.admin.231990.log: /var/log/ceph/ceph-client.admin.44597.log: /var/log/ceph/ceph-client.admin.152783.log: /var/log/ceph/ceph-client.admin.112951.log: /var/log/ceph/ceph-client.admin.296611.log: /var/log/ceph/ceph-client.admin.290127.log: /var/log/ceph/ceph-client.admin.221481.log: /var/log/ceph/ceph-client.admin.101566.log: /var/log/ceph/ceph-client.admin.157437.log: /var/log/ceph/ceph-client.admin.295403.log: /var/log/ceph/ceph-client.admin.95441.log: /var/log/ceph/ceph-client.admin.161953.log: /var/log/ceph/ceph-client.admin.129601.log: /var/log/ceph/ceph-client.admin.160318.log: /var/log/ceph/ceph-client.admin.230000.log: /var/log/ceph/ceph-client.admin.339270.log: /var/log/ceph/ceph-client.admin.306328.log: /var/log/ceph/ceph-client.admin.228010.log: /var/log/ceph/ceph-client.admin.307569.log: /var/log/ceph/ceph-client.admin.44993.log: /var/log/ceph/ceph-client.admin.173525.log: /var/log/ceph/ceph-client.admin.315104.log: /var/log/ceph/ceph-client.admin.43896.log: /var/log/ceph/ceph-client.admin.86491.log: /var/log/ceph/ceph-client.admin.46667.log: /var/log/ceph/ceph-client.admin.231999.log: /var/log/ceph/ceph-client.admin.317500.log: /var/log/ceph/ceph-client.admin.47618.log: /var/log/ceph/ceph-client.admin.303050.log: /var/log/ceph/ceph-client.admin.38518.log: /var/log/ceph/ceph-client.admin.43952.log: /var/log/ceph/ceph-client.admin.180710.log: /var/log/ceph/ceph-client.admin.185663.log: /var/log/ceph/ceph-client.admin.48484.log: /var/log/ceph/ceph-client.admin.307975.log: /var/log/ceph/ceph-client.admin.48841.log: /var/log/ceph/ceph-client.admin.46426.log: /var/log/ceph/ceph-client.admin.88635.log: /var/log/ceph/ceph-client.admin.271916.log: 69.0%/var/log/ceph/ceph-client.admin.44680.log: -- replaced with /var/log/ceph/ceph-client.admin.361312.log.gz 2023-09-10T09:22:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.343729.log: /var/log/ceph/ceph-client.admin.154498.log: /var/log/ceph/ceph-client.admin.150260.log: /var/log/ceph/ceph-client.admin.277121.log: /var/log/ceph/ceph-client.admin.278721.log: /var/log/ceph/ceph-client.admin.195770.log: /var/log/ceph/ceph-client.admin.89886.log: /var/log/ceph/ceph-client.admin.184073.log: /var/log/ceph/ceph-client.admin.277533.log: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.362112.log.gz 2023-09-10T09:22:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.220684.log: /var/log/ceph/ceph-client.admin.207402.log: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.362510.log.gz 2023-09-10T09:22:42.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.278730.log: /var/log/ceph/ceph-client.admin.47540.log: /var/log/ceph/ceph-client.admin.337652.log: /var/log/ceph/ceph-client.admin.346525.log: /var/log/ceph/ceph-client.admin.170137.log: /var/log/ceph/ceph-client.admin.43523.log: /var/log/ceph/ceph-client.admin.211865.log: /var/log/ceph/ceph-client.admin.338865.log: /var/log/ceph/ceph-client.admin.295394.log: /var/log/ceph/ceph-client.admin.38192.log: /var/log/ceph/ceph-client.admin.109613.log: /var/log/ceph/ceph-client.admin.43926.log: /var/log/ceph/ceph-client.admin.300740.log: /var/log/ceph/ceph-client.admin.282451.log: /var/log/ceph/ceph-client.admin.346478.log: /var/log/ceph/ceph-client.admin.168002.log: /var/log/ceph/ceph-client.admin.86943.log: /var/log/ceph/ceph-client.admin.46537.log: /var/log/ceph/ceph-client.admin.302125.log: /var/log/ceph/ceph-client.admin.191086.log: /var/log/ceph/ceph-client.admin.178709.log: /var/log/ceph/ceph-client.admin.303846.log: /var/log/ceph/ceph-client.admin.100346.log: /var/log/ceph/ceph-client.admin.43870.log: /var/log/ceph/ceph-client.admin.176326.log: /var/log/ceph/ceph-client.admin.180316.log: /var/log/ceph/ceph-client.admin.173927.log: /var/log/ceph/ceph-client.admin.103579.log: /var/log/ceph/ceph-client.admin.44706.log: /var/log/ceph/ceph-client.admin.212298.log: /var/log/ceph/ceph-client.admin.107964.log: /var/log/ceph/ceph-client.admin.110451.log: /var/log/ceph/ceph-client.admin.184867.log: /var/log/ceph/ceph-client.admin.279127.log: /var/log/ceph/ceph-client.admin.275923.log: /var/log/ceph/ceph-client.admin.346516.log: /var/log/ceph/ceph-client.admin.286162.log: /var/log/ceph/ceph-client.admin.45202.log: /var/log/ceph/ceph-client.admin.316545.log: /var/log/ceph/ceph-client.admin.121082.log: /var/log/ceph/ceph-client.admin.105162.log: /var/log/ceph/ceph-client.admin.274324.log: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.401306.log.gz 2023-09-10T09:22:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44030.log: /var/log/ceph/ceph-client.admin.173123.log: /var/log/ceph/ceph-client.admin.317968.log: /var/log/ceph/ceph-client.admin.217014.log: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.473459.log.gz 2023-09-10T09:22:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.129592.log: /var/log/ceph/ceph-client.admin.45201.log: /var/log/ceph/ceph-client.admin.109162.log: /var/log/ceph/ceph-client.admin.204350.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.400917.log.gz 2023-09-10T09:22:42.467 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.163760.log: /var/log/ceph/ceph-client.admin.292192.log: /var/log/ceph/ceph-client.admin.155315.log: /var/log/ceph/ceph-client.admin.207863.log: /var/log/ceph/ceph-client.admin.198695.log: /var/log/ceph/ceph-client.admin.196261.log: /var/log/ceph/ceph-client.admin.341314.log: /var/log/ceph/ceph-client.admin.221884.log: /var/log/ceph/ceph-client.admin.45196.log: /var/log/ceph/ceph-client.admin.289340.log: /var/log/ceph/ceph-client.admin.44466.log: /var/log/ceph/ceph-client.admin.215175.log: /var/log/ceph/ceph-client.admin.161563.log: /var/log/ceph/ceph-client.admin.46797.log: /var/log/ceph/ceph-client.admin.111295.log: /var/log/ceph/ceph-client.admin.37999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37999.log.gz 2023-09-10T09:22:42.468 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47405.log: /var/log/ceph/ceph-client.admin.191493.log: /var/log/ceph/ceph-client.admin.311697.log: /var/log/ceph/ceph-client.admin.44977.log: /var/log/ceph/ceph-client.admin.284128.log: /var/log/ceph/ceph-client.admin.242704.log: /var/log/ceph/ceph-client.admin.46034.log: /var/log/ceph/ceph-client.admin.246905.log: /var/log/ceph/ceph-client.admin.46262.log: /var/log/ceph/ceph-client.admin.48063.log: /var/log/ceph/ceph-client.admin.99101.log: /var/log/ceph/ceph-client.admin.87551.log: /var/log/ceph/ceph-client.admin.47566.log: /var/log/ceph/ceph-client.admin.235646.log: /var/log/ceph/ceph-client.admin.196710.log: /var/log/ceph/ceph-client.admin.49253.log: /var/log/ceph/ceph-client.admin.346174.log: /var/log/ceph/ceph-client.admin.274718.log: /var/log/ceph/ceph-client.admin.203960.log: /var/log/ceph/ceph-client.admin.130523.log: /var/log/ceph/ceph-client.admin.336036.log: /var/log/ceph/ceph-client.admin.186070.log: /var/log/ceph/ceph-client.admin.202355.log: /var/log/ceph/ceph-client.admin.47431.log: /var/log/ceph/ceph-client.admin.45406.log: /var/log/ceph/ceph-client.admin.170982.log: /var/log/ceph/ceph-client.admin.225494.log: /var/log/ceph/ceph-client.admin.300310.log: /var/log/ceph/ceph-client.admin.214333.log: /var/log/ceph/ceph-client.admin.337229.log: /var/log/ceph/ceph-client.admin.334468.log: /var/log/ceph/ceph-client.admin.283730.log: /var/log/ceph/ceph-client.admin.132752.log: /var/log/ceph/ceph-client.admin.148656.log: /var/log/ceph/ceph-client.admin.104764.log: /var/log/ceph/ceph-client.admin.147846.log: /var/log/ceph/ceph-client.admin.230407.log: /var/log/ceph/ceph-client.admin.344530.log: /var/log/ceph/ceph-client.admin.47514.log: /var/log/ceph/ceph-client.admin.154489.log: /var/log/ceph/ceph-client.admin.192290.log: /var/log/ceph/ceph-client.admin.88235.log: /var/log/ceph/ceph-client.admin.131004.log: /var/log/ceph/ceph-client.admin.99498.log: /var/log/ceph/ceph-client.admin.284958.log: /var/log/ceph/ceph-client.admin.48510.log: /var/log/ceph/ceph-client.admin.48536.log: /var/log/ceph/ceph-client.admin.44281.log: /var/log/ceph/ceph-client.admin.154925.log: /var/log/ceph/ceph-client.admin.38153.log: /var/log/ceph/ceph-client.admin.44519.log: /var/log/ceph/ceph-client.admin.184479.log: /var/log/ceph/ceph-client.admin.48406.log: /var/log/ceph/ceph-client.admin.44654.log: /var/log/ceph/ceph-client.admin.102380.log: /var/log/ceph/ceph-client.admin.152774.log: /var/log/ceph/ceph-client.admin.45774.log: /var/log/ceph/ceph-client.admin.334876.log: /var/log/ceph/ceph-client.admin.101977.log: /var/log/ceph/ceph-client.admin.168428.log: /var/log/ceph/ceph-client.admin.305884.log: /var/log/ceph/ceph-client.admin.281665.log: /var/log/ceph/ceph-client.admin.301194.log: /var/log/ceph/ceph-client.admin.98306.log: /var/log/ceph/ceph-client.admin.286153.log: /var/log/ceph/ceph-client.admin.273121.log: /var/log/ceph/ceph-client.admin.284526.log: /var/log/ceph/ceph-client.admin.132513.log: /var/log/ceph/ceph-client.admin.89487.log: /var/log/ceph/ceph-client.admin.165043.log: /var/log/ceph/ceph-client.admin.43556.log: /var/log/ceph/ceph-client.admin.178318.log: /var/log/ceph/ceph-client.admin.270326.log: /var/log/ceph/ceph-client.admin.330697.log: /var/log/ceph/ceph-client.admin.43808.log: /var/log/ceph/ceph-client.admin.44981.log: /var/log/ceph/ceph-client.admin.309972.log: /var/log/ceph/ceph-client.admin.315575.log: /var/log/ceph/ceph-client.admin.277927.log: /var/log/ceph/ceph-client.admin.84832.log: /var/log/ceph/ceph-client.admin.45198.log: /var/log/ceph/ceph-client.admin.244066.log: /var/log/ceph/ceph-client.admin.301665.log: /var/log/ceph/ceph-client.admin.161554.log: /var/log/ceph/ceph-client.admin.112942.log: /var/log/ceph/ceph-client.admin.48302.log: /var/log/ceph/ceph-client.admin.94248.log: /var/log/ceph/ceph-client.admin.160327.log: /var/log/ceph/ceph-client.admin.198305.log: /var/log/ceph/ceph-client.admin.227532.log: /var/log/ceph/ceph-client.admin.189494.log: /var/log/ceph/ceph-client.admin.46849.log: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.392385.log.gz 74.3% 2023-09-10T09:22:42.468 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.392790.log.gz 2023-09-10T09:22:42.468 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.392394.log.gz 2023-09-10T09:22:42.468 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.188256.log.gz 2023-09-10T09:22:42.469 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.214724.log.gz 2023-09-10T09:22:42.469 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.194457.log.gz 2023-09-10T09:22:42.469 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.243588.log.gz 2023-09-10T09:22:42.470 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.402274.log.gz 2023-09-10T09:22:42.471 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.402283.log.gz 2023-09-10T09:22:42.471 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.346430.log.gz 2023-09-10T09:22:42.471 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2023-09-10T09:22:42.471 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.472 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2023-09-10T09:22:42.472 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2023-09-10T09:22:42.472 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.399033.log.gz 2023-09-10T09:22:42.473 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.398579.log.gz 2023-09-10T09:22:42.474 INFO:teuthology.orchestra.run.smithi084.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.478917.log.gz 2023-09-10T09:22:42.505 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.478463.log.gz 2023-09-10T09:22:42.507 INFO:teuthology.orchestra.run.smithi084.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.479780.log.gz 2023-09-10T09:22:42.530 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.230805.log.gz 2023-09-10T09:22:42.532 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.235646.log.gz 2023-09-10T09:22:42.532 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.235256.log.gz 2023-09-10T09:22:42.534 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.220684.log.gz 2023-09-10T09:22:42.535 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.222278.log.gz 2023-09-10T09:22:42.535 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.221884.log.gz 2023-09-10T09:22:42.536 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.224276.log.gz 2023-09-10T09:22:42.537 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.223877.log.gz 2023-09-10T09:22:42.537 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.223886.log.gz 2023-09-10T09:22:42.541 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.105162.log.gz 2023-09-10T09:22:42.543 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.88626.log.gz 2023-09-10T09:22:42.544 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% 69.0% -- replaced with /var/log/ceph/ceph-client.admin.88235.log.gz 2023-09-10T09:22:42.544 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.408395.log.gz 2023-09-10T09:22:42.554 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.130514.log.gz 2023-09-10T09:22:42.554 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.131004.log.gz 2023-09-10T09:22:42.559 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.155324.log.gz 2023-09-10T09:22:42.564 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.369776.log.gz 2023-09-10T09:22:42.566 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.388663.log.gz 2023-09-10T09:22:42.567 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.388672.log.gz 2023-09-10T09:22:42.570 INFO:teuthology.orchestra.run.smithi084.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.479348.log.gz 2023-09-10T09:22:42.571 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.357670.log.gz 2023-09-10T09:22:42.580 INFO:teuthology.orchestra.run.smithi084.stderr: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.126044.log.gz 2023-09-10T09:22:42.581 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.123139.log.gz 2023-09-10T09:22:42.586 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.89886.log.gz 2023-09-10T09:22:42.592 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.404840.log.gz 2023-09-10T09:22:42.593 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.404387.log.gz 2023-09-10T09:22:42.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.404849.log.gz 2023-09-10T09:22:42.594 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.406103.log.gz 2023-09-10T09:22:42.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.405711.log.gz 2023-09-10T09:22:42.605 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.301194.log.gz 2023-09-10T09:22:42.606 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.301203.log.gz 2023-09-10T09:22:42.607 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.303846.log.gz 2023-09-10T09:22:42.608 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.303855.log.gz 2023-09-10T09:22:42.610 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.308778.log.gz 2023-09-10T09:22:42.611 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.416664.log.gz 2023-09-10T09:22:42.611 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.308382.log.gz 2023-09-10T09:22:42.611 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.308787.log.gz 2023-09-10T09:22:42.612 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.417074.log.gz 2023-09-10T09:22:42.623 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.185663.log.gz 2023-09-10T09:22:42.626 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.472274.log.gz 2023-09-10T09:22:42.627 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.346779.log.gz 2023-09-10T09:22:42.628 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.386979.log.gz 2023-09-10T09:22:42.636 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.196701.log.gz 2023-09-10T09:22:42.637 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.196710.log.gz 2023-09-10T09:22:42.638 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.413397.log.gz 2023-09-10T09:22:42.638 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.421531.log.gz 2023-09-10T09:22:42.641 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.367346.log.gz 2023-09-10T09:22:42.642 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367355.log.gz 2023-09-10T09:22:42.642 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.368946.log.gz 2023-09-10T09:22:42.643 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.368153.log.gz 2023-09-10T09:22:42.643 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.400444.log.gz 2023-09-10T09:22:42.644 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.399042.log.gz 2023-09-10T09:22:42.644 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.400453.log.gz 2023-09-10T09:22:42.645 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.473468.log.gz 2023-09-10T09:22:42.662 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.179109.log.gz 2023-09-10T09:22:42.669 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.286153.log.gz 2023-09-10T09:22:42.670 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.286162.log.gz 2023-09-10T09:22:42.675 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.420669.log.gz 2023-09-10T09:22:42.676 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420279.log.gz 2023-09-10T09:22:42.693 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.423693.log.gz 2023-09-10T09:22:42.724 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.334049.log.gz 2023-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.369358.log.gz 2023-09-10T09:22:42.733 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.403914.log.gz 2023-09-10T09:22:42.735 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.465497.log.gz 2023-09-10T09:22:42.740 INFO:teuthology.orchestra.run.smithi084.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.371822.log.gz 2023-09-10T09:22:42.755 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.474686.log.gz 2023-09-10T09:22:42.764 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.280344.log.gz 2023-09-10T09:22:42.764 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.351621.log.gz 2023-09-10T09:22:42.765 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.358064.log.gz 2023-09-10T09:22:42.765 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.352431.log.gz 2023-09-10T09:22:42.785 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-10T09:22:42.793 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.423684.log.gz 2023-09-10T09:22:42.793 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.423258.log.gz 2023-09-10T09:22:42.793 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.467080.log.gz 2023-09-10T09:22:42.795 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.468287.log.gz 2023-09-10T09:22:42.796 INFO:teuthology.orchestra.run.smithi084.stderr: 64.6% -- replaced with /var/log/ceph/ceph-client.admin.473061.log.gz 2023-09-10T09:22:42.796 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.471071.log.gz 2023-09-10T09:22:42.797 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.473070.log.gz 2023-09-10T09:22:42.797 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% 92.5% -- replaced with /var/log/ceph/ceph-client.admin.394845.log.gz 2023-09-10T09:22:42.797 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.183255.log.gz 2023-09-10T09:22:42.798 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.415398.log.gz 2023-09-10T09:22:42.798 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.418261.log.gz 2023-09-10T09:22:42.799 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.465089.log.gz 2023-09-10T09:22:42.799 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.470673.log.gz 2023-09-10T09:22:42.800 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.417473.log.gz 2023-09-10T09:22:42.814 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.386970.log.gz 2023-09-10T09:22:42.816 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.411250.log.gz 2023-09-10T09:22:42.817 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.361718.log.gz 2023-09-10T09:22:42.817 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.399989.log.gz 2023-09-10T09:22:42.818 INFO:teuthology.orchestra.run.smithi084.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.382742.log.gz 2023-09-10T09:22:42.847 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.398570.log.gz 2023-09-10T09:22:42.875 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.349985.log.gz 2023-09-10T09:22:42.877 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% 70.9% -- replaced with /var/log/ceph/ceph-client.admin.371408.log.gz -- replaced with /var/log/ceph/ceph-client.admin.370974.log.gz 2023-09-10T09:22:42.877 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.878 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.424150.log.gz 2023-09-10T09:22:42.878 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.370586.log.gz 2023-09-10T09:22:42.879 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.389063.log.gz 2023-09-10T09:22:42.880 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.391462.log.gz 2023-09-10T09:22:42.881 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.472265.log.gz 2023-09-10T09:22:42.898 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.371813.log.gz 2023-09-10T09:22:42.900 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.389466.log.gz 2023-09-10T09:22:42.912 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.353255.log.gz 2023-09-10T09:22:42.913 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.353657.log.gz 2023-09-10T09:22:42.913 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.354851.log.gz 2023-09-10T09:22:42.913 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.356450.log.gz 2023-09-10T09:22:42.946 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.466293.log.gz 2023-09-10T09:22:42.948 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.466691.log.gz 2023-09-10T09:22:42.960 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.333252.log.gz 2023-09-10T09:22:42.961 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.368542.log.gz 2023-09-10T09:22:42.961 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367755.log.gz 2023-09-10T09:22:42.963 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.416673.log.gz 2023-09-10T09:22:42.969 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.426147.log.gz 2023-09-10T09:22:42.970 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424960.log.gz 2023-09-10T09:22:42.971 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% 68.9% -- replaced with /var/log/ceph/ceph-client.admin.425349.log.gz -- replaced with /var/log/ceph/ceph-client.admin.426547.log.gz 2023-09-10T09:22:42.971 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:42.972 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.426944.log.gz 2023-09-10T09:22:42.972 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.425747.log.gz 2023-09-10T09:22:42.972 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.427375.log.gz 2023-09-10T09:22:42.973 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.426556.log.gz 2023-09-10T09:22:42.973 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.471867.log.gz 2023-09-10T09:22:42.973 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.425358.log.gz 2023-09-10T09:22:42.973 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.408859.log.gz 2023-09-10T09:22:42.974 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.393188.log.gz 2023-09-10T09:22:42.975 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.425756.log.gz 2023-09-10T09:22:42.975 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.426156.log.gz 2023-09-10T09:22:42.976 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.364931.log.gz 2023-09-10T09:22:42.976 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.361709.log.gz 2023-09-10T09:22:42.976 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.410065.log.gz 2023-09-10T09:22:42.976 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.385653.log.gz 2023-09-10T09:22:42.977 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.361321.log.gz 2023-09-10T09:22:42.981 INFO:teuthology.orchestra.run.smithi084.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.384359.log.gz 2023-09-10T09:22:42.985 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2023-09-10T09:22:42.990 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.421092.log.gz 2023-09-10T09:22:43.020 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2023-09-10T09:22:43.021 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.362917.log.gz 2023-09-10T09:22:43.023 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.364144.log.gz 2023-09-10T09:22:43.024 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.350388.log.gz 2023-09-10T09:22:43.036 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.482986.log.gz 2023-09-10T09:22:43.041 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.409667.log.gz 2023-09-10T09:22:43.070 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.370179.log.gz 2023-09-10T09:22:43.070 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.391866.log.gz 2023-09-10T09:22:43.071 INFO:teuthology.orchestra.run.smithi084.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.473866.log.gz 2023-09-10T09:22:43.099 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353264.log.gz 2023-09-10T09:22:43.100 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.356847.log.gz 2023-09-10T09:22:43.100 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.356856.log.gz 2023-09-10T09:22:43.102 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.388242.log.gz 2023-09-10T09:22:43.106 INFO:teuthology.orchestra.run.smithi084.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.351224.log.gz 2023-09-10T09:22:43.113 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.467490.log.gz 2023-09-10T09:22:43.118 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.372433.log.gz 2023-09-10T09:22:43.119 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372442.log.gz 2023-09-10T09:22:43.119 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.372836.log.gz 2023-09-10T09:22:43.120 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.373632.log.gz 2023-09-10T09:22:43.120 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.381494.log.gz 2023-09-10T09:22:43.122 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.395287.log.gz 2023-09-10T09:22:43.122 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372039.log.gz 2023-09-10T09:22:43.123 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.395685.log.gz 2023-09-10T09:22:43.123 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.396083.log.gz 2023-09-10T09:22:43.124 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.396879.log.gz 2023-09-10T09:22:43.124 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.396481.log.gz 2023-09-10T09:22:43.126 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.468685.log.gz 2023-09-10T09:22:43.127 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.396490.log.gz 2023-09-10T09:22:43.127 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.403092.log.gz 2023-09-10T09:22:43.128 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.467889.log.gz 2023-09-10T09:22:43.129 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.348348.log.gz 2023-09-10T09:22:43.129 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.349976.log.gz 2023-09-10T09:22:43.129 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.414999.log.gz 2023-09-10T09:22:43.130 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.418660.log.gz 2023-09-10T09:22:43.131 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.410056.log.gz 2023-09-10T09:22:43.131 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.400908.log.gz 2023-09-10T09:22:43.131 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.471478.log.gz 2023-09-10T09:22:43.131 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.412935.log.gz 2023-09-10T09:22:43.133 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.474695.log.gz 2023-09-10T09:22:43.144 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.364542.log.gz 2023-09-10T09:22:43.145 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45592.log.gz 2023-09-10T09:22:43.145 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46563.log.gz 2023-09-10T09:22:43.146 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2023-09-10T09:22:43.146 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2023-09-10T09:22:43.163 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421540.log.gz 2023-09-10T09:22:43.173 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.391471.log.gz 2023-09-10T09:22:43.189 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.371692.log.gz 2023-09-10T09:22:43.218 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.316064.log.gz 2023-09-10T09:22:43.224 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.186459.log.gz 2023-09-10T09:22:43.224 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.185274.log.gz 2023-09-10T09:22:43.230 INFO:teuthology.orchestra.run.smithi084.stderr: 73.9% -- replaced with /var/log/ceph/ceph-client.admin.468278.log.gz 2023-09-10T09:22:43.250 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.370983.log.gz 2023-09-10T09:22:43.261 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.316055.log.gz 2023-09-10T09:22:43.266 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.472663.log.gz 2023-09-10T09:22:43.278 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50003.log.gz 2023-09-10T09:22:43.281 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.164187.log.gz 2023-09-10T09:22:43.295 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.190299.log.gz 2023-09-10T09:22:43.297 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197508.log.gz 2023-09-10T09:22:43.299 INFO:teuthology.orchestra.run.smithi084.stderr: 69.8% -- replaced with /var/log/ceph/ceph-client.admin.205181.log.gz 2023-09-10T09:22:43.299 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.184082.log.gz 2023-09-10T09:22:43.303 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.427788.log.gz 2023-09-10T09:22:43.322 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.412502.log.gz 2023-09-10T09:22:43.330 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.406112.log.gz 2023-09-10T09:22:43.333 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47246.log.gz 2023-09-10T09:22:43.347 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.426953.log.gz 2023-09-10T09:22:43.376 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.393595.log.gz 2023-09-10T09:22:43.386 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.109604.log.gz 2023-09-10T09:22:43.389 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.112547.log.gz 2023-09-10T09:22:43.390 INFO:teuthology.orchestra.run.smithi084.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.363315.log.gz 2023-09-10T09:22:43.403 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49199.log.gz 2023-09-10T09:22:43.408 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2023-09-10T09:22:43.411 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.227523.log.gz 2023-09-10T09:22:43.415 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47828.log.gz 2023-09-10T09:22:43.417 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2023-09-10T09:22:43.420 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2023-09-10T09:22:43.428 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.228408.log.gz 2023-09-10T09:22:43.429 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.229602.log.gz 2023-09-10T09:22:43.443 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.213123.log.gz 2023-09-10T09:22:43.446 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.362121.log.gz 2023-09-10T09:22:43.448 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342889.log.gz 2023-09-10T09:22:43.461 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.403491.log.gz 2023-09-10T09:22:43.464 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.273519.log.gz 2023-09-10T09:22:43.465 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.320297.log.gz 2023-09-10T09:22:43.469 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.338055.log.gz 2023-09-10T09:22:43.472 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.201515.log.gz 2023-09-10T09:22:43.478 INFO:teuthology.orchestra.run.smithi084.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.243597.log.gz 2023-09-10T09:22:43.517 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.167148.log.gz 2023-09-10T09:22:43.535 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.166722.log.gz 2023-09-10T09:22:43.538 INFO:teuthology.orchestra.run.smithi084.stderr: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.350379.log.gz 2023-09-10T09:22:43.552 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.115011.log.gz 2023-09-10T09:22:43.553 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.235247.log.gz 2023-09-10T09:22:43.560 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48614.log.gz 2023-09-10T09:22:43.561 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49173.log.gz 2023-09-10T09:22:43.562 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.156177.log.gz 2023-09-10T09:22:43.567 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2023-09-10T09:22:43.570 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49553.log.gz 2023-09-10T09:22:43.573 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.246101.log.gz 2023-09-10T09:22:43.584 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44758.log.gz 2023-09-10T09:22:43.589 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.154916.log.gz 2023-09-10T09:22:43.591 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.192688.log.gz 2023-09-10T09:22:43.592 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.207854.log.gz 2023-09-10T09:22:43.592 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.306319.log.gz 2023-09-10T09:22:43.594 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.387382.log.gz 2023-09-10T09:22:43.598 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47880.log.gz 2023-09-10T09:22:43.599 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2023-09-10T09:22:43.636 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.165869.log.gz 2023-09-10T09:22:43.642 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.399516.log.gz 2023-09-10T09:22:43.644 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.364940.log.gz 2023-09-10T09:22:43.662 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.270317.log.gz 2023-09-10T09:22:43.664 INFO:teuthology.orchestra.run.smithi084.stderr: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.272718.log.gz 2023-09-10T09:22:43.677 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2023-09-10T09:22:43.681 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.182857.log.gz 2023-09-10T09:22:43.687 INFO:teuthology.orchestra.run.smithi084.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.234815.log.gz 2023-09-10T09:22:43.688 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.229611.log.gz 2023-09-10T09:22:43.692 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.107955.log.gz 2023-09-10T09:22:43.709 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.235655.log.gz 2023-09-10T09:22:43.712 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.130082.log.gz 2023-09-10T09:22:43.713 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.123950.log.gz 2023-09-10T09:22:43.714 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.151886.log.gz 2023-09-10T09:22:43.716 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.246110.log.gz 2023-09-10T09:22:43.720 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.179908.log.gz 2023-09-10T09:22:43.725 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.176715.log.gz 2023-09-10T09:22:43.726 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.183246.log.gz 2023-09-10T09:22:43.746 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.288933.log.gz 2023-09-10T09:22:43.748 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.293392.log.gz 2023-09-10T09:22:43.748 INFO:teuthology.orchestra.run.smithi084.stderr: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.293791.log.gz 2023-09-10T09:22:43.749 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.291340.log.gz 2023-09-10T09:22:43.750 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.295792.log.gz 2023-09-10T09:22:43.753 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.275529.log.gz 2023-09-10T09:22:43.754 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.288139.log.gz 2023-09-10T09:22:43.755 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.288148.log.gz 2023-09-10T09:22:43.761 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.296200.log.gz 2023-09-10T09:22:43.765 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.302134.log.gz 2023-09-10T09:22:43.769 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.161116.log.gz 2023-09-10T09:22:43.770 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.193581.log.gz 2023-09-10T09:22:43.791 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.180719.log.gz 2023-09-10T09:22:43.805 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.203153.log.gz 2023-09-10T09:22:43.843 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.232398.log.gz 2023-09-10T09:22:43.846 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.313819.log.gz 2023-09-10T09:22:43.849 INFO:teuthology.orchestra.run.smithi084.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.46214.log.gz 87.6% 2023-09-10T09:22:43.849 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2023-09-10T09:22:43.874 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.232797.log.gz 2023-09-10T09:22:43.875 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.156997.log.gz 2023-09-10T09:22:43.876 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.131013.log.gz 2023-09-10T09:22:43.881 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.174325.log.gz 2023-09-10T09:22:43.904 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.97917.log.gz 2023-09-10T09:22:43.909 INFO:teuthology.orchestra.run.smithi084.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.221472.log.gz 2023-09-10T09:22:43.920 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.49683.log.gz 2023-09-10T09:22:43.925 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.132210.log.gz 2023-09-10T09:22:43.930 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.96258.log.gz 2023-09-10T09:22:43.932 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.171408.log.gz 2023-09-10T09:22:43.934 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.176317.log.gz 2023-09-10T09:22:43.935 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.177511.log.gz 2023-09-10T09:22:43.940 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.158307.log.gz 2023-09-10T09:22:43.946 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.154072.log.gz 2023-09-10T09:22:43.953 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.186061.log.gz 2023-09-10T09:22:43.953 INFO:teuthology.orchestra.run.smithi084.stderr: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.191484.log.gz 2023-09-10T09:22:43.954 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.160727.log.gz 2023-09-10T09:22:43.961 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.181573.log.gz 2023-09-10T09:22:44.013 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.218664.log.gz 2023-09-10T09:22:44.017 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2023-09-10T09:22:44.018 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2023-09-10T09:22:44.018 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.293800.log.gz 2023-09-10T09:22:44.018 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44493.log.gz 2023-09-10T09:22:44.019 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2023-09-10T09:22:44.020 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2023-09-10T09:22:44.020 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47083.log.gz 2023-09-10T09:22:44.020 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2023-09-10T09:22:44.026 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.228815.log.gz 2023-09-10T09:22:44.031 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.152312.log.gz 2023-09-10T09:22:44.032 INFO:teuthology.orchestra.run.smithi084.stderr: 65.3% -- replaced with /var/log/ceph/ceph-client.admin.156168.log.gz 2023-09-10T09:22:44.032 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.172263.log.gz 2023-09-10T09:22:44.039 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.113763.log.gz 2023-09-10T09:22:44.071 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.279528.log.gz 2023-09-10T09:22:44.073 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.279537.log.gz 2023-09-10T09:22:44.074 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.283331.log.gz 2023-09-10T09:22:44.075 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.283739.log.gz 2023-09-10T09:22:44.087 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.307984.log.gz 2023-09-10T09:22:44.088 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.309185.log.gz 2023-09-10T09:22:44.109 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.186468.log.gz 2023-09-10T09:22:44.115 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.337220.log.gz 2023-09-10T09:22:44.122 INFO:teuthology.orchestra.run.smithi084.stderr: 68.5% -- replaced with /var/log/ceph/ceph-client.admin.199914.log.gz 2023-09-10T09:22:44.125 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.198704.log.gz 2023-09-10T09:22:44.162 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.310379.log.gz 2023-09-10T09:22:44.171 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.340481.log.gz 2023-09-10T09:22:44.190 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.242290.log.gz 2023-09-10T09:22:44.199 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45826.log.gz 2023-09-10T09:22:44.199 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47906.log.gz 2023-09-10T09:22:44.217 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.231601.log.gz 2023-09-10T09:22:44.243 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.124340.log.gz 2023-09-10T09:22:44.244 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.175530.log.gz 2023-09-10T09:22:44.250 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.170991.log.gz 2023-09-10T09:22:44.260 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.295005.log.gz 2023-09-10T09:22:44.276 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.221875.log.gz 2023-09-10T09:22:44.280 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.396888.log.gz 2023-09-10T09:22:44.284 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.151895.log.gz 2023-09-10T09:22:44.298 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.279931.log.gz 2023-09-10T09:22:44.308 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.388233.log.gz 2023-09-10T09:22:44.319 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49977.log.gz 2023-09-10T09:22:44.324 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.394037.log.gz 2023-09-10T09:22:44.333 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.206953.log.gz 2023-09-10T09:22:44.334 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.302587.log.gz 2023-09-10T09:22:44.360 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.185672.log.gz 2023-09-10T09:22:44.364 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.270719.log.gz 2023-09-10T09:22:44.375 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202364.log.gz 2023-09-10T09:22:44.383 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.290534.log.gz 2023-09-10T09:22:44.424 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.357258.log.gz 2023-09-10T09:22:44.444 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.297004.log.gz 2023-09-10T09:22:44.445 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.293002.log.gz 2023-09-10T09:22:44.466 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.171844.log.gz 2023-09-10T09:22:44.469 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.303059.log.gz 2023-09-10T09:22:44.471 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.299503.log.gz 2023-09-10T09:22:44.475 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.182426.log.gz 2023-09-10T09:22:44.485 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.191095.log.gz 2023-09-10T09:22:44.512 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.213532.log.gz 2023-09-10T09:22:44.520 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.276330.log.gz 2023-09-10T09:22:44.526 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.312564.log.gz 2023-09-10T09:22:44.540 INFO:teuthology.orchestra.run.smithi084.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.346788.log.gz 2023-09-10T09:22:44.557 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.100337.log.gz 2023-09-10T09:22:44.573 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.103570.log.gz 2023-09-10T09:22:44.582 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.121490.log.gz 2023-09-10T09:22:44.584 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48198.log.gz 2023-09-10T09:22:44.584 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2023-09-10T09:22:44.585 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.156566.log.gz 2023-09-10T09:22:44.586 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.158758.log.gz 2023-09-10T09:22:44.591 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.151071.log.gz 2023-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.219475.log.gz 2023-09-10T09:22:44.595 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.216616.log.gz 2023-09-10T09:22:44.596 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.218209.log.gz 2023-09-10T09:22:44.597 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.217820.log.gz 2023-09-10T09:22:44.598 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.244909.log.gz 2023-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.148647.log.gz 2023-09-10T09:22:44.600 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.282054.log.gz 2023-09-10T09:22:44.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2023-09-10T09:22:44.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2023-09-10T09:22:44.610 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.293401.log.gz 2023-09-10T09:22:44.610 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2023-09-10T09:22:44.611 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2023-09-10T09:22:44.611 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2023-09-10T09:22:44.613 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.203951.log.gz 2023-09-10T09:22:44.613 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.305495.log.gz 2023-09-10T09:22:44.618 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45193.log.gz 2023-09-10T09:22:44.621 INFO:teuthology.orchestra.run.smithi084.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2023-09-10T09:22:44.624 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.331562.log.gz 2023-09-10T09:22:44.626 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.331965.log.gz 2023-09-10T09:22:44.626 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.332388.log.gz 2023-09-10T09:22:44.628 INFO:teuthology.orchestra.run.smithi084.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2023-09-10T09:22:44.629 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38126.log.gz 2023-09-10T09:22:44.629 INFO:teuthology.orchestra.run.smithi084.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.38147.log.gz 2023-09-10T09:22:44.632 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47351.log.gz 2023-09-10T09:22:44.633 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2023-09-10T09:22:44.633 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47592.log.gz 2023-09-10T09:22:44.635 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.216625.log.gz 2023-09-10T09:22:44.637 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44056.log.gz 2023-09-10T09:22:44.639 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47748.log.gz 2023-09-10T09:22:44.642 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.330301.log.gz 2023-09-10T09:22:44.646 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2023-09-10T09:22:44.646 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2023-09-10T09:22:44.647 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48276.log.gz 2023-09-10T09:22:44.647 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gz 2023-09-10T09:22:44.658 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.150251.log.gz 2023-09-10T09:22:44.660 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150663.log.gz 2023-09-10T09:22:44.668 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.220281.log.gz 2023-09-10T09:22:44.673 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.101177.log.gz 2023-09-10T09:22:44.674 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.340916.log.gz 2023-09-10T09:22:44.677 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.89478.log.gz 2023-09-10T09:22:44.684 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.236054.log.gz 2023-09-10T09:22:44.685 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.129187.log.gz 2023-09-10T09:22:44.687 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.124747.log.gz 2023-09-10T09:22:44.691 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.107555.log.gz 2023-09-10T09:22:44.693 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.104773.log.gz 2023-09-10T09:22:44.693 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.114152.log.gz 2023-09-10T09:22:44.697 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.315566.log.gz 2023-09-10T09:22:44.699 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.178718.log.gz 2023-09-10T09:22:44.700 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.346565.log.gz 2023-09-10T09:22:44.704 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.230398.log.gz 2023-09-10T09:22:44.704 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.230796.log.gz 2023-09-10T09:22:44.705 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.296602.log.gz 2023-09-10T09:22:44.709 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.308373.log.gz 2023-09-10T09:22:44.711 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.307578.log.gz 2023-09-10T09:22:44.711 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.95450.log.gz 2023-09-10T09:22:44.712 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.83933.log.gz 2023-09-10T09:22:44.734 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.271526.log.gz 2023-09-10T09:22:44.742 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.284967.log.gz 2023-09-10T09:22:44.744 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.286948.log.gz 2023-09-10T09:22:44.745 INFO:teuthology.orchestra.run.smithi084.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.38118.log.gz 2023-09-10T09:22:44.751 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% -- replaced with /var/log/ceph/ceph-client.admin.209051.log.gz 2023-09-10T09:22:44.752 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.219466.log.gz 2023-09-10T09:22:44.753 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2023-09-10T09:22:44.760 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2023-09-10T09:22:44.760 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48011.log.gz 2023-09-10T09:22:44.761 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2023-09-10T09:22:44.766 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.89087.log.gz 2023-09-10T09:22:44.772 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.99507.log.gz 2023-09-10T09:22:44.776 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.341305.log.gz 2023-09-10T09:22:44.781 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199127.log.gz 2023-09-10T09:22:44.781 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.201506.log.gz 2023-09-10T09:22:44.782 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.199525.log.gz 2023-09-10T09:22:44.782 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.273917.log.gz 2023-09-10T09:22:44.784 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.233998.log.gz 2023-09-10T09:22:44.785 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.175132.log.gz 2023-09-10T09:22:44.791 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.273130.log.gz 2023-09-10T09:22:44.797 INFO:teuthology.orchestra.run.smithi084.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.216197.log.gz 2023-09-10T09:22:44.804 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.314691.log.gz 2023-09-10T09:22:44.825 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.167575.log.gz 2023-09-10T09:22:44.866 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.311240.log.gz 2023-09-10T09:22:44.875 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.201108.log.gz 2023-09-10T09:22:44.876 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197109.log.gz 2023-09-10T09:22:44.881 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.336434.log.gz 2023-09-10T09:22:44.888 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.288536.log.gz 2023-09-10T09:22:44.889 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.292594.log.gz 2023-09-10T09:22:44.892 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.209060.log.gz 2023-09-10T09:22:44.894 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.160718.log.gz 2023-09-10T09:22:44.927 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.219062.log.gz 2023-09-10T09:22:44.930 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.278333.log.gz 2023-09-10T09:22:44.943 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49095.log.gz 2023-09-10T09:22:44.944 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203162.log.gz 2023-09-10T09:22:44.946 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.99900.log.gz 2023-09-10T09:22:44.947 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.102371.log.gz 2023-09-10T09:22:44.948 INFO:teuthology.orchestra.run.smithi084.stderr: 65.3% -- replaced with /var/log/ceph/ceph-client.admin.132201.log.gz 2023-09-10T09:22:44.949 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.174723.log.gz 2023-09-10T09:22:44.950 INFO:teuthology.orchestra.run.smithi084.stderr: 65.3% -- replaced with /var/log/ceph/ceph-client.admin.175123.log.gz 2023-09-10T09:22:44.960 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.108759.log.gz 2023-09-10T09:22:44.973 INFO:teuthology.orchestra.run.smithi084.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.126053.log.gz 2023-09-10T09:22:44.980 INFO:teuthology.orchestra.run.smithi084.stderr: 70.7% -- replaced with /var/log/ceph/ceph-client.admin.87767.log.gz 2023-09-10T09:22:44.981 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.283340.log.gz 2023-09-10T09:22:45.043 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.170563.log.gz 2023-09-10T09:22:45.351 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.85648.log.gz 2023-09-10T09:22:45.364 INFO:teuthology.orchestra.run.smithi084.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.161125.log.gz 2023-09-10T09:22:45.838 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.122304.log.gz 2023-09-10T09:22:46.457 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.153661.log.gz 2023-09-10T09:22:46.694 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.164615.log.gz 2023-09-10T09:22:46.731 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.234396.log.gz 2023-09-10T09:22:46.796 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.173132.log.gz 2023-09-10T09:22:46.803 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.162497.log.gz 2023-09-10T09:22:46.981 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.169283.log.gz 2023-09-10T09:22:47.384 INFO:teuthology.orchestra.run.smithi084.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.205190.log.gz 2023-09-10T09:22:47.443 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.188645.log.gz 2023-09-10T09:22:47.443 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.186871.log.gz 2023-09-10T09:22:47.444 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.194448.log.gz 2023-09-10T09:22:47.444 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% 71.7% -- replaced with /var/log/ceph/ceph-client.admin.304643.log.gz 2023-09-10T09:22:47.444 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149045.log.gz 2023-09-10T09:22:47.444 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.223076.log.gz 2023-09-10T09:22:47.445 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2023-09-10T09:22:47.445 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.333243.log.gz 2023-09-10T09:22:47.445 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.217413.log.gz 2023-09-10T09:22:47.446 INFO:teuthology.orchestra.run.smithi084.stderr: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.338046.log.gz 2023-09-10T09:22:47.446 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.106755.log.gz 2023-09-10T09:22:47.446 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2023-09-10T09:22:47.447 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.121886.log.gz 2023-09-10T09:22:47.447 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.338467.log.gz 2023-09-10T09:22:47.447 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.272319.log.gz 2023-09-10T09:22:47.447 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2023-09-10T09:22:47.448 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.292192.log.gz 2023-09-10T09:22:47.448 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.108356.log.gz 2023-09-10T09:22:47.448 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.87551.log.gz 2023-09-10T09:22:47.449 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.103977.log.gz 2023-09-10T09:22:47.449 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.184876.log.gz 2023-09-10T09:22:47.449 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.90275.log.gz 2023-09-10T09:22:47.449 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149855.log.gz 2023-09-10T09:22:47.450 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.111295.log.gz 2023-09-10T09:22:47.450 INFO:teuthology.orchestra.run.smithi084.stderr: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.337643.log.gz 2023-09-10T09:22:47.451 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.236870.log.gz 2023-09-10T09:22:47.451 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45878.log.gz 2023-09-10T09:22:47.451 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.336822.log.gz 2023-09-10T09:22:47.452 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.180316.log.gz 2023-09-10T09:22:47.452 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.339270.log.gz 2023-09-10T09:22:47.452 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.226291.log.gz 2023-09-10T09:22:47.452 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44597.log.gz 2023-09-10T09:22:47.453 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.169274.log.gz 2023-09-10T09:22:47.453 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.295403.log.gz 2023-09-10T09:22:47.453 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.245299.log.gz 2023-09-10T09:22:47.453 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.292603.log.gz 2023-09-10T09:22:47.454 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.273926.log.gz 2023-09-10T09:22:47.454 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.166287.log.gz 2023-09-10T09:22:47.454 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.192299.log.gz 2023-09-10T09:22:47.455 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.122698.log.gz 2023-09-10T09:22:47.455 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.178709.log.gz 2023-09-10T09:22:47.455 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.179509.log.gz 2023-09-10T09:22:47.456 INFO:teuthology.orchestra.run.smithi084.stderr: 70.6% -- replaced with /var/log/ceph/ceph-client.admin.212720.log.gz 2023-09-10T09:22:47.456 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45384.log.gz 2023-09-10T09:22:47.456 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2023-09-10T09:22:47.456 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.103172.log.gz 2023-09-10T09:22:47.457 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.300731.log.gz 2023-09-10T09:22:47.457 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356459.log.gz 2023-09-10T09:22:47.457 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148656.log.gz 2023-09-10T09:22:47.458 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2023-09-10T09:22:47.458 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.244501.log.gz 2023-09-10T09:22:47.458 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150260.log.gz 2023-09-10T09:22:47.458 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49367.log.gz 2023-09-10T09:22:47.459 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.284128.log.gz 2023-09-10T09:22:47.459 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2023-09-10T09:22:47.459 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.281267.log.gz 2023-09-10T09:22:47.460 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.179518.log.gz 2023-09-10T09:22:47.460 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.294996.log.gz 2023-09-10T09:22:47.461 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.345776.log.gz 2023-09-10T09:22:47.461 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.168419.log.gz 2023-09-10T09:22:47.461 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.312150.log.gz 2023-09-10T09:22:47.461 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2023-09-10T09:22:47.462 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46262.log.gz 2023-09-10T09:22:47.462 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.279118.log.gz 2023-09-10T09:22:47.462 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.108365.log.gz 2023-09-10T09:22:47.463 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.95441.log.gz 2023-09-10T09:22:47.463 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2023-09-10T09:22:47.463 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2023-09-10T09:22:47.464 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.85639.log.gz 2023-09-10T09:22:47.464 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.217811.log.gz 2023-09-10T09:22:47.464 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.107964.log.gz 2023-09-10T09:22:47.465 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2023-09-10T09:22:47.465 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.334867.log.gz 2023-09-10T09:22:47.465 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% 64.7% -- replaced with /var/log/ceph/ceph-client.admin.299902.log.gz -- replaced with /var/log/ceph/ceph-client.admin.339668.log.gz 2023-09-10T09:22:47.465 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.466 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.112538.log.gz 2023-09-10T09:22:47.466 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.225494.log.gz 2023-09-10T09:22:47.466 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.292201.log.gz 2023-09-10T09:22:47.467 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.107156.log.gz 2023-09-10T09:22:47.467 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.303050.log.gz 2023-09-10T09:22:47.467 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.288545.log.gz -- replaced with /var/log/ceph/ceph-client.admin.309981.log.gz 2023-09-10T09:22:47.467 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.468 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.284958.log.gz 2023-09-10T09:22:47.468 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.186070.log.gz 2023-09-10T09:22:47.468 INFO:teuthology.orchestra.run.smithi084.stderr: 68.4% 68.7% -- replaced with /var/log/ceph/ceph-client.admin.165034.log.gz -- replaced with /var/log/ceph/ceph-client.admin.212289.log.gz 2023-09-10T09:22:47.469 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.469 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.330706.log.gz 2023-09-10T09:22:47.469 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.154925.log.gz 2023-09-10T09:22:47.469 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.148249.log.gz 2023-09-10T09:22:47.470 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.307569.log.gz 2023-09-10T09:22:47.470 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2023-09-10T09:22:47.470 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.337229.log.gz 2023-09-10T09:22:47.471 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.474285.log.gz 2023-09-10T09:22:47.471 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46426.log.gz 2023-09-10T09:22:47.471 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.99498.log.gz 2023-09-10T09:22:47.471 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.109613.log.gz 2023-09-10T09:22:47.472 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% 69.2% -- replaced with /var/log/ceph/ceph-client.admin.364135.log.gz -- replaced with /var/log/ceph/ceph-client.admin.101566.log.gz 2023-09-10T09:22:47.472 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.472 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.131413.log.gz 2023-09-10T09:22:47.473 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.245703.log.gz 2023-09-10T09:22:47.473 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz 2023-09-10T09:22:47.473 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.233193.log.gz 2023-09-10T09:22:47.474 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.333641.log.gz 2023-09-10T09:22:47.474 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.275923.log.gz 2023-09-10T09:22:47.474 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2023-09-10T09:22:47.474 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46797.log.gz 2023-09-10T09:22:47.475 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.246503.log.gz 2023-09-10T09:22:47.475 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.311697.log.gz 2023-09-10T09:22:47.475 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.94248.log.gz 2023-09-10T09:22:47.476 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.343729.log.gz 2023-09-10T09:22:47.476 INFO:teuthology.orchestra.run.smithi084.stderr: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.217014.log.gz 2023-09-10T09:22:47.476 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2023-09-10T09:22:47.476 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2023-09-10T09:22:47.477 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz -- replaced with /var/log/ceph/ceph-client.admin.313429.log.gz 2023-09-10T09:22:47.477 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.477 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2023-09-10T09:22:47.477 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.246905.log.gz 2023-09-10T09:22:47.478 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.300740.log.gz 2023-09-10T09:22:47.478 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.304254.log.gz 2023-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% 71.0% -- replaced with /var/log/ceph/ceph-client.admin.290937.log.gz -- replaced with /var/log/ceph/ceph-client.admin.390674.log.gz 2023-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.479 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.104764.log.gz 2023-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% 65.1% -- replaced with /var/log/ceph/ceph-client.admin.403482.log.gz -- replaced with /var/log/ceph/ceph-client.admin.390267.log.gz 2023-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% 73.8% -- replaced with /var/log/ceph/ceph-client.admin.101977.log.gz -- replaced with /var/log/ceph/ceph-client.admin.277927.log.gz 2023-09-10T09:22:47.480 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.481 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.176326.log.gz 2023-09-10T09:22:47.481 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.214324.log.gz 2023-09-10T09:22:47.481 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2023-09-10T09:22:47.481 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44981.log.gz 2023-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.150654.log.gz 2023-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.194018.log.gz 2023-09-10T09:22:47.482 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz 2023-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.294199.log.gz 2023-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.408404.log.gz 2023-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi084.stderr: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.84823.log.gz 2023-09-10T09:22:47.483 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.274324.log.gz 2023-09-10T09:22:47.484 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401865.log.gz 2023-09-10T09:22:47.484 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.296611.log.gz 2023-09-10T09:22:47.484 INFO:teuthology.orchestra.run.smithi084.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.83047.log.gz 2023-09-10T09:22:47.484 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.394444.log.gz 2023-09-10T09:22:47.485 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.271916.log.gz 2023-09-10T09:22:47.485 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.160327.log.gz 2023-09-10T09:22:47.485 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.217023.log.gz 2023-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.305884.log.gz 2023-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.381946.log.gz 2023-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.110451.log.gz 2023-09-10T09:22:47.486 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.282451.log.gz 2023-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.167139.log.gz 2023-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.399980.log.gz 2023-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi084.stderr: 64.8% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.382353.log.gz -- replaced with /var/log/ceph/ceph-client.admin.162917.log.gz 2023-09-10T09:22:47.487 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47566.log.gz 2023-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.177909.log.gz 2023-09-10T09:22:47.488 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.102380.log.gz 2023-09-10T09:22:47.489 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.199516.log.gz 2023-09-10T09:22:47.489 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.414589.log.gz 2023-09-10T09:22:47.489 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.129592.log.gz 2023-09-10T09:22:47.489 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.474276.log.gz 2023-09-10T09:22:47.490 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.161953.log.gz 2023-09-10T09:22:47.490 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.228010.log.gz 2023-09-10T09:22:47.490 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2023-09-10T09:22:47.490 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44654.log.gz 2023-09-10T09:22:47.491 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.284526.log.gz 2023-09-10T09:22:47.491 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.270326.log.gz 2023-09-10T09:22:47.491 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2023-09-10T09:22:47.492 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.336036.log.gz 2023-09-10T09:22:47.492 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.366492.log.gz 2023-09-10T09:22:47.492 INFO:teuthology.orchestra.run.smithi084.stderr: 64.6% -- replaced with /var/log/ceph/ceph-client.admin.274718.log.gz 90.2% 2023-09-10T09:22:47.492 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.214333.log.gz 2023-09-10T09:22:47.493 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.273121.log.gz 2023-09-10T09:22:47.493 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2023-09-10T09:22:47.493 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.423936.log.gz 2023-09-10T09:22:47.493 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.414193.log.gz 2023-09-10T09:22:47.494 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.383142.log.gz 2023-09-10T09:22:47.494 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.312159.log.gz 2023-09-10T09:22:47.494 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.98306.log.gz 2023-09-10T09:22:47.495 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.410861.log.gz 2023-09-10T09:22:47.495 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.334468.log.gz 2023-09-10T09:22:47.495 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.189043.log.gz 2023-09-10T09:22:47.495 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.175919.log.gz 2023-09-10T09:22:47.496 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.202355.log.gz 86.2% 2023-09-10T09:22:47.496 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38111.log.gz 2023-09-10T09:22:47.496 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.309176.log.gz 2023-09-10T09:22:47.496 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2023-09-10T09:22:47.497 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.201957.log.gz 2023-09-10T09:22:47.497 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.389869.log.gz 2023-09-10T09:22:47.497 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.164178.log.gz 2023-09-10T09:22:47.497 INFO:teuthology.orchestra.run.smithi084.stderr: 70.7% -- replaced with /var/log/ceph/ceph-client.admin.153652.log.gz 71.7% 2023-09-10T09:22:47.498 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.344965.log.gz 2023-09-10T09:22:47.498 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.231203.log.gz 2023-09-10T09:22:47.498 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.473857.log.gz 2023-09-10T09:22:47.499 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.352826.log.gz 2023-09-10T09:22:47.499 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2023-09-10T09:22:47.499 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% 69.0% -- replaced with /var/log/ceph/ceph-client.admin.192290.log.gz -- replaced with /var/log/ceph/ceph-client.admin.244066.log.gz 2023-09-10T09:22:47.499 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.500 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.223483.log.gz 2023-09-10T09:22:47.500 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.190688.log.gz 2023-09-10T09:22:47.500 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.397341.log.gz 2023-09-10T09:22:47.501 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.89487.log.gz 2023-09-10T09:22:47.501 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2023-09-10T09:22:47.501 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.105569.log.gz 2023-09-10T09:22:47.501 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.203552.log.gz 2023-09-10T09:22:47.502 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45696.log.gz 2023-09-10T09:22:47.502 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.417464.log.gz 2023-09-10T09:22:47.502 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.105171.log.gz 2023-09-10T09:22:47.503 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.330292.log.gz 2023-09-10T09:22:47.503 INFO:teuthology.orchestra.run.smithi084.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.38153.log.gz 2023-09-10T09:22:47.503 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.195761.log.gz 2023-09-10T09:22:47.503 INFO:teuthology.orchestra.run.smithi084.stderr: 64.7% -- replaced with /var/log/ceph/ceph-client.admin.340067.log.gz 2023-09-10T09:22:47.504 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2023-09-10T09:22:47.504 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.274727.log.gz 2023-09-10T09:22:47.504 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 2023-09-10T09:22:47.504 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.37975.log.gz 2023-09-10T09:22:47.505 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.95849.log.gz 2023-09-10T09:22:47.505 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.427384.log.gz 2023-09-10T09:22:47.505 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.424159.log.gz 2023-09-10T09:22:47.505 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.173927.log.gz 2023-09-10T09:22:47.506 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45410.log.gz 2023-09-10T09:22:47.506 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% 68.7% -- replaced with /var/log/ceph/ceph-client.admin.317500.log.gz -- replaced with /var/log/ceph/ceph-client.admin.291739.log.gz 2023-09-10T09:22:47.506 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.507 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.101168.log.gz 2023-09-10T09:22:47.507 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2023-09-10T09:22:47.507 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.225082.log.gz 2023-09-10T09:22:47.507 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.179118.log.gz 2023-09-10T09:22:47.508 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.222677.log.gz 2023-09-10T09:22:47.508 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45982.log.gz 2023-09-10T09:22:47.508 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.232788.log.gz 2023-09-10T09:22:47.508 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.403923.log.gz 2023-09-10T09:22:47.509 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.344974.log.gz 2023-09-10T09:22:47.509 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.391073.log.gz 2023-09-10T09:22:47.509 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.223474.log.gz 2023-09-10T09:22:47.509 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47932.log.gz 2023-09-10T09:22:47.510 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.342880.log.gz 2023-09-10T09:22:47.510 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47854.log.gz 2023-09-10T09:22:47.510 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.346421.log.gz 2023-09-10T09:22:47.511 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.294190.log.gz 2023-09-10T09:22:47.511 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.334477.log.gz 2023-09-10T09:22:47.511 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.99101.log.gz 2023-09-10T09:22:47.511 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.305084.log.gz 2023-09-10T09:22:47.512 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.196261.log.gz 2023-09-10T09:22:47.512 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.197906.log.gz 2023-09-10T09:22:47.512 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.299911.log.gz 2023-09-10T09:22:47.512 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.112942.log.gz 2023-09-10T09:22:47.513 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.275520.log.gz 2023-09-10T09:22:47.513 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.219869.log.gz 2023-09-10T09:22:47.513 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.197897.log.gz 2023-09-10T09:22:47.514 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2023-09-10T09:22:47.514 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.338874.log.gz 2023-09-10T09:22:47.514 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.123544.log.gz 2023-09-10T09:22:47.514 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.205618.log.gz 2023-09-10T09:22:47.515 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.166713.log.gz 2023-09-10T09:22:47.515 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2023-09-10T09:22:47.515 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.120624.log.gz 2023-09-10T09:22:47.516 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44158.log.gz 2023-09-10T09:22:47.516 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 90.3% 2023-09-10T09:22:47.516 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98315.log.gz 2023-09-10T09:22:47.516 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.228417.log.gz 2023-09-10T09:22:47.517 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% 73.8% -- replaced with /var/log/ceph/ceph-client.admin.288942.log.gz 2023-09-10T09:22:47.517 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.310370.log.gz 2023-09-10T09:22:47.517 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.180307.log.gz 2023-09-10T09:22:47.517 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.302125.log.gz 2023-09-10T09:22:47.518 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.132761.log.gz 2023-09-10T09:22:47.518 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48536.log.gz 2023-09-10T09:22:47.518 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.220675.log.gz 2023-09-10T09:22:47.519 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.203561.log.gz 2023-09-10T09:22:47.519 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.424553.log.gz 2023-09-10T09:22:47.519 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.307975.log.gz 2023-09-10T09:22:47.519 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.221083.log.gz 2023-09-10T09:22:47.520 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.271127.log.gz 2023-09-10T09:22:47.520 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.104366.log.gz 2023-09-10T09:22:47.520 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44862.log.gz 2023-09-10T09:22:47.520 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.178309.log.gz 2023-09-10T09:22:47.521 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.393586.log.gz 2023-09-10T09:22:47.521 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.289340.log.gz 2023-09-10T09:22:47.521 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2023-09-10T09:22:47.521 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.194877.log.gz 2023-09-10T09:22:47.522 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.336831.log.gz 2023-09-10T09:22:47.522 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.159928.log.gz 2023-09-10T09:22:47.522 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2023-09-10T09:22:47.523 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz 2023-09-10T09:22:47.523 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.301656.log.gz 2023-09-10T09:22:47.523 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.110904.log.gz 2023-09-10T09:22:47.523 INFO:teuthology.orchestra.run.smithi084.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2023-09-10T09:22:47.524 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49281.log.gz 2023-09-10T09:22:47.524 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.345372.log.gz 2023-09-10T09:22:47.524 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.244900.log.gz 2023-09-10T09:22:47.524 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.355249.log.gz 2023-09-10T09:22:47.525 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.412493.log.gz 2023-09-10T09:22:47.525 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.157894.log.gz 2023-09-10T09:22:47.525 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47774.log.gz 2023-09-10T09:22:47.525 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.398178.log.gz 2023-09-10T09:22:47.526 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.212729.log.gz 90.4% 2023-09-10T09:22:47.526 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.290946.log.gz 2023-09-10T09:22:47.526 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.277936.log.gz 2023-09-10T09:22:47.527 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.147846.log.gz 2023-09-10T09:22:47.527 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.205609.log.gz 2023-09-10T09:22:47.527 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.242704.log.gz 2023-09-10T09:22:47.527 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.309583.log.gz 2023-09-10T09:22:47.528 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.163751.log.gz 2023-09-10T09:22:47.528 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.344530.log.gz 2023-09-10T09:22:47.528 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.172691.log.gz 2023-09-10T09:22:47.528 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.224688.log.gz 2023-09-10T09:22:47.529 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.182848.log.gz 2023-09-10T09:22:47.529 INFO:teuthology.orchestra.run.smithi084.stderr: 68.4% -- replaced with /var/log/ceph/ceph-client.admin.162488.log.gz 2023-09-10T09:22:47.529 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.131802.log.gz 2023-09-10T09:22:47.529 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228019.log.gz 2023-09-10T09:22:47.530 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.112135.log.gz 2023-09-10T09:22:47.531 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.292993.log.gz 2023-09-10T09:22:47.532 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2023-09-10T09:22:47.532 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2023-09-10T09:22:47.532 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.317026.log.gz 2023-09-10T09:22:47.532 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.183684.log.gz 2023-09-10T09:22:47.533 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.372845.log.gz 2023-09-10T09:22:47.533 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.230009.log.gz 2023-09-10T09:22:47.533 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2023-09-10T09:22:47.534 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.305075.log.gz 2023-09-10T09:22:47.534 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.157428.log.gz 2023-09-10T09:22:47.534 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.86491.log.gz 2023-09-10T09:22:47.534 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.176724.log.gz 2023-09-10T09:22:47.535 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.184073.log.gz 2023-09-10T09:22:47.535 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.299512.log.gz 2023-09-10T09:22:47.535 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.315104.log.gz 2023-09-10T09:22:47.536 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.333650.log.gz 2023-09-10T09:22:47.536 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.309574.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2023-09-10T09:22:47.536 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.536 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.395694.log.gz 2023-09-10T09:22:47.537 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.187858.log.gz 2023-09-10T09:22:47.537 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.296191.log.gz 2023-09-10T09:22:47.537 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.173525.log.gz 2023-09-10T09:22:47.537 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.178318.log.gz 2023-09-10T09:22:47.538 INFO:teuthology.orchestra.run.smithi084.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44983.log.gz 2023-09-10T09:22:47.538 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.342000.log.gz 2023-09-10T09:22:47.538 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48484.log.gz 2023-09-10T09:22:47.539 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.111746.log.gz 2023-09-10T09:22:47.539 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.218673.log.gz -- replaced with /var/log/ceph/ceph-client.admin.44545.log.gz 2023-09-10T09:22:47.539 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.539 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2023-09-10T09:22:47.540 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48692.log.gz 2023-09-10T09:22:47.540 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.170982.log.gz 2023-09-10T09:22:47.540 INFO:teuthology.orchestra.run.smithi084.stderr: 86.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38169.log.gz -- replaced with /var/log/ceph/ceph-client.admin.49629.log.gz 2023-09-10T09:22:47.540 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.541 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.280829.log.gz 2023-09-10T09:22:47.541 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.269919.log.gz 2023-09-10T09:22:47.541 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.339677.log.gz 2023-09-10T09:22:47.541 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.387373.log.gz 2023-09-10T09:22:47.542 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.103579.log.gz 2023-09-10T09:22:47.542 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.187451.log.gz 2023-09-10T09:22:47.542 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.290136.log.gz 2023-09-10T09:22:47.543 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.416201.log.gz 2023-09-10T09:22:47.543 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.189503.log.gz 2023-09-10T09:22:47.543 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.341991.log.gz 2023-09-10T09:22:47.543 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% 70.7% -- replaced with /var/log/ceph/ceph-client.admin.306757.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45411.log.gz 2023-09-10T09:22:47.544 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.544 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2023-09-10T09:22:47.544 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.230407.log.gz 2023-09-10T09:22:47.544 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.289331.log.gz 2023-09-10T09:22:47.545 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz 2023-09-10T09:22:47.545 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.216188.log.gz 2023-09-10T09:22:47.545 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.86038.log.gz 2023-09-10T09:22:47.545 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.418270.log.gz 2023-09-10T09:22:47.546 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.208252.log.gz 2023-09-10T09:22:47.546 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.337652.log.gz 2023-09-10T09:22:47.546 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.131811.log.gz 2023-09-10T09:22:47.547 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2023-09-10T09:22:47.547 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38161.log.gz 2023-09-10T09:22:47.547 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47405.log.gz 2023-09-10T09:22:47.547 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.177122.log.gz 2023-09-10T09:22:47.548 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.285765.log.gz 2023-09-10T09:22:47.548 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.219878.log.gz 2023-09-10T09:22:47.548 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz 2023-09-10T09:22:47.548 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.104375.log.gz 2023-09-10T09:22:47.549 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.204750.log.gz 2023-09-10T09:22:47.549 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46667.log.gz 2023-09-10T09:22:47.549 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.346469.log.gz 2023-09-10T09:22:47.550 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.231592.log.gz 2023-09-10T09:22:47.550 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2023-09-10T09:22:47.550 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203960.log.gz 2023-09-10T09:22:47.550 INFO:teuthology.orchestra.run.smithi084.stderr: 70.9% -- replaced with /var/log/ceph/ceph-client.admin.213926.log.gz 2023-09-10T09:22:47.551 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.368955.log.gz 2023-09-10T09:22:47.551 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% 68.8% -- replaced with /var/log/ceph/ceph-client.admin.123941.log.gz -- replaced with /var/log/ceph/ceph-client.admin.94702.log.gz 2023-09-10T09:22:47.551 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.552 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47431.log.gz 2023-09-10T09:22:47.552 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.113352.log.gz 2023-09-10T09:22:47.552 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44680.log.gz 2023-09-10T09:22:47.552 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.188654.log.gz 2023-09-10T09:22:47.553 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.338865.log.gz 2023-09-10T09:22:47.553 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.317968.log.gz 2023-09-10T09:22:47.553 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.108768.log.gz 2023-09-10T09:22:47.553 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.330697.log.gz 2023-09-10T09:22:47.554 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48718.log.gz 2023-09-10T09:22:47.554 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44706.log.gz 2023-09-10T09:22:47.554 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2023-09-10T09:22:47.555 INFO:teuthology.orchestra.run.smithi084.stderr: 72.1% -- replaced with /var/log/ceph/ceph-client.admin.132504.log.gz 2023-09-10T09:22:47.555 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.342389.log.gz 2023-09-10T09:22:47.555 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.317977.log.gz 2023-09-10T09:22:47.555 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.215595.log.gz 2023-09-10T09:22:47.556 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.213935.log.gz 2023-09-10T09:22:47.556 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.190290.log.gz 2023-09-10T09:22:47.556 INFO:teuthology.orchestra.run.smithi084.stderr: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.369349.log.gz 2023-09-10T09:22:47.556 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.160318.log.gz 2023-09-10T09:22:47.557 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.345767.log.gz 2023-09-10T09:22:47.557 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.101575.log.gz 2023-09-10T09:22:47.557 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.234387.log.gz 2023-09-10T09:22:47.558 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.226694.log.gz 2023-09-10T09:22:47.558 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.183675.log.gz 2023-09-10T09:22:47.558 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48841.log.gz 2023-09-10T09:22:47.558 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.281665.log.gz 2023-09-10T09:22:47.559 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.191086.log.gz 2023-09-10T09:22:47.559 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gz 2023-09-10T09:22:47.559 INFO:teuthology.orchestra.run.smithi084.stderr: 68.5% -- replaced with /var/log/ceph/ceph-client.admin.466284.log.gz 2023-09-10T09:22:47.559 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.318874.log.gz 2023-09-10T09:22:47.560 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.307172.log.gz 2023-09-10T09:22:47.560 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.199923.log.gz 2023-09-10T09:22:47.560 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.318430.log.gz 2023-09-10T09:22:47.560 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.406627.log.gz 2023-09-10T09:22:47.561 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.368144.log.gz 2023-09-10T09:22:47.561 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.287742.log.gz 2023-09-10T09:22:47.561 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.161563.log.gz 2023-09-10T09:22:47.561 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.278730.log.gz 2023-09-10T09:22:47.562 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.233600.log.gz 2023-09-10T09:22:47.562 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.224679.log.gz 69.1% 2023-09-10T09:22:47.562 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114613.log.gz 2023-09-10T09:22:47.563 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.279127.log.gz 2023-09-10T09:22:47.563 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.86943.log.gz 2023-09-10T09:22:47.563 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.113754.log.gz 2023-09-10T09:22:47.563 INFO:teuthology.orchestra.run.smithi084.stderr: 70.8% -- replaced with /var/log/ceph/ceph-client.admin.189892.log.gz 2023-09-10T09:22:47.564 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2023-09-10T09:22:47.564 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.475102.log.gz 2023-09-10T09:22:47.564 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% 71.3% -- replaced with /var/log/ceph/ceph-client.admin.88226.log.gz -- replaced with /var/log/ceph/ceph-client.admin.170554.log.gz 2023-09-10T09:22:47.564 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.565 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2023-09-10T09:22:47.565 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49069.log.gz 2023-09-10T09:22:47.565 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2023-09-10T09:22:47.566 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.132752.log.gz 2023-09-10T09:22:47.566 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.290127.log.gz 2023-09-10T09:22:47.566 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.93797.log.gz 2023-09-10T09:22:47.566 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.244510.log.gz -- replaced with /var/log/ceph/ceph-client.admin.339279.log.gz 2023-09-10T09:22:47.567 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T09:22:47.567 INFO:teuthology.orchestra.run.smithi084.stderr: 74.1% -- replaced with /var/log/ceph/ceph-client.admin.225485.log.gz 2023-09-10T09:22:47.567 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148258.log.gz 2023-09-10T09:22:47.567 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.283730.log.gz 2023-09-10T09:22:47.568 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.171835.log.gz 2023-09-10T09:22:47.568 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.198305.log.gz 2023-09-10T09:22:47.568 INFO:teuthology.orchestra.run.smithi084.stderr: 68.5% -- replaced with /var/log/ceph/ceph-client.admin.208650.log.gz 2023-09-10T09:22:47.569 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.82054.log.gz 2023-09-10T09:22:47.569 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.211865.log.gz 2023-09-10T09:22:47.569 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202763.log.gz 2023-09-10T09:22:47.569 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46693.log.gz 2023-09-10T09:22:47.570 INFO:teuthology.orchestra.run.smithi084.stderr: 74.0% -- replaced with /var/log/ceph/ceph-client.admin.202754.log.gz 2023-09-10T09:22:47.570 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.103968.log.gz 2023-09-10T09:22:47.570 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.106365.log.gz 2023-09-10T09:22:47.570 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.282933.log.gz 2023-09-10T09:22:47.571 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.200720.log.gz 2023-09-10T09:22:47.571 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.294605.log.gz 2023-09-10T09:22:47.571 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.343278.log.gz 2023-09-10T09:22:47.571 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.311688.log.gz 2023-09-10T09:22:47.572 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.209910.log.gz 2023-09-10T09:22:47.572 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.190697.log.gz 2023-09-10T09:22:47.572 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.382344.log.gz 2023-09-10T09:22:47.572 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.177520.log.gz 2023-09-10T09:22:47.573 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.185265.log.gz 2023-09-10T09:22:47.573 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.246512.log.gz 2023-09-10T09:22:47.573 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.207402.log.gz 2023-09-10T09:22:47.574 INFO:teuthology.orchestra.run.smithi084.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.211874.log.gz 2023-09-10T09:22:47.574 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.133150.log.gz 2023-09-10T09:22:47.574 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.383540.log.gz 2023-09-10T09:22:47.574 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.200711.log.gz 2023-09-10T09:22:47.575 INFO:teuthology.orchestra.run.smithi084.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.95858.log.gz 2023-09-10T09:22:47.575 INFO:teuthology.orchestra.run.smithi084.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472672.log.gz 2023-09-10T09:22:47.575 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.114622.log.gz 2023-09-10T09:22:47.575 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.309972.log.gz 2023-09-10T09:22:47.576 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.165462.log.gz 2023-09-10T09:22:47.576 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.360103.log.gz 2023-09-10T09:22:47.576 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.195306.log.gz 2023-09-10T09:22:47.576 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.360515.log.gz 2023-09-10T09:22:47.577 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.271517.log.gz 2023-09-10T09:22:47.577 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.241897.log.gz 2023-09-10T09:22:47.577 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.275130.log.gz 2023-09-10T09:22:47.578 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.152774.log.gz 2023-09-10T09:22:47.578 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.278324.log.gz 2023-09-10T09:22:47.578 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.100778.log.gz 2023-09-10T09:22:47.578 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.407996.log.gz 2023-09-10T09:22:47.579 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.189494.log.gz 2023-09-10T09:22:47.579 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.310778.log.gz 2023-09-10T09:22:47.579 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2023-09-10T09:22:47.579 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.307163.log.gz 2023-09-10T09:22:47.580 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.209485.log.gz 2023-09-10T09:22:47.580 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.277524.log.gz 2023-09-10T09:22:47.580 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48089.log.gz 2023-09-10T09:22:47.580 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.225888.log.gz 2023-09-10T09:22:47.581 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.284137.log.gz 2023-09-10T09:22:47.581 INFO:teuthology.orchestra.run.smithi084.stderr: 71.5% -- replaced with /var/log/ceph/ceph-client.admin.105958.log.gz 2023-09-10T09:22:47.581 INFO:teuthology.orchestra.run.smithi084.stderr: 69.2% -- replaced with /var/log/ceph/ceph-client.admin.204350.log.gz 2023-09-10T09:22:47.581 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.276321.log.gz 2023-09-10T09:22:47.582 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.310787.log.gz 2023-09-10T09:22:47.582 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.305486.log.gz 2023-09-10T09:22:47.582 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.154489.log.gz 2023-09-10T09:22:47.583 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.346516.log.gz 2023-09-10T09:22:47.583 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.278721.log.gz 2023-09-10T09:22:47.583 INFO:teuthology.orchestra.run.smithi084.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38192.log.gz 2023-09-10T09:22:47.583 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2023-09-10T09:22:47.584 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.276718.log.gz 2023-09-10T09:22:47.584 INFO:teuthology.orchestra.run.smithi084.stderr: 74.1% -- replaced with /var/log/ceph/ceph-client.admin.109162.log.gz 90.3% 2023-09-10T09:22:47.584 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184479.log.gz 2023-09-10T09:22:47.584 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.225897.log.gz 2023-09-10T09:22:47.585 INFO:teuthology.orchestra.run.smithi084.stderr: 64.5% -- replaced with /var/log/ceph/ceph-client.admin.155315.log.gz 2023-09-10T09:22:47.585 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.161554.log.gz 2023-09-10T09:22:47.585 INFO:teuthology.orchestra.run.smithi084.stderr: 68.7% -- replaced with /var/log/ceph/ceph-client.admin.312555.log.gz 2023-09-10T09:22:47.586 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.85231.log.gz 2023-09-10T09:22:47.586 INFO:teuthology.orchestra.run.smithi084.stderr: 71.8% -- replaced with /var/log/ceph/ceph-client.admin.281656.log.gz 2023-09-10T09:22:47.586 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.236444.log.gz 2023-09-10T09:22:47.586 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.197100.log.gz 2023-09-10T09:22:47.587 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.226300.log.gz 2023-09-10T09:22:47.587 INFO:teuthology.orchestra.run.smithi084.stderr: 73.6% -- replaced with /var/log/ceph/ceph-client.admin.191892.log.gz 2023-09-10T09:22:47.587 INFO:teuthology.orchestra.run.smithi084.stderr: 72.2% -- replaced with /var/log/ceph/ceph-client.admin.97083.log.gz 2023-09-10T09:22:47.587 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.149457.log.gz 2023-09-10T09:22:47.588 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44571.log.gz 2023-09-10T09:22:47.588 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.175521.log.gz 2023-09-10T09:22:47.588 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.131404.log.gz 2023-09-10T09:22:47.589 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.180710.log.gz 2023-09-10T09:22:47.589 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.359305.log.gz 2023-09-10T09:22:47.589 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.173123.log.gz 2023-09-10T09:22:47.589 INFO:teuthology.orchestra.run.smithi084.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.389475.log.gz 2023-09-10T09:22:47.590 INFO:teuthology.orchestra.run.smithi084.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.242299.log.gz 2023-09-10T09:22:47.590 INFO:teuthology.orchestra.run.smithi084.stderr: 71.0% -- replaced with /var/log/ceph/ceph-client.admin.232389.log.gz 2023-09-10T09:22:47.590 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.410454.log.gz 2023-09-10T09:22:47.591 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.404378.log.gz 2023-09-10T09:22:47.591 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2023-09-10T09:22:47.591 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.383151.log.gz 2023-09-10T09:22:47.591 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.368551.log.gz 2023-09-10T09:22:47.592 INFO:teuthology.orchestra.run.smithi084.stderr: 71.9% -- replaced with /var/log/ceph/ceph-client.admin.167566.log.gz 2023-09-10T09:22:47.592 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.282942.log.gz 2023-09-10T09:22:47.592 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49147.log.gz 2023-09-10T09:22:47.592 INFO:teuthology.orchestra.run.smithi084.stderr: 71.3% -- replaced with /var/log/ceph/ceph-client.admin.231990.log.gz 2023-09-10T09:22:47.593 INFO:teuthology.orchestra.run.smithi084.stderr: 68.6% -- replaced with /var/log/ceph/ceph-client.admin.313004.log.gz 2023-09-10T09:22:47.593 INFO:teuthology.orchestra.run.smithi084.stderr: 69.1% -- replaced with /var/log/ceph/ceph-client.admin.335339.log.gz 2023-09-10T09:22:47.593 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.471876.log.gz 2023-09-10T09:22:47.593 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.285368.log.gz 2023-09-10T09:22:47.594 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.121082.log.gz 2023-09-10T09:22:47.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.157903.log.gz 2023-09-10T09:22:47.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.277533.log.gz 2023-09-10T09:22:47.595 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.348760.log.gz 2023-09-10T09:22:47.595 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.354860.log.gz 2023-09-10T09:22:47.595 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.272727.log.gz 2023-09-10T09:22:47.595 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208659.log.gz 2023-09-10T09:22:47.596 INFO:teuthology.orchestra.run.smithi084.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2023-09-10T09:22:47.596 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.340907.log.gz 2023-09-10T09:22:47.596 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.289738.log.gz 2023-09-10T09:22:47.597 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2023-09-10T09:22:47.597 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.295394.log.gz 2023-09-10T09:22:47.597 INFO:teuthology.orchestra.run.smithi084.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2023-09-10T09:22:47.597 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.223085.log.gz 2023-09-10T09:22:47.598 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.229213.log.gz 2023-09-10T09:22:47.598 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.207863.log.gz 2023-09-10T09:22:47.598 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.177113.log.gz 2023-09-10T09:22:47.598 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314293.log.gz 2023-09-10T09:22:47.599 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.184867.log.gz 2023-09-10T09:22:47.599 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45198.log.gz 2023-09-10T09:22:47.599 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47800.log.gz 2023-09-10T09:22:47.600 INFO:teuthology.orchestra.run.smithi084.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213132.log.gz 2023-09-10T09:22:47.600 INFO:teuthology.orchestra.run.smithi084.stderr: 73.7% -- replaced with /var/log/ceph/ceph-client.admin.198695.log.gz 2023-09-10T09:22:47.600 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2023-09-10T09:22:47.600 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.408868.log.gz 2023-09-10T09:22:47.601 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.222686.log.gz 2023-09-10T09:22:47.601 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.287354.log.gz 2023-09-10T09:22:47.601 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.389072.log.gz 2023-09-10T09:22:47.601 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.174334.log.gz 2023-09-10T09:22:47.604 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.222287.log.gz 2023-09-10T09:22:47.605 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.215175.log.gz 2023-09-10T09:22:47.605 INFO:teuthology.orchestra.run.smithi084.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.admin.123130.log.gz 2023-09-10T09:22:47.605 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.164606.log.gz 2023-09-10T09:22:47.606 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.181990.log.gz 2023-09-10T09:22:47.606 INFO:teuthology.orchestra.run.smithi084.stderr: 64.6% -- replaced with /var/log/ceph/ceph-client.admin.424951.log.gz 2023-09-10T09:22:47.606 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2023-09-10T09:22:47.607 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.149448.log.gz 2023-09-10T09:22:47.607 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.149054.log.gz 2023-09-10T09:22:47.607 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.226703.log.gz 2023-09-10T09:22:47.607 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.121091.log.gz 2023-09-10T09:22:47.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2023-09-10T09:22:47.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49449.log.gz 2023-09-10T09:22:47.608 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2023-09-10T09:22:47.608 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2023-09-10T09:22:47.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46771.log.gz 2023-09-10T09:22:47.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2023-09-10T09:22:47.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2023-09-10T09:22:47.609 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49423.log.gz 2023-09-10T09:22:47.610 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.197499.log.gz 2023-09-10T09:22:47.610 INFO:teuthology.orchestra.run.smithi084.stderr: 74.3% -- replaced with /var/log/ceph/ceph-client.admin.199118.log.gz 2023-09-10T09:22:47.610 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2023-09-10T09:22:47.611 INFO:teuthology.orchestra.run.smithi084.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43952.log.gz 2023-09-10T09:22:47.611 INFO:teuthology.orchestra.run.smithi084.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38183.log.gz 2023-09-10T09:22:47.611 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.243128.log.gz 2023-09-10T09:22:47.611 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2023-09-10T09:22:47.612 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43896.log.gz 2023-09-10T09:22:47.612 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48510.log.gz 2023-09-10T09:22:47.613 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.349154.log.gz 2023-09-10T09:22:47.613 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.305893.log.gz 2023-09-10T09:22:47.621 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.317035.log.gz 2023-09-10T09:22:47.647 INFO:teuthology.orchestra.run.smithi084.stderr: 71.2% -- replaced with /var/log/ceph/ceph-client.admin.181137.log.gz 2023-09-10T09:22:47.648 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.174732.log.gz 2023-09-10T09:22:47.651 INFO:teuthology.orchestra.run.smithi084.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.482995.log.gz 2023-09-10T09:22:47.677 INFO:teuthology.orchestra.run.smithi084.stderr: 65.2% -- replaced with /var/log/ceph/ceph-client.admin.193128.log.gz 2023-09-10T09:22:47.699 INFO:teuthology.orchestra.run.smithi084.stderr: 77.4% 71.1% -- replaced with /var/log/ceph/ceph-client.admin.37895.log.gz 71.2% 2023-09-10T09:22:47.699 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124738.log.gz 2023-09-10T09:22:47.699 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.126477.log.gz 2023-09-10T09:22:47.705 INFO:teuthology.orchestra.run.smithi084.stderr: 72.0% -- replaced with /var/log/ceph/ceph-client.admin.294596.log.gz 2023-09-10T09:22:47.721 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.332808.log.gz 2023-09-10T09:22:47.768 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.133159.log.gz 2023-09-10T09:22:47.798 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.245308.log.gz 2023-09-10T09:22:47.810 INFO:teuthology.orchestra.run.smithi084.stderr: 68.8% -- replaced with /var/log/ceph/ceph-client.admin.158298.log.gz 2023-09-10T09:22:47.811 INFO:teuthology.orchestra.run.smithi084.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38021.log.gz 2023-09-10T09:22:47.857 INFO:teuthology.orchestra.run.smithi084.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.168002.log.gz 2023-09-10T09:22:47.890 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.220272.log.gz 2023-09-10T09:22:47.899 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.163760.log.gz 2023-09-10T09:22:47.929 INFO:teuthology.orchestra.run.smithi100.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-10T09:22:47.971 INFO:teuthology.orchestra.run.smithi084.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.191493.log.gz 2023-09-10T09:22:48.007 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.187849.log.gz 2023-09-10T09:22:48.008 INFO:teuthology.orchestra.run.smithi084.stderr: 68.9% -- replaced with /var/log/ceph/ceph-client.admin.188247.log.gz 2023-09-10T09:22:48.090 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.313013.log.gz 2023-09-10T09:22:48.103 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.122707.log.gz 2023-09-10T09:22:48.123 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.172700.log.gz 2023-09-10T09:22:48.157 INFO:teuthology.orchestra.run.smithi084.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.189052.log.gz 2023-09-10T09:22:48.190 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.130091.log.gz 2023-09-10T09:22:48.202 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.284535.log.gz 2023-09-10T09:22:48.206 INFO:teuthology.orchestra.run.smithi084.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.242713.log.gz 2023-09-10T09:22:48.206 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.236879.log.gz 2023-09-10T09:22:48.208 INFO:teuthology.orchestra.run.smithi084.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.132513.log.gz 2023-09-10T09:22:48.233 INFO:teuthology.orchestra.run.smithi084.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.231999.log.gz 2023-09-10T09:22:48.245 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.371417.log.gz 2023-09-10T09:22:48.269 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.170137.log.gz 2023-09-10T09:22:48.278 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.276727.log.gz 2023-09-10T09:22:48.385 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.165043.log.gz 2023-09-10T09:22:48.393 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.159279.log.gz 2023-09-10T09:22:48.400 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.151468.log.gz 2023-09-10T09:22:48.414 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.169710.log.gz 2023-09-10T09:22:48.422 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.130523.log.gz 2023-09-10T09:22:48.444 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.181146.log.gz 2023-09-10T09:22:48.544 INFO:teuthology.orchestra.run.smithi084.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.125596.log.gz 2023-09-10T09:22:48.545 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.112144.log.gz 2023-09-10T09:22:48.591 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.195315.log.gz 2023-09-10T09:22:48.603 INFO:teuthology.orchestra.run.smithi084.stderr: 69.0% -- replaced with /var/log/ceph/ceph-client.admin.83448.log.gz 2023-09-10T09:22:48.603 INFO:teuthology.orchestra.run.smithi084.stderr: 65.0% -- replaced with /var/log/ceph/ceph-client.admin.123535.log.gz 2023-09-10T09:22:48.764 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.332397.log.gz 2023-09-10T09:22:48.826 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.221481.log.gz 2023-09-10T09:22:48.828 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.230000.log.gz 2023-09-10T09:22:48.831 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.315113.log.gz 2023-09-10T09:22:48.862 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.168856.log.gz 2023-09-10T09:22:48.862 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-10T09:22:48.863 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154498.log.gz 2023-09-10T09:22:48.878 INFO:teuthology.orchestra.run.smithi084.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.121895.log.gz 2023-09-10T09:22:48.982 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.282460.log.gz 2023-09-10T09:22:49.021 INFO:teuthology.orchestra.run.smithi084.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gz 2023-09-10T09:22:49.034 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.204759.log.gz 2023-09-10T09:22:49.074 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.406636.log.gz 2023-09-10T09:22:49.102 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.181999.log.gz 2023-09-10T09:22:49.124 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.394854.log.gz 2023-09-10T09:22:49.177 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46095.log.gz 2023-09-10T09:22:49.182 INFO:teuthology.orchestra.run.smithi084.stderr: 71.1% -- replaced with /var/log/ceph/ceph-client.admin.332799.log.gz 2023-09-10T09:22:49.183 INFO:teuthology.orchestra.run.smithi084.stderr: 71.7% -- replaced with /var/log/ceph/ceph-client.admin.334040.log.gz 2023-09-10T09:22:49.184 INFO:teuthology.orchestra.run.smithi084.stderr: 73.5% -- replaced with /var/log/ceph/ceph-client.admin.227092.log.gz 2023-09-10T09:22:49.185 INFO:teuthology.orchestra.run.smithi084.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.224285.log.gz 2023-09-10T09:22:49.251 INFO:teuthology.orchestra.run.smithi084.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.243137.log.gz 2023-09-10T09:22:49.285 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.331974.log.gz 2023-09-10T09:22:49.357 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.168428.log.gz 2023-09-10T09:22:49.365 INFO:teuthology.orchestra.run.smithi084.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.236453.log.gz 2023-09-10T09:22:49.433 INFO:teuthology.orchestra.run.smithi084.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.163327.log.gz 2023-09-10T09:22:49.644 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.112951.log.gz 2023-09-10T09:22:49.646 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2023-09-10T09:22:49.650 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.96267.log.gz 2023-09-10T09:22:49.657 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44623.log.gz 2023-09-10T09:22:49.658 INFO:teuthology.orchestra.run.smithi084.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2023-09-10T09:22:49.713 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.383947.log.gz 2023-09-10T09:22:49.888 INFO:teuthology.orchestra.run.smithi100.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-09-10T09:22:49.895 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.306328.log.gz 2023-09-10T09:22:49.971 INFO:teuthology.orchestra.run.smithi084.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.156575.log.gz 2023-09-10T09:22:50.019 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.172272.log.gz 2023-09-10T09:22:50.099 INFO:teuthology.orchestra.run.smithi084.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.318883.log.gz 2023-09-10T09:22:50.114 INFO:teuthology.orchestra.run.smithi084.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.157437.log.gz 2023-09-10T09:22:50.172 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.166296.log.gz 2023-09-10T09:22:50.250 INFO:teuthology.orchestra.run.smithi084.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.358478.log.gz 2023-09-10T09:22:50.298 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.346174.log.gz 2023-09-10T09:22:50.352 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.318439.log.gz 2023-09-10T09:22:50.459 INFO:teuthology.orchestra.run.smithi084.stderr: 71.4% -- replaced with /var/log/ceph/ceph-client.admin.467880.log.gz 2023-09-10T09:22:50.476 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.344539.log.gz 2023-09-10T09:22:50.491 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.421101.log.gz 2023-09-10T09:22:50.516 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.468676.log.gz 2023-09-10T09:22:50.548 INFO:teuthology.orchestra.run.smithi084.stderr: 74.2% -- replaced with /var/log/ceph/ceph-client.admin.419873.log.gz 2023-09-10T09:22:50.643 INFO:teuthology.orchestra.run.smithi084.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.99909.log.gz 2023-09-10T09:22:50.652 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.352835.log.gz 2023-09-10T09:22:50.900 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48640.log.gz 2023-09-10T09:22:50.934 INFO:teuthology.orchestra.run.smithi084.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.335348.log.gz 2023-09-10T09:22:50.977 INFO:teuthology.orchestra.run.smithi084.stderr: 73.4% -- replaced with /var/log/ceph/ceph-client.admin.198296.log.gz 2023-09-10T09:22:51.148 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.301665.log.gz 2023-09-10T09:22:51.169 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.234824.log.gz 2023-09-10T09:22:51.226 INFO:teuthology.orchestra.run.smithi084.stderr: 65.1% -- replaced with /var/log/ceph/ceph-client.admin.97508.log.gz 2023-09-10T09:22:51.276 INFO:teuthology.orchestra.run.smithi084.stderr: 71.6% -- replaced with /var/log/ceph/ceph-client.admin.277121.log.gz 2023-09-10T09:22:51.334 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.397748.log.gz 2023-09-10T09:22:51.361 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.291748.log.gz 2023-09-10T09:22:51.536 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.173534.log.gz 2023-09-10T09:22:51.539 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.171417.log.gz 2023-09-10T09:22:51.624 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.155750.log.gz 2023-09-10T09:22:51.745 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.186880.log.gz 2023-09-10T09:22:51.762 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.346478.log.gz 2023-09-10T09:22:51.956 INFO:teuthology.orchestra.run.smithi084.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.194886.log.gz 2023-09-10T09:22:52.138 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.316545.log.gz 2023-09-10T09:22:52.240 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.411259.log.gz 2023-09-10T09:22:52.283 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.346525.log.gz 2023-09-10T09:22:52.326 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.300310.log.gz 2023-09-10T09:22:52.465 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.391875.log.gz 2023-09-10T09:22:53.632 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.82063.log.gz 2023-09-10T09:22:53.656 INFO:teuthology.orchestra.run.smithi084.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.317509.log.gz 2023-09-10T09:22:53.885 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.315575.log.gz 2023-09-10T09:22:55.175 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-09-10T09:22:55.191 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.158767.log.gz 2023-09-10T09:22:55.462 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.206962.log.gz 2023-09-10T09:22:56.280 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.195770.log.gz 2023-09-10T09:22:57.191 INFO:teuthology.orchestra.run.smithi084.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.83457.log.gz 2023-09-10T09:23:04.412 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.342398.log.gz 2023-09-10T09:23:06.688 INFO:teuthology.orchestra.run.smithi084.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.94711.log.gz 2023-09-10T09:23:08.156 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.334876.log.gz 2023-09-10T09:23:08.536 INFO:teuthology.orchestra.run.smithi084.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.227101.log.gz 2023-09-10T09:23:12.064 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-09-10T09:23:12.104 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.215604.log.gz 2023-09-10T09:23:14.825 INFO:teuthology.orchestra.run.smithi084.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.279940.log.gz 2023-09-10T09:23:17.889 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.86500.log.gz 2023-09-10T09:23:18.751 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.215184.log.gz 2023-09-10T09:23:18.987 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.244075.log.gz 2023-09-10T09:23:19.060 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.85240.log.gz 2023-09-10T09:23:19.427 INFO:teuthology.orchestra.run.smithi084.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.97092.log.gz 2023-09-10T09:23:19.647 INFO:teuthology.orchestra.run.smithi084.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.93806.log.gz 2023-09-10T09:23:20.447 INFO:teuthology.orchestra.run.smithi084.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.94257.log.gz 2023-09-10T09:23:20.815 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.110016.log.gz 2023-09-10T09:23:21.076 INFO:teuthology.orchestra.run.smithi084.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.193590.log.gz 2023-09-10T09:23:21.244 INFO:teuthology.orchestra.run.smithi084.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.88635.log.gz 2023-09-10T09:23:22.026 INFO:teuthology.orchestra.run.smithi084.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.401315.log.gz 2023-09-10T09:23:22.414 INFO:teuthology.orchestra.run.smithi084.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.280353.log.gz 2023-09-10T09:23:22.959 INFO:teuthology.orchestra.run.smithi084.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.84832.log.gz 2023-09-10T09:23:22.977 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.111304.log.gz 2023-09-10T09:23:23.199 INFO:teuthology.orchestra.run.smithi084.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.350791.log.gz 2023-09-10T09:23:23.755 INFO:teuthology.orchestra.run.smithi084.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.280838.log.gz 2023-09-10T09:23:23.912 INFO:teuthology.orchestra.run.smithi084.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.110460.log.gz 2023-09-10T09:23:24.605 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.109171.log.gz 2023-09-10T09:23:24.676 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.311249.log.gz 2023-09-10T09:23:24.906 INFO:teuthology.orchestra.run.smithi084.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.196270.log.gz 2023-09-10T09:23:24.928 INFO:teuthology.orchestra.run.smithi084.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.214733.log.gz 2023-09-10T09:23:27.288 INFO:teuthology.orchestra.run.smithi084.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.304652.log.gz 2023-09-10T09:23:30.533 INFO:teuthology.orchestra.run.smithi084.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.381503.log.gz 2023-09-10T09:23:31.659 INFO:teuthology.orchestra.run.smithi084.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.115020.log.gz 2023-09-10T09:23:34.766 INFO:teuthology.orchestra.run.smithi084.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.192697.log.gz 2023-09-10T09:23:35.027 INFO:teuthology.orchestra.run.smithi084.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.341314.log.gz 2023-09-10T09:23:40.301 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.90284.log.gz 2023-09-10T09:23:40.826 INFO:teuthology.orchestra.run.smithi084.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.206016.log.gz 2023-09-10T09:23:44.843 INFO:teuthology.orchestra.run.smithi084.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.343287.log.gz 2023-09-10T09:23:50.927 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.422732.log.gz 2023-09-10T09:23:53.968 INFO:teuthology.orchestra.run.smithi084.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.212298.log.gz 2023-09-10T09:23:58.347 INFO:teuthology.orchestra.run.smithi100.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-10T09:24:12.106 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.209919.log.gz 2023-09-10T09:24:12.164 INFO:teuthology.orchestra.run.smithi084.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.420678.log.gz 2023-09-10T09:24:14.957 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-10T09:24:51.420 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.218218.log.gz 2023-09-10T09:25:12.013 INFO:teuthology.orchestra.run.smithi084.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.152321.log.gz 2023-09-10T09:25:19.789 INFO:teuthology.orchestra.run.smithi084.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.193137.log.gz 2023-09-10T09:25:20.905 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.87560.log.gz 2023-09-10T09:25:28.545 INFO:teuthology.orchestra.run.smithi084.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.120633.log.gz 2023-09-10T09:25:39.918 INFO:teuthology.orchestra.run.smithi084.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.297013.log.gz 2023-09-10T09:26:30.121 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.152783.log.gz 2023-09-10T09:26:34.063 INFO:teuthology.orchestra.run.smithi084.stderr: 97.9% -- replaced with /var/log/ceph/ceph-client.admin.100346.log.gz 2023-09-10T09:27:29.119 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-09-10T09:27:32.050 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.114161.log.gz 2023-09-10T09:27:45.184 INFO:teuthology.orchestra.run.smithi084.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.129601.log.gz 2023-09-10T09:27:49.575 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-09-10T09:27:49.577 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-09-10T09:27:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:real 5m9.463s 2023-09-10T09:27:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:user 5m51.552s 2023-09-10T09:27:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m16.401s 2023-09-10T09:27:58.217 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.87776.log.gz 2023-09-10T09:28:21.721 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.313828.log.gz 2023-09-10T09:28:37.106 INFO:teuthology.orchestra.run.smithi084.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-09-10T09:28:56.232 INFO:teuthology.orchestra.run.smithi084.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.161962.log.gz 2023-09-10T09:29:42.228 INFO:teuthology.orchestra.run.smithi084.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.133588.log.gz 2023-09-10T09:30:02.795 INFO:teuthology.orchestra.run.smithi084.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.83942.log.gz 2023-09-10T09:31:41.076 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.86047.log.gz 2023-09-10T09:34:17.372 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.246914.log.gz 2023-09-10T09:34:51.656 INFO:teuthology.orchestra.run.smithi084.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.227532.log.gz 2023-09-10T09:35:51.936 INFO:teuthology.orchestra.run.smithi084.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.320306.log.gz 2023-09-10T09:36:30.670 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.84388.log.gz 2023-09-10T09:38:25.025 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-10T09:38:33.413 INFO:teuthology.orchestra.run.smithi084.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.207411.log.gz 2023-09-10T09:38:41.314 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.86952.log.gz 2023-09-10T09:39:53.072 INFO:teuthology.orchestra.run.smithi084.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.237311.log.gz 2023-09-10T09:48:30.081 INFO:teuthology.orchestra.run.smithi084.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.373641.log.gz 2023-09-10T09:49:55.009 INFO:teuthology.orchestra.run.smithi084.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-10T09:50:11.981 INFO:teuthology.orchestra.run.smithi084.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.159288.log.gz 2023-09-10T09:50:47.398 INFO:teuthology.orchestra.run.smithi084.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-10T09:52:07.910 INFO:teuthology.orchestra.run.smithi084.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-10T10:01:50.441 INFO:teuthology.orchestra.run.smithi084.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.366501.log.gz 2023-09-10T10:02:02.635 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.365343.log.gz 2023-09-10T10:02:56.677 INFO:teuthology.orchestra.run.smithi084.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-10T10:06:42.236 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.475111.log.gz 2023-09-10T10:08:27.098 INFO:teuthology.orchestra.run.smithi084.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.126486.log.gz 2023-09-10T10:11:27.940 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-09-10T10:22:48.687 INFO:teuthology.orchestra.run.smithi084.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.115842.log.gz 2023-09-10T10:25:28.275 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.428216.log.gz 2023-09-10T10:25:28.276 INFO:teuthology.orchestra.run.smithi084.stderr: 2023-09-10T10:25:28.276 INFO:teuthology.orchestra.run.smithi084.stderr:real 62m48.210s 2023-09-10T10:25:28.277 INFO:teuthology.orchestra.run.smithi084.stderr:user 51m8.867s 2023-09-10T10:25:28.277 INFO:teuthology.orchestra.run.smithi084.stderr:sys 2m30.669s 2023-09-10T10:25:28.278 INFO:tasks.ceph:Archiving logs... 2023-09-10T10:25:28.280 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi084/log 2023-09-10T10:25:28.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-10T10:35:55.894 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi100/log 2023-09-10T10:35:55.918 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-10T10:41:57.526 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-10T10:41:57.538 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-10T10:41:57.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-10T10:41:57.543 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-10T10:41:57.620 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-10T10:41:57.628 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-10T10:41:57.629 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-10T10:41:57.631 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-10T10:41:57.685 INFO:teuthology.orchestra.run.smithi084.stdout: remote refid st t when poll reach delay offset jitter 2023-09-10T10:41:57.686 INFO:teuthology.orchestra.run.smithi084.stdout:============================================================================== 2023-09-10T10:41:57.686 INFO:teuthology.orchestra.run.smithi084.stdout:*hv01.front.sepi 44.4.53.2 2 u 384 1024 377 0.179 -2.584 5.327 2023-09-10T10:41:57.686 INFO:teuthology.orchestra.run.smithi084.stdout:+hv02.front.sepi 63.231.80.2 3 u 310 1024 377 0.203 -1.354 5.136 2023-09-10T10:41:57.686 INFO:teuthology.orchestra.run.smithi084.stdout:+hv03.front.sepi 74.6.168.72 3 u 355 1024 377 0.222 -3.903 5.576 2023-09-10T10:41:57.687 INFO:teuthology.orchestra.run.smithi084.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-09-10T10:41:57.710 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2023-09-10T10:41:57.710 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2023-09-10T10:41:57.710 INFO:teuthology.orchestra.run.smithi100.stdout:*hv01.front.sepi 44.4.53.2 2 u 137 1024 377 0.221 -1.561 3.029 2023-09-10T10:41:57.711 INFO:teuthology.orchestra.run.smithi100.stdout:+hv02.front.sepi 63.231.80.2 3 u 578 1024 377 0.208 +0.038 2.627 2023-09-10T10:41:57.711 INFO:teuthology.orchestra.run.smithi100.stdout:+hv03.front.sepi 74.6.168.72 3 u 340 1024 377 0.177 -2.634 3.113 2023-09-10T10:41:57.711 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-09-10T10:41:57.712 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-10T10:41:57.722 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-10T10:41:57.723 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-10T10:41:57.733 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-10T10:41:57.743 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-10T10:41:57.752 INFO:teuthology.task.internal:Duration was 38434.363679 seconds 2023-09-10T10:41:57.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-10T10:41:57.761 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-10T10:41:57.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-10T10:41:57.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-10T10:41:58.000 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-10T10:41:58.000 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2023-09-10T10:41:58.001 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-10T10:41:58.104 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2023-09-10T10:41:58.104 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-10T10:41:58.131 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-10T10:41:58.131 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-10T10:41:58.134 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-10T10:41:58.264 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-10T10:41:58.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-10T10:41:58.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-10T10:41:59.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-10T10:41:59.242 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-10T10:41:59.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-10T10:41:59.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-10T10:41:59.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-10T10:41:59.316 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-10T10:41:59.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-10T10:41:59.342 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2023-09-10T10:41:59.355 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2023-09-10T10:41:59.395 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-10T10:41:59.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T10:41:59.418 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-10T10:41:59.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-10T10:41:59.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-10T10:41:59.453 INFO:teuthology.task.internal:Transferring archived files... 2023-09-10T10:41:59.455 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi084 2023-09-10T10:41:59.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-10T10:41:59.502 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514/remote/smithi100 2023-09-10T10:41:59.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-10T10:41:59.523 INFO:teuthology.task.internal:Removing archive directory... 2023-09-10T10:41:59.524 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-10T10:41:59.540 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-10T10:41:59.567 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-10T10:41:59.579 INFO:teuthology.task.internal:Not uploading archives. 2023-09-10T10:41:59.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-10T10:41:59.589 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-10T10:41:59.590 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-10T10:41:59.593 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-10T10:41:59.597 INFO:teuthology.orchestra.run.smithi084.stdout: 655475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:41 /home/ubuntu/cephtest 2023-09-10T10:41:59.615 INFO:teuthology.orchestra.run.smithi100.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 10:41 /home/ubuntu/cephtest 2023-09-10T10:41:59.616 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-10T10:41:59.627 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-10T10:41:59.648 INFO:teuthology.nuke:Checking targets against current locks 2023-09-10T10:41:59.676 DEBUG:teuthology.nuke:shortname: smithi084 2023-09-10T10:41:59.676 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-10T10:41:59.701 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-09 23:52:57.511702', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLybwlcIyj00H+jeLtM8lPFyNiL68Ef1XVNXa8m7uetT2eJy6/Ti3ws/mG5wk8tu62Ndj5Y3aqu/IimCUAAhdgk='} 2023-09-10T10:41:59.705 DEBUG:teuthology.nuke:shortname: smithi100 2023-09-10T10:41:59.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-10T10:41:59.726 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-09_19:00:20-fs-wip-batrick-testing-20230909.145638-distro-default-smithi/7392514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-09 23:52:57.510098', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFanmScQKbUsmU2qk9kD/DpJR5YjQLrBNoqA6hS2EXJZivkW1KlXmYgmbGmVBjhQThLp2Ek5bO6LjekpW/Vy6Ow='} 2023-09-10T10:41:59.756 INFO:teuthology.orchestra.console.smithi084:Power off 2023-09-10T10:41:59.758 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-10T10:41:59.815 INFO:teuthology.orchestra.console.smithi100:Power off 2023-09-10T10:41:59.815 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-10T10:41:59.920 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-09-10T10:41:59.921 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:41:59.929 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-09-10T10:41:59.930 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:41:59.944 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-09-10T10:41:59.956 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-09-10T10:42:03.945 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:42:03.957 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:42:04.056 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-09-10T10:42:04.068 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-09-10T10:42:08.059 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:42:08.068 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:42:08.170 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-09-10T10:42:08.179 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-09-10T10:42:08.272 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-09-10T10:42:12.183 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-10T10:42:12.293 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-09-10T10:42:12.394 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-09-10T10:42:12.499 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 38434.36367869377 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=20cb6af52c1347569f5182647a8e53e4 status: fail success: false 2023-09-10T10:42:12.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-10T10:42:12.586 INFO:teuthology.run:FAIL